Quickstart: console

Sign inCopy Anchor Link

Open the console and sign in with Google, or with your email address and password.

The first time, the console asks you to Name your workspace. Enter your organisation and a first project, then choose Create workspace. A project holds applications, worlds, agents and runs.

Add an applicationCopy Anchor Link

The console now asks you to Add your first application. There are two choices.

• Start with the sample applications adds the open-source applications that Rehearsal is tested on. There are eight, each pinned to an exact version. Use this choice on a server your team runs, or on a plan that keeps eight applications or more.
• Connect your own application adds one application. Use this choice on the Free and Pro plans, which keep fewer applications than the samples need.

To add one sample by hand, choose Connect your own application and enter these values for Gitea, which come from Rehearsal's own catalog:

Then choose Add application. To add your own application instead, read Add an application first.

Build the worldCopy Anchor Link

Choose Build world beside the application. The console opens the build view.

1. 1. Read the source
   inspect
2. 2. Plan the runtime
   plan
3. 3. Start the sandbox
   materialize
4. 4. Find the API
   discover
5. 5. Seed fictional data
   seed
6. 6. Choose agent tools
   adapt
7. 7. Write scenarios
   author
8. 8. Validate and repair
   validate
9. 9. Publish
   package

The build goes through nine phases. The view shows which phase is in progress, what the compiler is doing, and a feed of its actions. You do not need to watch. When the last phase is done, the world version is published and the button Open the world appears.

If the build stops, the view says why. Read Build a practice world before you choose Restart build.

Create an agentCopy Anchor Link

Open Agents and choose Create a profile.

• Name: for example support-agent.
• Instructions: what you want the agent to do and not do. You can leave this empty to test the platform's default instructions.

Choose Create profile. A profile is one version of an agent: its instructions and its model.

Run an evaluationCopy Anchor Link

Open Runs and choose Run an evaluation.

• World version: the version you built.
• Agents: your profile.
• Scenario splits: choose dev for a first look.
• Repeats per scenario: 2. One attempt at a job is not enough to judge an agent.

Choose Start evaluation. A run usually takes 2 to 10 minutes. The run page shows each episode as it finishes.

Open an episodeCopy Anchor Link

On the run page, the Episodes table has one row for each attempt, with its outcome: verified, not achieved or rule violated.

Choose an episode that is not verified. Under Independent checks, each check shows what the database held and what was wanted. The timeline shows each action the agent took, with its result.