> ## Documentation Index > Fetch the complete documentation index at: https://docs.zeroruntime.ai/llms.txt > Use this file to discover all available pages before exploring further. # Run an Evaluation > Grade scenarios, a finished simulation run, or live calls with the judges you pick, or grade calls automatically as they happen. Select **Run evaluation** in the **Evals** page header to open the **Run evaluation** panel. You pick what to grade, which judges grade it, and the scorecard. An agent runs one evaluation at a time. While a run is going, **Run evaluation** is disabled, and hovering it shows which run is still going. ## Choose what to grade Under **What to grade**, choose one: | Source | What it grades | | - | - | | **Scenarios** | Plays each scenario you pick with a simulated caller, then grades every try. | | **Simulation run** | Grades the calls of a simulation run that already finished. Nothing new is simulated. | | **Live calls** | Grades real calls the agent took. | ### Scenarios ![Run evaluation panel with Scenarios selected, the Main branch at 100% traffic, three of four scenarios ticked, the Calm customer persona, 3 tries per scenario, all ten judges selected, the Default scorecard, and the summary 3 scenarios × 3 tries = 9 conversations](https://cdn.zeroruntime.ai/zrt/docs-resource/agent-builder/run-evaluation-scenarios.png) **1. Version** Choose the branch of the agent to test. It defaults to the branch serving live traffic. Agents deployed to Zero Runtime Cloud have no branches, so this field doesn't appear for them. **2. Scenarios** Tick the [scenarios](https://docs.zeroruntime.ai/agent-builder/simulation/scenarios.md) to play, or select **Select all**. Select **Manage in Simulation** to add or edit scenarios. **3. Caller persona** Choose the [persona](https://docs.zeroruntime.ai/agent-builder/simulation/personas.md) who calls in every scenario. **4. Tries per scenario** Choose **1**, **3**, or **5**. Defaults to 3. * **1** try is the quickest check. * **3** tries show whether a pass is reliable. * **5** tries catch rare failures. The run has one conversation per scenario per try. For example, 4 scenarios × 3 tries make 12 conversations. ### Simulation run Pick a finished [simulation run](https://docs.zeroruntime.ai/agent-builder/simulation/run-a-simulation.md) of this agent. Every conversation that ended is graded. You can't pick conversations one by one. If the simulation run is still going, the conversations that haven't ended are left out. ### Live calls Choose how to pick the calls: * **Pick calls**: tick calls from the agent's call list, newest first. Each call shows when it happened, how long it lasted, its number of turns, and the caller's first words. Select **Load more calls** to see older ones. * **Date range**: every call from the last **24 hours**, **7 days**, or **30 days**, up to 50, 100, 250, or 500 calls. Simulated calls are left out, and very short calls may be skipped. ![Run evaluation panel with Live calls and Pick calls selected, two of three calls ticked showing their time, duration, turns, and the caller's first words, the judges, the Default scorecard, and the summary 2 live calls picked](https://cdn.zeroruntime.ai/zrt/docs-resource/agent-builder/run-evaluation-live-calls.png) ## Pick the judges Under **Judges**, tick the judges that grade this run. The list starts with the judges that are on [auto run](https://docs.zeroruntime.ai/agent-builder/evaluations/judges.md#auto-run) for this agent. Add or remove any judge for this run only. Pick at least one. ## Pick the scorecard Under **Scorecard**, choose how each call's verdicts become a score. It starts on the scorecard the agent's auto run uses, or **Default**. Select **New scorecard** in the dropdown to create one. See [Scorecards](https://docs.zeroruntime.ai/agent-builder/evaluations/scorecards.md). ## Start the run The bottom of the panel sums up what will run, for example *4 scenarios × 3 tries = 12 conversations*, or says what's still missing. Select **Run evaluation** to start. You go straight to the run, where scores appear when every try is graded. You can leave the page while it runs. See [Review results](https://docs.zeroruntime.ai/agent-builder/evaluations/review-results.md). ## Grade calls automatically Auto run grades this agent's calls without you starting a run. Set it up in the agent builder: open the agent and select the **Evals** tab. For an agent deployed to Zero Runtime Cloud, open the deployment and select its **Evals** tab. ![Agent builder Evals tab with the Auto run card, its Live calls and Simulation runs switches, the scorecard picker with Manage scorecards, and the Manage judges button](https://cdn.zeroruntime.ai/zrt/docs-resource/agent-builder/agent-evals-tab.png) | Setting | What it does | | - | - | | **Live calls** | Grades every finished call. Each day's calls join one auto run. | | **Which live calls** | **Every call**, **1 in 2 calls**, **1 in 4 calls**, or **1 in 10 calls**, picked at random. Shown when **Live calls** is on. | | **Daily limit** | **No daily limit**, or up to 50, 100, 500, or 1000 calls a day. Shown when **Live calls** is on. | | **Simulation runs** | Grades every simulation run of this agent when it ends, in a run of its own. The sample and daily limit don't apply. | | **Scorecard** | The scorecard auto runs score each call with. | Auto runs grade with the judges that are on for this agent. The tab lists them; select **Manage judges** to change them on the **Judges** tab. You need at least one judge on before you can switch auto run on. Auto runs show up on the **Runs** tab as **Auto run · live calls** or **Auto run · simulation**. ## Cost Each LLM or audio judge reads each graded call once, and each read is billed as model usage on your account. Code checks don't use a model. For example, with 5 judges on and **1 in 4 calls** selected, one live call in four, on average, costs 5 judge reads. A graded simulation run costs 5 judge reads for every conversation in it. Runs you start yourself are billed the same way. When you grade **Scenarios**, the simulated conversations are also billed as a [simulation](https://docs.zeroruntime.ai/agent-builder/simulation/run-a-simulation.md#cost). Skipped calls aren't charged. ## Limits | Setting | Limit | | - | - | | Runs going at once, per agent | 1 | | Calls per run | 500 | | Tries per scenario | 1, 3, or 5 | This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.