---
title: "oz0 compare-savings start"
description: "Plan a comparison of AGENT as defined against a variant and start it."
canonical_url: "https://docs.oz0.ai/reference/cli/oz0/compare-savings/start"
---
# oz0 compare-savings start

> Plan a comparison of AGENT as defined against a variant and start it.

For: Operators and developers looking up a command.

Plan a comparison of AGENT as defined against a variant and start it. The plan says how many runs it makes, what they are expected to cost (the agent's median billed cost per job over 30 days, or --cost-per-run when it has none), and the power to show an equal pass rate. A start whose estimate does not fit --budget, or what is left of the tenant's monthly budget, is refused before anything runs.

Cases are the agent's eval cases (--cases evals, graded by each case's expect) or the inputs of its recent top-level jobs (--cases recent, passed when the job completes; a data subject's job is never a case).

## Usage

```bash
oz0 compare-savings start AGENT --budget USD [--variant-model M | --variant-tool-loading lazy|eager | --variant-tools F,... | --variant-cache off | --variant-offload on|off|N] [flags]
```

## Flags

<table>
<thead>
  <tr>
    <th>
      Flag
    </th>
    
    <th>
      Type
    </th>
    
    <th>
      Default
    </th>
    
    <th>
      Description
    </th>
  </tr>
</thead>

<tbody>
  <tr>
    <td>
      <code>
        --baseline-cache
      </code>
    </td>
    
    <td>
      string
    </td>
    
    <td>
      
    </td>
    
    <td>
      off: the baseline's model calls go without the gateway's prompt-cache management
    </td>
  </tr>
  
  <tr>
    <td>
      <code>
        --baseline-model
      </code>
    </td>
    
    <td>
      string
    </td>
    
    <td>
      <code>
        as defined
      </code>
    </td>
    
    <td>
      the baseline runs on this model alone
    </td>
  </tr>
  
  <tr>
    <td>
      <code>
        --baseline-offload
      </code>
    </td>
    
    <td>
      string
    </td>
    
    <td>
      
    </td>
    
    <td>
      the baseline's large tool results: off (all inline), on, or a threshold in tokens
    </td>
  </tr>
  
  <tr>
    <td>
      <code>
        --baseline-tool-loading
      </code>
    </td>
    
    <td>
      string
    </td>
    
    <td>
      <code>
        as defined
      </code>
    </td>
    
    <td>
      the baseline's tool loading
    </td>
  </tr>
  
  <tr>
    <td>
      <code>
        --baseline-tools
      </code>
    </td>
    
    <td>
      strings
    </td>
    
    <td>
      <code>
        all
      </code>
    </td>
    
    <td>
      the baseline offers only these plugin functions
    </td>
  </tr>
  
  <tr>
    <td>
      <code>
        --budget
      </code>
    </td>
    
    <td>
      float
    </td>
    
    <td>
      
    </td>
    
    <td>
      what the comparison may spend, in dollars (required)
    </td>
  </tr>
  
  <tr>
    <td>
      <code>
        --cases
      </code>
    </td>
    
    <td>
      string
    </td>
    
    <td>
      <code>
        evals
      </code>
    </td>
    
    <td>
      evals (the agent's eval cases) or recent (inputs of its jobs that completed in the last 7 days)
    </td>
  </tr>
  
  <tr>
    <td>
      <code>
        --confidence
      </code>
    </td>
    
    <td>
      float
    </td>
    
    <td>
      <code>
        0.95
      </code>
    </td>
    
    <td>
      the intervals' confidence
    </td>
  </tr>
  
  <tr>
    <td>
      <code>
        --cost-per-run
      </code>
    </td>
    
    <td>
      float
    </td>
    
    <td>
      
    </td>
    
    <td>
      the estimate's cost of one run, when the agent has no recent jobs to estimate from
    </td>
  </tr>
  
  <tr>
    <td>
      <code>
        --dry-run
      </code>
    </td>
    
    <td>
      bool
    </td>
    
    <td>
      
    </td>
    
    <td>
      only show the plan: the estimate and the power
    </td>
  </tr>
  
  <tr>
    <td>
      <code>
        --json
      </code>
    </td>
    
    <td>
      bool
    </td>
    
    <td>
      
    </td>
    
    <td>
      print JSON instead of a table
    </td>
  </tr>
  
  <tr>
    <td>
      <code>
        --margin
      </code>
    </td>
    
    <td>
      float
    </td>
    
    <td>
      <code>
        5
      </code>
    </td>
    
    <td>
      the non-inferiority margin, in points of pass rate
    </td>
  </tr>
  
  <tr>
    <td>
      <code>
        --max-cases
      </code>
    </td>
    
    <td>
      int32
    </td>
    
    <td>
      <code>
        10, at most 50
      </code>
    </td>
    
    <td>
      with --cases recent, at most this many inputs
    </td>
  </tr>
  
  <tr>
    <td>
      <code>
        --output
      </code>
      
       (<code>
        -o
      </code>
      
      )
    </td>
    
    <td>
      string
    </td>
    
    <td>
      
    </td>
    
    <td>
      with --wait, write the result's JSON export to this file
    </td>
  </tr>
  
  <tr>
    <td>
      <code>
        --poll
      </code>
    </td>
    
    <td>
      duration
    </td>
    
    <td>
      <code>
        2s
      </code>
    </td>
    
    <td>
      with --wait, how often to look
    </td>
  </tr>
  
  <tr>
    <td>
      <code>
        --runs
      </code>
    </td>
    
    <td>
      int32
    </td>
    
    <td>
      <code>
        3, at most 10
      </code>
    </td>
    
    <td>
      runs per arm and case
    </td>
  </tr>
  
  <tr>
    <td>
      <code>
        --tenant
      </code>
    </td>
    
    <td>
      string
    </td>
    
    <td>
      <code>
        default
      </code>
    </td>
    
    <td>
      tenant
    </td>
  </tr>
  
  <tr>
    <td>
      <code>
        --variant-cache
      </code>
    </td>
    
    <td>
      string
    </td>
    
    <td>
      
    </td>
    
    <td>
      off: the variant's model calls go without the gateway's prompt-cache management
    </td>
  </tr>
  
  <tr>
    <td>
      <code>
        --variant-model
      </code>
    </td>
    
    <td>
      string
    </td>
    
    <td>
      
    </td>
    
    <td>
      the variant runs on this model alone: an alias or &lt;provider>/&lt;model>
    </td>
  </tr>
  
  <tr>
    <td>
      <code>
        --variant-offload
      </code>
    </td>
    
    <td>
      string
    </td>
    
    <td>
      
    </td>
    
    <td>
      the variant's large tool results: off (all inline), on, or a threshold in tokens; measured on read-only results
    </td>
  </tr>
  
  <tr>
    <td>
      <code>
        --variant-tool-loading
      </code>
    </td>
    
    <td>
      string
    </td>
    
    <td>
      
    </td>
    
    <td>
      the variant loads its tools eagerly or lazily: eager or lazy
    </td>
  </tr>
  
  <tr>
    <td>
      <code>
        --variant-tools
      </code>
    </td>
    
    <td>
      strings
    </td>
    
    <td>
      
    </td>
    
    <td>
      the variant offers only these of the agent's plugin functions
    </td>
  </tr>
  
  <tr>
    <td>
      <code>
        --wait
      </code>
    </td>
    
    <td>
      bool
    </td>
    
    <td>
      
    </td>
    
    <td>
      wait for the result and print it
    </td>
  </tr>
</tbody>
</table>

## Inherited flags

<table>
<thead>
  <tr>
    <th>
      Flag
    </th>
    
    <th>
      Type
    </th>
    
    <th>
      Default
    </th>
    
    <th>
      Description
    </th>
  </tr>
</thead>

<tbody>
  <tr>
    <td>
      <code>
        --context
      </code>
    </td>
    
    <td>
      string
    </td>
    
    <td>
      <code>
        $OZ0_CONTEXT or &lt;config dir>/orchestrator-zero/context.json
      </code>
    </td>
    
    <td>
      CLI context file written by server init
    </td>
  </tr>
  
  <tr>
    <td>
      <code>
        --log-level
      </code>
    </td>
    
    <td>
      string
    </td>
    
    <td>
      <code>
        info
      </code>
    </td>
    
    <td>
      log level: debug, info, warn or error
    </td>
  </tr>
</tbody>
</table>

See [all `oz0` commands](https://docs.oz0.ai/reference/cli/oz0) and the [global flags](https://docs.oz0.ai/reference/cli/oz0#global-flags).


## Sitemap

See the full [sitemap](https://docs.oz0.ai/sitemap.md) for all pages.