oz0 tenant quality
For: Operators and developers looking up a command.
--sample AGENT=RATE[:JUDGE] has a judge look at that share of the agent's finished jobs after the fact (a rule of the tenant's own, which wins over the agent's quality.sample; RATE 0 turns it off); JUDGE is a model alias or <provider>/<model>, and --sample-rubric-file the rubric it judges by, else the agent's own. --unsample AGENT removes a rule. Agents with an outcome check are judged on every job already and are never sampled.
Each judge job is a model call through the gateway, metered to the tenant and left out of the usage figures.
--sample-subject-jobs on lets jobs about a data subject be sampled too (off by default): their task and answer then go to the judge, so turning it on loosens a governance control and waits for a second admin where the tenant has four eyes on.
--retirement-notice-days is how many days before a pinned model retires the agents that pin it get a model_retiring finding and the model.retiring notification (30 by default, 1 to 365).
Every change takes a reason (--reason or $OZ0_REASON). Operators may read the setting; admins change it.
Usage
oz0 tenant quality <tenant> [flags]
Flags
| Flag | Type | Default | Description |
|---|---|---|---|
--decision-ref | string | the decision or case the change follows, such as a case number (at most 200 characters) | |
--json | bool | print JSON instead of a table | |
--reason | string | why, required for every governance change (at most 500 characters; default $OZ0_REASON); the audit log keeps it | |
--retirement-notice-days | int32 | days before a pinned model retires that its agents are warned (1 to 365) | |
--sample | stringArray | a sampling rule, AGENT=RATE or AGENT=RATE:JUDGE, such as writer=0.1:smart; repeatable | |
--sample-rubric-file | file | the agent's own | a file with the rubric the --sample rules' judge judges by |
--sample-subject-jobs | string | whether jobs about a data subject may be sampled: on or off | |
--unsample | stringArray | remove an agent's sampling rule (its own quality.sample applies again); repeatable |
Inherited flags
| Flag | Type | Default | Description |
|---|---|---|---|
--context | string | $OZ0_CONTEXT or <config dir>/orchestrator-zero/context.json | CLI context file written by server init |
--log-level | string | info | log level: debug, info, warn or error |
See all oz0 commands and the global flags.