Skip to documentation
DocsEvaluations

Agents, models, and options

Choose a Runtime harness, pin the model, and record operational options safely.

On this page

Built-in harnesses

KindCredential variableTypical use
ClaudeANTHROPIC_API_KEYClaude Code CLI harness.
CodexOPENAI_API_KEYCodex CLI harness.
AntigravityGEMINI_API_KEYGoogle Antigravity CLI harness.
MuseMETA_API_KEYMeta endpoint with optional checkpoint and base URL.
GrokXAI_API_KEYxAI CLI harness.
OpenCodeProvider-dependentOPENCODE_API_KEY or OPENROUTER_API_KEY.
TerminusProvider-dependentANTHROPIC_API_KEY or OPENAI_API_KEY, selected by the provider-qualified model.
DeepSeekDEEPSEEK_API_KEYA deepseek/… provider-qualified model.
Scripted / PythonNone declared by the harnessA pinned script or Python factory; Task or Verifier bindings may still apply.

Pin models explicitly when reproducibility needs it

The Registry composer treats model as a form field and records it in the agent options; Muse may be left blank. The Runtime CLI has no separate model flag: use --agent-option model=PROVIDER/MODEL when the harness supports it. Dynamic provider-qualified harness defaults are canonicalized, while an omitted static-harness model may remain that harness's implicit default. UI suggestions are conveniences, not a universal allowlist.

Agent options

Terminal
fleet-runtime runs submit benchmark -n 1 \
  --agent claude \
  --agent-option max_turns=20 \
  --agent-option max_budget_usd=5 \
  --harness-var ANTHROPIC_API_KEY=@ --follow

Option values are recorded in the durable Run spec. Do not put credentials in options or a URL; use a declared harness variable or Registry credential source.