Skip to main content

Configuration

wendell run reads a TOML config file, usually wendell.toml.

Minimal hosted-suite config

project = "refund-agent"
mode = "advisory"
agent = "refund_agent"
agent_command = "python scripts/wendell_agent_adapter.py"
upload_traces = true

[gates]
suite_min_score = 0.80
scenario_min_score = 0.75
critical_failures_allowed = 0

When you run a hosted suite with wendell run --suite, Wendell resolves world, world_version, scenario_pack, and scenario_pack_version from the published suite.

Fields

FieldRequiredDescription
projectyesCustomer project slug or name.
modenoadvisory or blocking. Defaults to advisory.
api_urlnoAPI URL override. Production is the default.
api_key_envnoEnv var for API key. Defaults to WENDELL_INKPASS_API_KEY.
agentnoAgent name shown in results.
agent_commandyes for hosted runtimeCommand that runs the local agent adapter.
upload_tracesnoUpload traces/results. Defaults to true.
worldsim_inputnoLocal suite JSON for offline/local tests.
worldresolvedHosted world slug.
world_versionresolvedHosted world version.
scenario_packresolvedScenario pack slug.
scenario_pack_versionresolvedScenario pack version.

Gates

[gates]
suite_min_score = 0.90
scenario_min_score = 0.85
critical_failures_allowed = 0

In advisory mode, failed gates are reported but the process exits successfully.

In blocking mode, failed gates return a nonzero exit code.

Environment files

The CLI loads .env files from:

  1. The current working directory.
  2. The config file directory.
  3. The project directory resolved from the config.

Use this for local non-secret adapter settings. Keep production secrets in your CI secret store.

API URL override

Production is the default API target. Only pass an API URL when you are using a staging, preview, or local API.

wendell run \
--suite refund-agent-regression \
--config ./wendell.toml \
--api-url http://localhost:8000

You can also set an override in wendell.toml:

api_url = "http://localhost:8000"