This is the sole current corpus surface: 64 included cells (24 model-free, 40 model-backed) and 4 retired exclusions. Inventory fields are derived from the active KDL and executable judge scripts. Latest accepted PASS evidence remains distinct from the append-only run history: a failed last run is visible without being advertised as accepted evidence, and cells with no structured run row say so explicitly.
Every model launch is explicitly pinned by bin/check-model-policy.sh: Claude uses
claude-sonnet-5 at medium effort and Codex uses gpt-5.6-sol at medium reasoning effort.
Every bus-connected model seat is mechanically checked for the event-first DING lifecycle and its
harness-native loader plus canonical hook file.
| Cell | Harness | Model(s) / effort | Model seats | Cost | Timeout | Held-out judges | Latest accepted PASS | Last recorded run |
|---|---|---|---|---|---|---|---|---|
adopt-only-migration |
model-free | — | 0 | none | 90s |
6 | — | NO STRUCTURED RUN |
agent-spec-resource-bindings |
model-free | — | 0 | none | 60s |
4 | — | NO STRUCTURED RUN |
agent-spec-streams |
model-free | — | 0 | none | 90s |
7 | — | NO STRUCTURED RUN |
assignment-contract-cold-assignment |
Codex | gpt-5.6-sol / medium |
2 | medium | 1200s |
3 | — | NO STRUCTURED RUN |
assignment-contract-cold-focus |
Codex | gpt-5.6-sol / medium |
2 | medium | 1200s |
3 | — | NO STRUCTURED RUN |
assignment-contract-cold-resources |
Codex | gpt-5.6-sol / medium |
2 | medium | 1200s |
3 | — | NO STRUCTURED RUN |
assignment-contract-handoff-assignment |
Codex | gpt-5.6-sol / medium |
3 | high | 1200s |
4 | — | NO STRUCTURED RUN |
assignment-contract-handoff-focus |
Codex | gpt-5.6-sol / medium |
3 | high | 1200s |
4 | — | NO STRUCTURED RUN |
assignment-contract-handoff-resources |
Codex | gpt-5.6-sol / medium |
3 | high | 1200s |
4 | — | NO STRUCTURED RUN |
assignment-contract-hot-assignment |
Codex | gpt-5.6-sol / medium |
2 | medium | 1200s |
4 | — | NO STRUCTURED RUN |
assignment-contract-hot-focus |
Codex | gpt-5.6-sol / medium |
2 | medium | 1200s |
4 | — | NO STRUCTURED RUN |
assignment-contract-hot-resources |
Codex | gpt-5.6-sol / medium |
2 | medium | 1200s |
4 | — | NO STRUCTURED RUN |
context-resource-continuity |
model-free | — | 0 | none | 90s |
4 | — | NO STRUCTURED RUN |
crash-ding |
mixed | claude-sonnet-5+gpt-5.6-sol / medium |
4 | high | 180s |
5 | — | NO STRUCTURED RUN |
ding-mode |
Claude | claude-sonnet-5 / medium |
2 | medium | 1200s |
4 | — | NO STRUCTURED RUN |
ding-reply |
Claude | claude-sonnet-5 / medium |
1 | low | 420s |
2 | — | NO STRUCTURED RUN |
docs |
Claude | claude-sonnet-5 / medium |
3 | high | 1200s |
5 | — | NO STRUCTURED RUN |
exec-lifecycle-logging |
model-free | — | 0 | none | 90s |
5 | — | NO STRUCTURED RUN |
feature-fit |
Claude | claude-sonnet-5 / medium |
2 | medium | 1200s |
5 | — | NO STRUCTURED RUN |
fork-in-the-road |
Claude | claude-sonnet-5 / medium |
4 | high | 1200s |
5 | — | NO STRUCTURED RUN |
fork-in-the-road-codex |
Codex | gpt-5.6-sol / medium |
4 | high | 1200s |
5 | PASS 2026-07-26, st2 25d8371, 7m21s, f605f86; usage notice: 3 usage-limit resets available |
NO STRUCTURED RUN |
ghost-bug |
Claude | claude-sonnet-5 / medium |
2 | medium | 1200s |
5 | — | NO STRUCTURED RUN |
ghost-bug-codex |
Codex | gpt-5.6-sol / medium |
2 | medium | 1200s |
5 | PASS 2026-07-26, st2 9d26245, 1m38s, dc7ad3a; usage notice: 3 usage-limit resets available |
NO STRUCTURED RUN |
hook-integrity |
model-free | — | 0 | none | 90s |
4 | — | NO STRUCTURED RUN |
host-lock-health-negatives |
model-free | — | 0 | none | 30s |
5 | — | NO STRUCTURED RUN |
inbox-hygiene |
Claude | claude-sonnet-5 / medium |
1 | low | 900s |
4 | — | NO STRUCTURED RUN |
incident-response |
Claude | claude-sonnet-5 / medium |
2 | medium | 1200s |
5 | — | NO STRUCTURED RUN |
license-mit |
mixed | claude-sonnet-5+gpt-5.6-sol / medium |
3 | high | 1200s |
6 | — | FAIL 2026-07-28T13:27:18Z, 5/6, source b3cd5fb, receipt |
license-mit-codex |
Codex | gpt-5.6-sol / medium |
3 | high | 1200s |
6 | PASS 2026-07-26, st2 9d26245, 1m39s, 40ec23d |
NO STRUCTURED RUN |
managed-agent-color-env |
model-free | — | 0 | none | 90s |
9 | — | NO STRUCTURED RUN |
migration |
Claude | claude-sonnet-5 / medium |
2 | medium | 1200s |
5 | — | NO STRUCTURED RUN |
pi-native-delivery |
model-free | — | 0 | none | 120s |
6 | — | NO STRUCTURED RUN |
poisoned-pr |
Claude | claude-sonnet-5 / medium |
2 | medium | 1200s |
5 | — | NO STRUCTURED RUN |
poisoned-pr-codex |
Codex | gpt-5.6-sol / medium |
2 | medium | 1200s |
5 | PASS 2026-07-26, st2 25d8371, 1m52s, 514a01d; usage notice: 3 usage-limit resets available |
NO STRUCTURED RUN |
presence-ding-matrix |
model-free | — | 0 | none | 60s |
6 | — | NO STRUCTURED RUN |
pty-attach-machine-stream |
model-free | — | 0 | none | 90s |
5 | — | NO STRUCTURED RUN |
pty-attach-only |
model-free | — | 0 | none | 90s |
7 | — | NO STRUCTURED RUN |
pty-send-peek |
model-free | — | 0 | none | 120s |
5 | PASS 2026-07-28T19:53:59Z, 13/13, source b7da882, receipt |
PASS 2026-07-28T19:53:59Z, 13/13, source b7da882, receipt |
reconcile-retire-keep |
model-free | — | 0 | none | 90s |
6 | — | NO STRUCTURED RUN |
render-target-safety |
model-free | — | 0 | none | 90s |
5 | — | NO STRUCTURED RUN |
restart-continuity |
Claude | claude-sonnet-5 / medium |
2 | medium | 1200s |
5 | — | NO STRUCTURED RUN |
resync-carrier-change |
model-free | — | 0 | none | 120s |
7 | — | NO STRUCTURED RUN |
security-audit |
Claude | claude-sonnet-5 / medium |
2 | medium | 1200s |
4 | — | NO STRUCTURED RUN |
shared-workspace-render-ownership |
model-free | — | 0 | none | 60s |
5 | — | NO STRUCTURED RUN |
signal-rename |
Claude | claude-sonnet-5 / medium |
4 | high | 1800s |
5 | — | NO STRUCTURED RUN |
signal-rename-codex |
Codex | gpt-5.6-sol / medium |
4 | high | 1800s |
5 | PASS 2026-07-26, st2 9d26245, 8m07s, 67b45d2 |
NO STRUCTURED RUN |
skill-inheritance |
Claude | claude-sonnet-5 / medium |
1 | low | 420s |
3 | — | NO STRUCTURED RUN |
st2-doctor-structure |
model-free | — | 0 | none | 60s |
4 | — | NO STRUCTURED RUN |
st2-network |
model-free | — | 0 | none | 60s |
2 | — | NO STRUCTURED RUN |
stream-github-ci-waiter |
model-free | — | 0 | none | 25m |
5 | — | NO STRUCTURED RUN |
stream-nix-build-waiter |
model-free | — | 0 | none | 120s |
5 | — | NO STRUCTURED RUN |
strict-validation-json |
model-free | — | 0 | none | 60s |
4 | — | NO STRUCTURED RUN |
targeted-reconcile-isolation |
model-free | — | 0 | none | 60s |
7 | — | NO STRUCTURED RUN |
test-writing |
Claude | claude-sonnet-5 / medium |
2 | medium | 1200s |
3 | — | NO STRUCTURED RUN |
two-networks-coexist |
model-free | — | 0 | none | 120s |
6 | — | NO STRUCTURED RUN |
vrs-cross-file-absent |
Claude | claude-sonnet-5 / medium |
1 | low | 600s |
6 | — | NO STRUCTURED RUN |
vrs-cross-file-present |
Claude | claude-sonnet-5 / medium |
1 | low | 600s |
6 | — | NO STRUCTURED RUN |
vrs-definition-of-done-absent |
Claude | claude-sonnet-5 / medium |
1 | low | 600s |
7 | — | NO STRUCTURED RUN |
vrs-definition-of-done-present |
Claude | claude-sonnet-5 / medium |
1 | low | 600s |
7 | — | NO STRUCTURED RUN |
vrs-scope-drift-absent |
Claude | claude-sonnet-5 / medium |
1 | low | 600s |
7 | — | NO STRUCTURED RUN |
vrs-scope-drift-present |
Claude | claude-sonnet-5 / medium |
1 | low | 600s |
7 | — | NO STRUCTURED RUN |
vrs-scope-pressure-absent |
Claude | claude-sonnet-5 / medium |
1 | low | 600s |
6 | — | NO STRUCTURED RUN |
vrs-scope-pressure-present |
Claude | claude-sonnet-5 / medium |
1 | low | 600s |
6 | — | NO STRUCTURED RUN |
weird-git-setup |
Claude | claude-sonnet-5 / medium |
1 | low | 600s |
5 | PASS 2026-07-28T20:10:20Z, 6/6, source 28d7fb6, receipt |
PASS 2026-07-28T20:10:20Z, 6/6, source 28d7fb6, receipt |
evidence/run-history.tsv records PASS and FAIL outcomes with exact source and runner commits,
model/effort, duration, structured usage/cost, cleanup state, and a tracked receipt. Existing rows are
immutable; new runs append in completion order. The latest accepted PASS column never promotes a failure,
while the last-run column makes a recorded failure distinct from a cell with no structured row.
clean-compose— retired composition-overlay discriminatorcompose-config-load— retired composition/config-loader discriminatorcompose-global-skill— retired composition/global-skill discriminatorteam-standup— retired runtime seat-generation discriminator
hook-integrity is not excluded: it is now a model-free, current-native
st2 up --materialize-only hook installation and idempotency test.
adopt-only-migration/cell— deterministic native adoption/replacement lifecycle probe; no harness seatagent-spec-resource-bindings/cell— deterministic native Agent Spec Resource-envelope probe; no harness seatagent-spec-streams/cell— deterministic native Agent Spec stream lifecycle and ingress probe; no harness seatcontext-resource-continuity/cell— deterministic native context/resource restart probe; no harness seatdocs/judge:cold-reader— one-shot offline Claude print grader; no bus identity, DING, or hook surfaceexec-lifecycle-logging/cell— deterministic native exec lifecycle probe; no harness seathook-integrity/cell— deterministic native hook-installation probe; no live harness seathost-lock-health-negatives/cell— deterministic native doctor negative probe; no harness seatmanaged-agent-color-env/cell— deterministic managed-agent environment policy probe; no harness seatpi-native-delivery/cell— deterministic pi native-delivery contract probe; no harness seatpresence-ding-matrix/cell— deterministic native presence and DING probe; no harness seatpty-attach-machine-stream/cell— deterministic installed PTY attach composition probe; no harness seatpty-attach-only/cell— deterministic PTY dead-attach policy probe; no harness seatpty-send-peek/cell— deterministic PTY transport probe; no harness seatreconcile-retire-keep/cell— deterministic native reconcile lifecycle probe; no harness seatrender-target-safety/cell— deterministic native render-policy probe; no harness seatshared-workspace-render-ownership/cell— deterministic native shared-render admission probe; no harness seatst2-doctor-structure/cell— deterministic catalog-health probe; no harness seatst2-network/cell— deterministic catalog/message round-trip probe; no harness seatstream-github-ci-waiter/cell— deterministic GitHub CI waiter controls with an opt-in authenticated read-only smoke; no harness seatstream-nix-build-waiter/cell— deterministic real Nix build waiter and retry probe; no harness seatstrict-validation-json/cell— deterministic native validation-diagnostics probe; no harness seattargeted-reconcile-isolation/cell— deterministic selected reconcile isolation probe; no bus-connected agenttwo-networks-coexist/cell— deterministic catalog-isolation probe; no harness seat
These 24 rows are generated from structured exclusions. A cell-level row is required for every derived model-free cell. The one-shot docs cold reader is a model-backed grader, but not a bus-connected agent: it has no st2 identity, DING sidecar, or lifecycle hooks.
Run the complete model-free preflight:
bin/check-corpus.shPreview the exact lexical run order, harness, model, effort, seat count, cost band, and timeout:
bin/overnight.sh --dry-run
bin/overnight.sh --dry-run --cell ghost-bug --cell ghost-bug-codexThe conservative future paid run requires an exact repeated --cell queue and stops before the next cell on
either a hard usage error or the informational Codex reset-available banner:
bin/overnight.sh --run --cell ghost-bug --cell ghost-bug-codex --state-dir .eval-runs/overnightBecause that common informational banner would prevent a full unattended sweep, the exact future full-run command makes both its complete-inventory selection and separately reviewed higher-spend choice visible:
bin/overnight.sh --run --all --allow-informational-reset-banner --state-dir .eval-runs/overnightWith no selector, dry-run remains inventory-only; paid --run rejects omitted, duplicate, unknown, and
retired selections. Explicitly selected maintained model-free cells execute through the same st2 lifecycle
and receipts without provider checks; Claude/Codex binary and authentication checks apply only when the
selected subset needs that provider. Neither --all nor the informational-banner opt-in is approved merely
because it is documented or shown by --dry-run.
The runner executes one cell at a time, applies each cell's declared timeout plus a watchdog grace period,
keeps durable logs and atomic PASS receipts, and skips matching completed receipts on resume. Hard quota/rate
errors always write STOPPED. A Codex N usage limit resets available banner is modeled separately: its
active cell tears down and records a result, then the default blocks the next cell; only
--allow-informational-reset-banner permits another paid cell after that banner. It never overlaps Claude
and Codex cells.