eval: cover managed agent color environment - #63
Merged
Conversation
schickling-assistant
force-pushed
the
schickling-assistant/2026-07-31-pty-fractal-composition-evals
branch
from
July 31, 2026 12:16
2db74e9 to
a71e19d
Compare
Contributor
Author
|
Nathan, Johannes explicitly asked that the durable VRS—including requirements—cover these composition evals. May I clarify the existing requirements as follows?
The spec would then map Posted on behalf of @schickling
|
schickling-assistant
force-pushed
the
schickling-assistant/2026-07-31-pty-fractal-composition-evals
branch
from
July 31, 2026 12:49
a71e19d to
0fafa94
Compare
agent-session-id: ed878dac-3735-4276-b3e0-ea1b1cd65291 agent-tool: Codex CLI agent-tool-version: 0.145.0 agent-model: unknown agent-runtime-profile: /nix/store/mnx8agbdq3wiyb6vz63lhgscgazkrn98-coding-agent-runtime-profile/share/coding-agents/profile.json agent-skills-manifest: /nix/store/5r69m9k2llmri3na81518zx0a7y0d3cn-agent-skills-corpus/share/agent-skills/manifest.json tooling-profile: dotfiles@0fb7e03 agent-session-id: ed878dac-3735-4276-b3e0-ea1b1cd65291 agent-tool: Codex CLI agent-tool-version: 0.145.0 agent-model: unknown agent-runtime-profile: /nix/store/mnx8agbdq3wiyb6vz63lhgscgazkrn98-coding-agent-runtime-profile/share/coding-agents/profile.json agent-skills-manifest: /nix/store/5r69m9k2llmri3na81518zx0a7y0d3cn-agent-skills-corpus/share/agent-skills/manifest.json tooling-profile: dotfiles@0fb7e03
agent-session-id: ed878dac-3735-4276-b3e0-ea1b1cd65291 agent-tool: Codex CLI agent-tool-version: 0.145.0 agent-model: unknown agent-runtime-profile: /nix/store/mnx8agbdq3wiyb6vz63lhgscgazkrn98-coding-agent-runtime-profile/share/coding-agents/profile.json agent-skills-manifest: /nix/store/5r69m9k2llmri3na81518zx0a7y0d3cn-agent-skills-corpus/share/agent-skills/manifest.json tooling-profile: dotfiles@0fb7e03
agent-session-id: ed878dac-3735-4276-b3e0-ea1b1cd65291 agent-tool: Codex CLI agent-tool-version: 0.145.0 agent-model: unknown agent-runtime-profile: /nix/store/mnx8agbdq3wiyb6vz63lhgscgazkrn98-coding-agent-runtime-profile/share/coding-agents/profile.json agent-skills-manifest: /nix/store/5r69m9k2llmri3na81518zx0a7y0d3cn-agent-skills-corpus/share/agent-skills/manifest.json tooling-profile: dotfiles@0fb7e03
agent-session-id: ed878dac-3735-4276-b3e0-ea1b1cd65291 agent-tool: Codex CLI agent-tool-version: 0.145.0 agent-model: unknown agent-runtime-profile: /nix/store/mnx8agbdq3wiyb6vz63lhgscgazkrn98-coding-agent-runtime-profile/share/coding-agents/profile.json agent-skills-manifest: /nix/store/5r69m9k2llmri3na81518zx0a7y0d3cn-agent-skills-corpus/share/agent-skills/manifest.json tooling-profile: dotfiles@0fb7e03
agent-session-id: ed878dac-3735-4276-b3e0-ea1b1cd65291 agent-tool: Codex CLI agent-tool-version: 0.145.0 agent-model: unknown agent-runtime-profile: /nix/store/mnx8agbdq3wiyb6vz63lhgscgazkrn98-coding-agent-runtime-profile/share/coding-agents/profile.json agent-skills-manifest: /nix/store/5r69m9k2llmri3na81518zx0a7y0d3cn-agent-skills-corpus/share/agent-skills/manifest.json tooling-profile: dotfiles@0fb7e03
schickling-assistant
force-pushed
the
schickling-assistant/2026-07-31-pty-fractal-composition-evals
branch
from
July 31, 2026 19:45
0fafa94 to
9a8bd2e
Compare
agent-session-id: ed878dac-3735-4276-b3e0-ea1b1cd65291 agent-tool: Codex CLI agent-tool-version: 0.145.0 agent-model: unknown agent-runtime-profile: /nix/store/mnx8agbdq3wiyb6vz63lhgscgazkrn98-coding-agent-runtime-profile/share/coding-agents/profile.json agent-skills-manifest: /nix/store/5r69m9k2llmri3na81518zx0a7y0d3cn-agent-skills-corpus/share/agent-skills/manifest.json tooling-profile: dotfiles@0fb7e03
agent-session-id: ed878dac-3735-4276-b3e0-ea1b1cd65291 agent-tool: Codex CLI agent-tool-version: 0.145.0 agent-model: unknown agent-runtime-profile: /nix/store/mnx8agbdq3wiyb6vz63lhgscgazkrn98-coding-agent-runtime-profile/share/coding-agents/profile.json agent-skills-manifest: /nix/store/5r69m9k2llmri3na81518zx0a7y0d3cn-agent-skills-corpus/share/agent-skills/manifest.json tooling-profile: dotfiles@0fb7e03
schickling-assistant
marked this pull request as ready for review
July 31, 2026 20:18
agent-session-id: ed878dac-3735-4276-b3e0-ea1b1cd65291 agent-tool: Codex CLI agent-tool-version: 0.145.0 agent-model: unknown agent-runtime-profile: /nix/store/mnx8agbdq3wiyb6vz63lhgscgazkrn98-coding-agent-runtime-profile/share/coding-agents/profile.json agent-skills-manifest: /nix/store/5r69m9k2llmri3na81518zx0a7y0d3cn-agent-skills-corpus/share/agent-skills/manifest.json tooling-profile: dotfiles@0fb7e03
Contributor
Author
|
Final merged-dependency receipt at exact head
R04/R05 wording remains visibly proposed and unapproved; Posted on behalf of @schickling
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Why
A managed coding-agent PTY should remain color-capable when both the st2 reconciler and a later operator restart run under ambient
NO_COLOR=1. An explicit Agent SpecNO_COLORvalue must remain authoritative.What
This adds a model-free composition cell covering the managed-agent environment contract through real
st2 upreconciliation, real transient user scopes, PTY metadata, and standalonepty restart. The living specification defines the composed runtime boundary and traces it to R04-R05.The cell proves ambient removal, explicit-value precedence, real scope isolation, live adoption, st2-owned replacement, standalone restart durability, and complete cleanup.
Rationale
The observation happens inside each launched task, after the complete st2 isolation/spawn path. The explicit-value leg is a negative control against unconditionally deleting
NO_COLOR.The restart leg invokes
NO_COLOR=1 pty restart -y --forceagainst the default managed session. This distinguishes a temporary launch-time scrub from the durable contract: st2 must persist an unset tombstone and PTY must apply removals after inherited values and before explicit assignments. Ordinary non-agent PTYs without an authored unset policy retain ambient inheritance.Dependencies
mainfa2d6336e12085057bdec29671df5fae870dae5f, including merged packaged machine-stream composition from eval: cover packaged pty attach stream #64d5fabc3917407aeb937a012bd97679c303e180338ca0f3653aae6ca6ebcb880f82e9296016df6e08Verification
At exact PR head
9a38e04f07ddb46de867f3fde1a36fed1cf6c398with the merged dependency identities above:SCORE: 11 PASS / 0 FAIL / 11 gating judges(two run steps plus nine held-out judges)e193141523bb35a397f90170f6fc182e663d205eef2d95af27a94dcae806cc481c9716d435ca56ad9b4f67056d76fa6856cdc08e6bbda1fd4be6f59952e9fde3d61d12b2b1189a391c196ca28f8f4ba69072d14fcbad2571fc29db1f250f4eed0fed14bwith current PTY exposes ambientNO_COLORat initial launch; merged st2 with a labeled PTY argument mutation that strips--unset-envpasses initial launch but reintroduces ambientNO_COLORon restartIncident #1350 constrained this refresh to the targeted composition and static/VRS surface; it did not start a package build, model, or full corpus run. The exact merged-source st2 binary was relinked with
cargo build --bin st2using the existing hot target cache.Protected VRS approval request
docs/vrs/spec.mdmaps both composed runtime cells to the existing R04/R05 boundary.docs/vrs/requirements.mdremains unchanged pending Nathan's explicit approval or revision of these clarifications:Per Johannes, this visible approval request does not hold an otherwise implementation-ready PR. No vision change is proposed.
Posted on behalf of @schickling
agent_nameagent_session_idagent_toolagent_tool_versionagent_runtimeagent_modelruntime_profileskills_manifestworktreemachinetooling_profile