Skip to content

docs(phase5): Phase 5 — Evolution Infrastructure scope#13

Merged
hoangnb24 merged 3 commits into
mainfrom
devin/1780546348-phase-5-evolution-infrastructure
Jun 9, 2026
Merged

docs(phase5): Phase 5 — Evolution Infrastructure scope#13
hoangnb24 merged 3 commits into
mainfrom
devin/1780546348-phase-5-evolution-infrastructure

Conversation

@hoangnb24

Copy link
Copy Markdown
Owner

Summary

Adds PHASE5.md defining the next development phase for repository-harness. Phase 5 transitions the harness from verifying individual stories (Phase 4) to evolving itself — completing H4 maturity and starting H5.

Six stories in dependency order:

Story What Lane
US-019 Tool Registry — extensible, validated tool register + query tools --json/--summary/--responsibility Normal
US-020 Batch Story Verification — story verify-all completes H4 Normal
US-021 Intervention Recording — intervention add/query schema for human corrections vs agent actions Normal
US-022 Context Rule Measurement — score-context <trace-id> checks agent reading discipline Normal
US-023 Drift Detection — audit command with entropy score (orphaned stories, unverified records, broken tools) Normal
US-024 Improvement Proposal Pipeline — propose composes friction+interventions+drift → structured proposals (H5 begins) High-risk

Key design decisions from discussion:

  • Tool registry is discovery-only (no usage analytics — deferred until proper instrumentation exists)
  • Tool registry is extensible — supports both compiled-in harness-cli commands and user-registered external tools via tool register
  • Registration is validated (unique name, command existence check, 10-200 char description, valid responsibility)
  • Interventions use imperfect-but-useful recording — prompted at trace time, humans can record directly
  • propose is rule-based pattern detection (SQL grouping/counting), not LLM-generated
  • Estimated ~23-30 hours implementation

Link to Devin session: https://app.devin.ai/sessions/b35d6fa2be66434983cb855cda1fbda3

devin-ai-integration Bot and others added 3 commits June 4, 2026 04:12
Phase 5 turns the harness from a system that verifies individual stories
into one that can evolve itself. Six stories:

- US-019: Machine-readable tool registry (extensible, supports non-CLI tools)
- US-020: Batch story verification (completes H4)
- US-021: Intervention recording schema (human corrections vs agent actions)
- US-022: Context rule measurement (score-context command)
- US-023: Drift detection / entropy score (audit command)
- US-024: Improvement proposal pipeline (propose command, starts H5)

Target: H4 partial → H4 full, H5 not achieved → H5 partial.
Estimated effort: ~23-30 hours.

Co-Authored-By: muscled.flumes.4r@icloud.com <hoangmrb.vn@gmail.com>
Add tool registry, batch story verification, intervention recording, context scoring, drift audit, and deterministic improvement proposals.\n\nDocument the Phase 5 operating model with audit, tool registry, improvement protocol, story packets, progress notes, schema migrations, and the durable decision for proposal rules.\n\nValidation: cargo fmt --check; cargo test --workspace; cargo clippy --workspace -- -D warnings; scripts/bin/harness-cli story verify-all; scripts/bin/harness-cli audit; scripts/bin/harness-cli propose.
Install Phase 5 reference docs, proposal decision record, and schema migrations so benchmark installs exercise the same CLI/database surface as the checked-out branch.\n\nValidation: bash -n scripts/install-harness.sh.
@hoangnb24 hoangnb24 merged commit bfef94a into main Jun 9, 2026
hoangnb24 pushed a commit that referenced this pull request Jun 9, 2026
Use printf -- for post-merge changelog bullet lines so runner shells do not treat leading hyphens in format strings as options.

Record the failed PR #13 workflow run and local reproduction proof in the US-025 story evidence.
hoangnb24 pushed a commit that referenced this pull request Jun 9, 2026
Recover the missed post-merge maintenance for PR #13 after the workflow failed before it could write the changelog or prepare the CLI release.

Record the merged PR in CHANGELOG.md, bump the Harness CLI package metadata to 0.1.9, and update the installer release tag pin to harness-cli-v0.1.9.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants