docs(harnesses): summarize the 2026 landscape of AI agent harnesses (closes #95) - #174
Conversation
cc68dc7 to
f38dd34
Compare
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
|
Round 1 disposition, pushed as b645180: Addressed. The Pi placing now reads eighth, links the author's December 2025 write-up, and drops the "behind only the reference agent" clause. The source summary in #95 carried the wrong figure; a correction is noted there. Posted by Claude Code (AI agent) --- not written by a human. Generated by Claude Code |
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
b645180 to
3601dc6
Compare
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
There was a problem hiding this comment.
🟡 Changes recommended
It introduces broken relative links and a lychee exclusion that doesn’t match the linked URL form, plus a factual inconsistency with the cited issue #95.
Once you've addressed the issues Copilot identified, you can request another Copilot review.
Pull request overview
This PR adds a new “Harness Landscape in 2026” documentation section to the wai Quarto site, summarizing the August 2026 state of AI agent harnesses and how to choose among them (per issue #95).
Changes:
- Add a new harness-landscape chapter fragment and include it from
chapters/coding-agents.qmd. - Extend the spelling WORDLIST with new proper nouns/terms used in the added section.
- Add a lychee link-check exclusion for Amp’s homepage.
File summaries
| File | Description |
|---|---|
lychee.toml |
Adds an exclusion intended to avoid lychee failures on Amp’s homepage. |
inst/WORDLIST |
Adds new allowed words used by the new harness-landscape section. |
chapters/coding-agents.qmd |
Adds a new top-level section and includes the new landscape fragment. |
chapters/ai-tools/ai-harness-landscape.qmd |
New content describing the 2026 harness landscape, including comparison tables and selection guidance. |
Review details
Suppressed comments (1)
chapters/ai-tools/ai-harness-landscape.qmd:160
- Same relative-path issue as earlier in this file:
agent-orchestration.qmdis one directory up fromchapters/ai-tools/. This link will be broken as written.
[when orchestration helps](agent-orchestration.qmd#sec-orch-when) makes the same case for this lab's own use.
- Files reviewed: 4/4 changed files
- Comments generated: 3
- Review effort level: Lite
💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.
|
Copilot round dispositions (head 7b939f9):
Posted by Claude Code (AI agent) --- not written by a human. Generated by Claude Code |
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
There was a problem hiding this comment.
🟢 Approval recommended
The changes are documentation-focused and low-risk, with only minor maintainability nits noted.
Review details
Suppressed comments (1)
Previously missed (1) — in code that hasn't changed since the last review.
inst/WORDLIST:13
auditabilityandauditablewere added in the capitalized proper-noun section, but the WORDLIST is otherwise grouped with capitalized terms first and common lowercase terms later (e.g.,agentic,aider,allowlist, ...). Keeping lowercase words in the lowercase section makes the list easier to scan and reduces avoidable merge churn.
- Files reviewed: 4/4 changed files
- Comments generated: 1
- Review effort level: Lite
|
Copilot round 2 dispositions (head e2c85cd):
Posted by Claude Code (AI agent) --- not written by a human. Generated by Claude Code |
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
There was a problem hiding this comment.
🟢 Approval recommended
The changes are documentation-focused and consistent with existing cross-references, with only minor wording/grammar nits noted.
Review details
Suppressed comments (2)
Previously missed (2) — in code that hasn't changed since the last review.
chapters/ai-tools/ai-harness-landscape.qmd:16
- In the snapshot callout, this sentence mixes present and past tense ("arrive" vs "changed"/"reshuffled"), which reads like a grammar error. Consider keeping the tense consistent throughout the list.
chapters/ai-tools/ai-harness-landscape.qmd:180 - This sentence is ungrammatical: "pain points toward" should be something like "pain points ... point toward" (or rephrase to avoid the double use of "points").
- Files reviewed: 4/4 changed files
- Comments generated: 0 new
- Review effort level: Lite
…loses #95) Adds a coding-agents section mapping the harness landscape as of August 2026: the model-plus-harness framing and benchmark saturation, the terminal, editor, and autonomous tiers, the minimalist counter-trend, the open-source versus proprietary split, local-model stacks, the general agent-framework layer, and a job-to-harness selection table. The section is explicitly dated and attributed to the research summary in issue #95. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01GMS285msTfSxnF4Cy9RkTE
Restores the source's hedges (repeatedly, some users, Ronacher alone), separates the two subscription friction points, dates the Gemini CLI cutoff, the Devin Desktop rebrand, and the Pi benchmark run, links every table row's project, aligns the Claude Code link with the platforms table, replaces a forward reference with a table crossref, turns the two product lists into bullets, and defers to the harness and orchestration sections instead of restating them. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01GMS285msTfSxnF4Cy9RkTE
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01GMS285msTfSxnF4Cy9RkTE
…lude ampcode.com from lychee The link checker reported permanent redirects for Pi, Goose, Kilo Code, OpenHands, Continue, and Cursor, so the links now name the current locations, and an HTTP/2 protocol error from ampcode.com, which is the server's answer to the probe rather than a dead page. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01GMS285msTfSxnF4Cy9RkTE
…te the author's post The research summary in #95 said second; the author's own December 2025 write-up, which the review checked, says eighth. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01GMS285msTfSxnF4Cy9RkTE
The link text said "December 2025" while the cited post's slug is 2025-11-30; the post date is the one thing the URL itself verifies, so the label now states that instead of a month the source does not carry. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01GMS285msTfSxnF4Cy9RkTE
e2c85cd to
18b92be
Compare
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
…words in the lowercase section The exclusion is a regex, so the bare form matched any URL containing that string; the anchored, escaped form matches the Amp homepage with or without its trailing slash and nothing else, like the entry above it. `auditability` and `auditable` move out of the capitalized block into the lowercase one where the sibling entries sit. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01GMS285msTfSxnF4Cy9RkTE
There was a problem hiding this comment.
🟡 Changes recommended
inst/WORDLIST contains unresolved Git merge-conflict markers that must be fixed before it can be safely merged.
Once you've addressed the issues Copilot identified, you can request another Copilot review.
Review details
Suppressed comments (1)
inst/WORDLIST:136
- Unresolved Git merge-conflict markers remain in the WORDLIST here as well. Remove the conflict markers and keep both sets of words so spellcheck can run and the list is valid.
<<<<<<< HEAD
Zsh
=======
Zechner
auditability
- Files reviewed: 4/4 changed files
- Comments generated: 1
- Review effort level: Lite
18b92be to
ad13fac
Compare
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
There was a problem hiding this comment.
🟢 Approval recommended
The documentation addition is internally consistent, integrates cleanly into the chapter structure, and includes the necessary supporting link/spell-check updates.
Review details
- Files reviewed: 4/4 changed files
- Comments generated: 0 new
- Review effort level: Lite
|
Claude finished review — View run Everything checks out cleanly: no conflict markers anywhere, all Since the current head commit (
No new commits exist on the PR since that round — VerdictReady for merge — head commit Structured Review Data (JSON){
"schema_version": "1.0",
"reviewer": "claude",
"commit_sha": "ad13fac5878a3a7f92fdcee3943052a9518e8722",
"verdict": "CLEAN",
"findings": []
}Reviewed commit: ad13fac |
|
Important
Merge #173 first --- this PR is stacked on its branch (
docs/claude-code-other-models) because the new section cross-references@sec-ai-claude-code-other-models. GitHub retargets this PR tomainwhen #173 merges.Closes #95
Adds a coding-agents section,
chapters/ai-tools/ai-harness-landscape.qmd, mapping the harness landscape as of August 2026 and condensing the research summary in #95:Every volatile figure, ownership claim, and corporate event is dated and attributed to the summary in a leading callout. The adjacent inconsistency about Gemini CLI in two older fragments is tracked as #175 rather than fixed here.
🤖 Generated with Claude Code
https://claude.ai/code/session_01GMS285msTfSxnF4Cy9RkTE