Skip to content

docs: mine the four-month game-dev field report for supervision, tiering, and validation lessons (closes #98) - #179

Merged
d-morrison merged 4 commits into
docs/ai-guidance-sourcesfrom
docs/field-report-lessons
Sep 1, 2026
Merged

docs: mine the four-month game-dev field report for supervision, tiering, and validation lessons (closes #98)#179
d-morrison merged 4 commits into
docs/ai-guidance-sourcesfrom
docs/field-report-lessons

Conversation

@d-morrison

Copy link
Copy Markdown
Collaborator

Important

Merge #173, #174, and the #94 PR first --- this PR is stacked on the #94 branch (docs/ai-guidance-sources) because they edit the same chapter file.

Closes #98

Takes the placement calls the issue left open, and implements all four items:

  • the closing list in relative-advantages-ai-humans.qmd now asks for enough domain judgment to supervise, with coding skill as one route rather than a precondition, citing the report as the datapoint
  • the report's plan-expensive, implement-cheap cost lever and its spend figure join the existing routed-architectures subsection of the small-local-models section, which already states that rule with a citation, instead of a new section
  • the test-thoroughly best practice says to budget for manual testing, attributed to the two commenters who named it as the dominant cost
  • the validation-responsibility section gains a worked example of defects that look correct to the builder and surface only on contact with a player

The report is cited inline by venue, date, and title, linked to the community and to #98, because references.bib carries only academic entries and the issue supplies no post URL.

🤖 Generated with Claude Code

https://claude.ai/code/session_01GMS285msTfSxnF4Cy9RkTE


Generated by Claude Code

@d-morrison
d-morrison force-pushed the docs/field-report-lessons branch from 5bc9584 to bc5b5d5 Compare September 1, 2026 19:42
@d-morrison
d-morrison marked this pull request as ready for review September 1, 2026 19:43
@d-morrison
d-morrison force-pushed the docs/ai-guidance-sources branch from a75d411 to 3e6853c Compare September 1, 2026 19:48
@d-morrison
d-morrison force-pushed the docs/field-report-lessons branch from da73b12 to 2665724 Compare September 1, 2026 19:48
@github-actions

This comment has been minimized.

Copy link
Copy Markdown
Collaborator Author

The red claude-review / require-review on 2665724 is the reviewer stub described in the caution notice above (the reviewer spawned a background agent and ended its turn without a ### Verdict), not a defect in this PR's diff. I re-dispatched claude-code-review.yml for this PR once via workflow_dispatch; if that run also stubs, I will post a self-review at the bot's standard rather than retry again.

Posted by Claude Code (AI agent) --- not written by a human.


Generated by Claude Code

@github-actions

This comment has been minimized.

@github-actions

This comment has been minimized.

@github-actions

This comment has been minimized.

@d-morrison
d-morrison force-pushed the docs/ai-guidance-sources branch from 3e6853c to 8b4948a Compare September 1, 2026 20:08
…ing, and validation lessons (closes #98)

A public field report (r/ClaudeCode, 2026-08-22) from a non-programmer who
built a browser racing game with coding agents refines three things these
notes already say and adds one they did not:

- the closing list in relative-advantages now asks for enough domain
  judgment to supervise, with coding skill as the usual route rather than a
  precondition, and cites the report as the datapoint;
- a new model-tiering section states the plan-expensive, implement-cheap
  rule that previously had no human-facing home (the vendor-spend and
  local-model sections cover its two halves);
- the test-thoroughly best practice now says to budget for manual testing,
  which two practitioners in the thread independently name as the dominant
  cost;
- the validation-responsibility section gains a worked example of defects
  that look correct to the builder and surface only on contact with a
  player, as the concrete answer to why checks are worth instrumenting.

The report is cited inline by venue, date, and title because references.bib
carries only academic entries.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01GMS285msTfSxnF4Cy9RkTE
…ubsection and attribute every use

The planner-executor rule already lives, with a citation, in the
small-local-models section, so the separate model-tiering section is
dropped and the report's spend and scope datapoint joins that
subsection. Each of the four uses now cites the community and the
tracking issue, the two testing-cost commenters are named as such, the
defect list is a bullet list, and coding skill is one route rather than
the usual one.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01GMS285msTfSxnF4Cy9RkTE
… spend figure

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01GMS285msTfSxnF4Cy9RkTE
@d-morrison
d-morrison force-pushed the docs/field-report-lessons branch from 2665724 to 60665c0 Compare September 1, 2026 20:09
@github-actions

github-actions Bot commented Sep 1, 2026

Copy link
Copy Markdown
Contributor

Claude finished reviewView run


All checks confirm the diff content is byte-for-byte identical to what was already reviewed: same four files (agents-best-practices.qmd, relative-advantages-ai-humans.qmd, responsibility-for-validation.qmd, small-local-models-agentic.qmd), same field-report citations, same wording throughout, including the restored "on top of a general-purpose subscription the author already held" qualifier. The commit SHA differs from the prior review's 2665724 because the branch was rebased/merged since (the current HEAD is a fresh merge commit 7e8e671), but the tree content is unchanged.

I re-verified the build-hygiene items that could have drifted with a rebase:

  • ClaudeCode (inst/WORDLIST:28) and Reddit (inst/WORDLIST:114) are still present, so spell-check still passes.
  • lychee.toml:17 still globally accepts HTTP 403, so the Reddit link still passes link-check.
  • The ::: {.callout-tip} fence in responsibility-for-validation.qmd is still balanced (4 fence markers = 2 open/close pairs, consistent with the file's existing callout plus the new one).

No new content, no new files, and nothing in the diff diverges from the version already fact-checked against issue #98 and found clean in the prior substantive review (run 33552081328). That review's verdict stands: prose is accurately sourced, semantic line breaks and bullet-list formatting follow CLAUDE.md, no fabricated citations, no build-hygiene regressions.

Verdict

Ready for merge

Structured Review Data (JSON)
{
  "schema_version": "1.0",
  "reviewer": "claude",
  "commit_sha": "7e8e671ea069dc316c4d23989351acc8cdf0e0ab",
  "verdict": "CLEAN",
  "findings": []
}

Reviewed commit: 60665c0

@github-actions

github-actions Bot commented Sep 1, 2026

Copy link
Copy Markdown
Contributor

💰 Cost: $0.2191 (review) — run

@d-morrison
d-morrison merged commit 15b1408 into docs/ai-guidance-sources Sep 1, 2026
11 checks passed
@d-morrison
d-morrison deleted the docs/field-report-lessons branch September 1, 2026 20:55
@github-actions

github-actions Bot commented Sep 1, 2026

Copy link
Copy Markdown
Contributor
PR Preview Action v1.8.1
Preview removed because the pull request was closed.
2026-09-01 20:56 UTC

d-morrison added a commit that referenced this pull request Sep 1, 2026
…ing, and validation lessons (closes #98) (#179)

* start: mine the four-month game-dev field report (closes #98)

* docs: mine the four-month game-dev field report for supervision, tiering, and validation lessons (closes #98)

A public field report (r/ClaudeCode, 2026-08-22) from a non-programmer who
built a browser racing game with coding agents refines three things these
notes already say and adds one they did not:

- the closing list in relative-advantages now asks for enough domain
  judgment to supervise, with coding skill as the usual route rather than a
  precondition, and cites the report as the datapoint;
- a new model-tiering section states the plan-expensive, implement-cheap
  rule that previously had no human-facing home (the vendor-spend and
  local-model sections cover its two halves);
- the test-thoroughly best practice now says to budget for manual testing,
  which two practitioners in the thread independently name as the dominant
  cost;
- the validation-responsibility section gains a worked example of defects
  that look correct to the builder and surface only on contact with a
  player, as the concrete answer to why checks are worth instrumenting.

The report is cited inline by venue, date, and title because references.bib
carries only academic entries.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01GMS285msTfSxnF4Cy9RkTE

* docs: fold the field-report datapoint into the routed-architectures subsection and attribute every use

The planner-executor rule already lives, with a citation, in the
small-local-models section, so the separate model-tiering section is
dropped and the report's spend and scope datapoint joins that
subsection. Each of the four uses now cites the community and the
tracking issue, the two testing-cost commenters are named as such, the
defect list is a bullet list, and coding skill is one route rather than
the usual one.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01GMS285msTfSxnF4Cy9RkTE

* docs: restore the shared-subscription qualifier on the field report's spend figure

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01GMS285msTfSxnF4Cy9RkTE

---------

Co-authored-by: Claude <noreply@anthropic.com>
d-morrison added a commit that referenced this pull request Sep 1, 2026
…ing, and validation lessons (closes #98) (#179)

* start: mine the four-month game-dev field report (closes #98)

* docs: mine the four-month game-dev field report for supervision, tiering, and validation lessons (closes #98)

A public field report (r/ClaudeCode, 2026-08-22) from a non-programmer who
built a browser racing game with coding agents refines three things these
notes already say and adds one they did not:

- the closing list in relative-advantages now asks for enough domain
  judgment to supervise, with coding skill as the usual route rather than a
  precondition, and cites the report as the datapoint;
- a new model-tiering section states the plan-expensive, implement-cheap
  rule that previously had no human-facing home (the vendor-spend and
  local-model sections cover its two halves);
- the test-thoroughly best practice now says to budget for manual testing,
  which two practitioners in the thread independently name as the dominant
  cost;
- the validation-responsibility section gains a worked example of defects
  that look correct to the builder and surface only on contact with a
  player, as the concrete answer to why checks are worth instrumenting.

The report is cited inline by venue, date, and title because references.bib
carries only academic entries.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01GMS285msTfSxnF4Cy9RkTE

* docs: fold the field-report datapoint into the routed-architectures subsection and attribute every use

The planner-executor rule already lives, with a citation, in the
small-local-models section, so the separate model-tiering section is
dropped and the report's spend and scope datapoint joins that
subsection. Each of the four uses now cites the community and the
tracking issue, the two testing-cost commenters are named as such, the
defect list is a bullet list, and coding skill is one route rather than
the usual one.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01GMS285msTfSxnF4Cy9RkTE

* docs: restore the shared-subscription qualifier on the field report's spend figure

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01GMS285msTfSxnF4Cy9RkTE

---------

Co-authored-by: Claude <noreply@anthropic.com>
d-morrison added a commit that referenced this pull request Sep 1, 2026
…ing, and validation lessons (closes #98) (#179)

* start: mine the four-month game-dev field report (closes #98)

* docs: mine the four-month game-dev field report for supervision, tiering, and validation lessons (closes #98)

A public field report (r/ClaudeCode, 2026-08-22) from a non-programmer who
built a browser racing game with coding agents refines three things these
notes already say and adds one they did not:

- the closing list in relative-advantages now asks for enough domain
  judgment to supervise, with coding skill as the usual route rather than a
  precondition, and cites the report as the datapoint;
- a new model-tiering section states the plan-expensive, implement-cheap
  rule that previously had no human-facing home (the vendor-spend and
  local-model sections cover its two halves);
- the test-thoroughly best practice now says to budget for manual testing,
  which two practitioners in the thread independently name as the dominant
  cost;
- the validation-responsibility section gains a worked example of defects
  that look correct to the builder and surface only on contact with a
  player, as the concrete answer to why checks are worth instrumenting.

The report is cited inline by venue, date, and title because references.bib
carries only academic entries.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01GMS285msTfSxnF4Cy9RkTE

* docs: fold the field-report datapoint into the routed-architectures subsection and attribute every use

The planner-executor rule already lives, with a citation, in the
small-local-models section, so the separate model-tiering section is
dropped and the report's spend and scope datapoint joins that
subsection. Each of the four uses now cites the community and the
tracking issue, the two testing-cost commenters are named as such, the
defect list is a bullet list, and coding skill is one route rather than
the usual one.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01GMS285msTfSxnF4Cy9RkTE

* docs: restore the shared-subscription qualifier on the field report's spend figure

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01GMS285msTfSxnF4Cy9RkTE

---------

Co-authored-by: Claude <noreply@anthropic.com>
d-morrison added a commit that referenced this pull request Sep 1, 2026
…ing, and validation lessons (closes #98) (#184)

* docs: mine the four-month game-dev field report for supervision, tiering, and validation lessons (closes #98)

Re-lands the change that PR #179 carried. That PR was stacked on the
community-directory branch and merged into it, and the branch was then
closed and re-landed as #182 without these commits, so the field-report
edits never reached main. Same content as #179's reviewed head, plus one
grammar fix Copilot raised on the stacked branch ("with coding agents and
no coding experience").

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01GMS285msTfSxnF4Cy9RkTE

* docs: scope the verification claim to the report and list the three cost levers

Copilot's round on #184: the sentence "No automated verification appears
anywhere in the project" asserted more than the report evidences, so it
now says what the report and its thread do not mention; the three cost
levers are a bullet list with the spend figure in its own sentence, per
the lab's list rule; and the new callout uses the same div syntax as the
one above it.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01GMS285msTfSxnF4Cy9RkTE

* docs: cite the field report by its post permalink

The four citations linked the subreddit because the issue body carried
no permalink; a comment on issue #98 does carry it, so the citations now
link the post itself with the subreddit and date beside it.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01GMS285msTfSxnF4Cy9RkTE

* docs: one clause per line in the three field-report sentences Copilot flagged

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01GMS285msTfSxnF4Cy9RkTE

* docs: one clause per line in the field-report citation sentence

Copilot flagged the remaining long line in small-local-models-agentic.qmd.
The split is source-only: no blank line is added, so the paragraph renders
unchanged.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01GMS285msTfSxnF4Cy9RkTE

* docs: caution callout and sentence-level lines for the field-report passages

Copilot's suppressed comments: the worked example in
responsibility-for-validation.qmd describes a failure mode, so it is a
callout-caution rather than a callout-tip; the "budget for it" item in
agents-best-practices.qmd now starts its continuation as a sentence and
carries one clause per line. The citation parentheticals in both files are
split at their separators to match the other two chapters.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01GMS285msTfSxnF4Cy9RkTE

---------

Co-authored-by: Claude <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants