Skip to content

docs(agents): survey Posit's AI tooling repositories (closes #106) - #211

Merged
dem-extra1 merged 7 commits into
mainfrom
review-posit-dev-106
Sep 10, 2026
Merged

docs(agents): survey Posit's AI tooling repositories (closes #106)#211
dem-extra1 merged 7 commits into
mainfrom
review-posit-dev-106

Conversation

@dem-extra1

Copy link
Copy Markdown
Collaborator

Issue #106 asks for a review of the whole posit-dev GitHub organization.
The lab already covers one of its repositories (posit-dev/skills, @sec-ai-posit-skills),
but Posit publishes a growing set of LLM packages, MCP servers, and agent tooling for R and Python
that a lab centered on R and Quarto should know about, and nothing in the site surveys them together.

This PR adds chapters/ai-tools/posit-dev-ai-repos.qmd ("Posit's AI Tooling on GitHub"),
transcluded from chapters/coding-agents.qmd right after the Posit skills section.
The organization was enumerated with gh repo list posit-dev rather than by browsing,
then filtered to the AI-related repositories;
the fragment tabulates them (purpose, language, stars, last push, verdict)
and closes with a short "Useful to us?" assessment for the lab's workflow.

Closes #106

🤖 Generated with Claude Code

dem-extra1 and others added 2 commits September 9, 2026 03:47
The lab already adopted posit-dev/skills but had no survey of the rest of
the organization, so questions like "should we use btw or mcptools with
Claude Code" were answered from memory. This adds a chapter fragment that
enumerates the organization from the GitHub API (226 public repos on
2026-09-09), tabulates the 16 that build or evaluate LLM tooling, and
gives an R-centric verdict for each, singling out btw, mcptools, and
mcp-repl as worth adopting and bluffbench2 as a reference eval. It also
notes that ellmer and ragnar live under tidyverse and that Positron
Assistant has no standalone public repo, since both are common
expectations that the listing cannot satisfy.

The section is transcluded right after the Posit skill collection so the
two Posit sections sit together, and each table row cites its repository
in references.bib.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
@dem-extra1
dem-extra1 requested a lite review from Copilot September 10, 2026 01:28

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot wasn't able to review any files in this pull request.


💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

An adversarial review of the posit-dev survey found prose that
contradicted its own table and two claims stated more firmly than the
evidence allows. The table verdict for mcptools now matches the prose
(it is the layer btw uses, not itself the session inspector); commons is
no longer lumped in with the Shiny chat components, since it is a data
agent framework; the ellmer sentence now distinguishes the packages that
build on it from those that integrate with it; the Positron Assistant
architecture is attributed to the repository descriptions; and the
Rscript -e cost is stated as the mechanism (a fresh process per call)
rather than as an observation. Filler verdicts ("worth trying", "worth
knowing") are replaced with direct ones, the section heading counts
tools rather than packages because mcp-repl is a Rust binary, and
ellmer, ragnar, and vitals get repository links.

Refs #106.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
@dem-extra1
dem-extra1 marked this pull request as ready for review September 10, 2026 03:57
Copilot AI review requested due to automatic review settings September 10, 2026 03:57
@dem-extra1

Copy link
Copy Markdown
Collaborator Author

Pushed with the pre-push guard's ALLOW_UNREVIEWED_PUSH=1 override. The adversarial-reviewer subagent the guard expects is not registered in this session, so the adversarial pre-push review was performed instead by the Google Antigravity CLI (agy --print) against the full branch diff; its real findings were fixed and its stale-knowledge findings rebutted before this push. The @claude review workflow and a requested Copilot review are the independent reviews of record for this head.

Posted by Claude Code (AI agent) --- not written by a human.

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟡 Changes recommended

The newly added references.bib entries don’t follow the file’s established howpublished = {Software} convention for GitHub repositories.

Once you've addressed the issues Copilot identified, you can request another Copilot review.

Review details
  • Files reviewed: 4/4 changed files
  • Comments generated: 1
  • Review effort level: Lite

Comment thread references.bib
@github-actions

This comment has been minimized.

@github-actions

This comment has been minimized.

…tion

Copilot flagged the 17 new posit-dev repository entries for using
`howpublished = {GitHub repository}` where the file uses `{Software}`
for GitHub repositories; they now match.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Copilot AI review requested due to automatic review settings September 10, 2026 06:56
@github-actions

This comment has been minimized.

@github-actions

This comment has been minimized.

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟢 Approval recommended

The changes are documentation-focused and internally consistent, with only a minor table clarity nit noted in the new page.

Review details

Suppressed comments (1)

Previously missed (1) — in code that hasn't changed since the last review.

chapters/ai-tools/posit-dev-ai-repos.qmd:37

  • In the "Language" column, the value none isn’t a programming language and reads like a placeholder; using a neutral marker (e.g., -) makes the table clearer and avoids implying a real language.
  • Files reviewed: 4/4 changed files
  • Comments generated: 0 new
  • Review effort level: Lite

Copilot AI review requested due to automatic review settings September 10, 2026 08:10
@github-actions

This comment has been minimized.

@github-actions

This comment has been minimized.

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟡 Changes recommended

references.bib has an invalid/malformed BibTeX entry (posit_dev_positron) that will break bibliography parsing/rendering.

Once you've addressed the issues Copilot identified, you can request another Copilot review.

Review details
  • Files reviewed: 4/4 changed files
  • Comments generated: 1
  • Review effort level: Lite

Comment thread references.bib Outdated
The union resolver used for the sync dropped the blank line between
every pre-existing entry and truncated one entry, which made pandoc
reject the file and failed the build. The file is now rebuilt from
the two parent versions: main's entries in main's order and formatting,
then this branch's new entries appended, validated with pandoc.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Copilot AI review requested due to automatic review settings September 10, 2026 08:32

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟡 Changes recommended

The new Quarto content introduces a style-guide inconsistency in list formatting (and a small inline formatting inconsistency) that should be corrected before merging.

Once you've addressed the issues Copilot identified, you can request another Copilot review.

Review details
  • Files reviewed: 4/4 changed files
  • Comments generated: 2
  • Review effort level: Lite

Comment on lines +15 to +17
The rest of the organization is Positron and its extensions,
Shiny for Python, `great-tables`, `pointblank`, `air`, `ggsql`,
Posit Team deployment tooling, container images, and workshop material.
| [`btw`](https://github.com/posit-dev/btw) [@posit_dev_btw] | Toolkit for giving LLMs context about an R session: copy context to the clipboard, chat in the IDE, or connect R to coding agents through `mcptools` | R | 135 | 2026-09-09 | Yes: the most direct fit for an R-centric workflow |
| [`mcp-repl`](https://github.com/posit-dev/mcp-repl) [@posit_dev_mcp_repl] | Sandboxed MCP server that keeps a persistent R or Python session alive across an agent's tool calls, with plots returned as images | Rust | 65 | 2026-07-27 | Yes, untried: replaces `Rscript -e` round trips in Claude Code |
| [`shiny-assistant`](https://github.com/posit-dev/shiny-assistant) [@posit_dev_shiny_assistant] | Source of the hosted Shiny Assistant chat app | Python | 58 | 2026-01-17 | No: an application, not a library |
| [`raghilda`](https://github.com/posit-dev/raghilda) [@posit_dev_raghilda] | Retrieval-augmented generation pipeline in Python, with DuckDB or ChromaDB storage | Python | 36 | 2026-09-02 | No: the R counterpart is `tidyverse/ragnar` |
@github-actions

This comment has been minimized.

@github-actions

This comment has been minimized.

Copilot AI review requested due to automatic review settings September 10, 2026 08:58
@github-actions

Copy link
Copy Markdown
Contributor

Claude finished reviewView run


Review: PR #211docs(agents): survey Posit's AI tooling repositories (closes #106)

PR status confirmed: state=open, merged=false, mergeable. Proceeding with full review.

What changed since the last review round

The prior round (posted 2026-09-10T08:38:43Z, link) verdict was Ready for merge, after confirming the previously-flagged posit_dev_positron BibTeX corruption (introduced by an earlier bad merge-conflict resolution) had been fixed by commit f813d19 ("rebuild references.bib as a clean union").

Since then, two more commits landed (c3a750e, c538744), both merges of origin/main into this branch. git diff --stat f813d197 c5387440 shows the only content pulled in is chapters/ai-tools/opencode-ecosystem.qmd (304 lines), 4 lines in coding-agents.qmd, 29 WORDLIST entries, and 180 references.bib lines — all of which belong to the separately-authored, already-merged PR #209 ("OpenCode ecosystem"), not to this PR. The actual PR diff (.claude-review-pr.diff, confirmed against the live checkout) still touches only the same four files as before: chapters/ai-tools/posit-dev-ai-repos.qmd (new), chapters/coding-agents.qmd (+4 lines), inst/WORDLIST (+3 words), and references.bib (+154 lines, 17 new entries). Nothing in this PR's own content changed in this range.

Verification performed this round

  • BibTeX integrity: 73 total @-entries in references.bib, 73 matching closing braces, no duplicate keys. All 17 posit_dev_* keys are present, unique, and each entry (including posit_dev_positron, the one previously corrupted) has its complete title/author/year/howpublished/url/note fields and closing brace intact.
  • Citations resolve: all 17 [@posit_dev_*] citations in posit-dev-ai-repos.qmd correspond to defined bib keys.
  • Cross-references resolve: @sec-ai-posit-skills, @sec-ai-mcp-server-setup, @sec-ai-copilot-settings, and @sec-ai-offline, all used in the new fragment, resolve to labels actually defined in chapters/coding-agents.qmd.
  • Table structure: all 16 data rows in the "AI-related repositories" table have consistent 8-pipe-field structure matching the 6-column header.
  • WORDLIST additions justified: ChromaDB and DuckDB appear in the new raghilda table row; PBC appears in the new prose ("Posit PBC" in the opening paragraph). All three are real, in-content words, not spurious additions.
  • Fact-check spot-check against the live GitHub API for querychat, mcptools, btw, mcp-repl, commons, bluffbench2, code-index: star counts and languages match exactly what's in the table. Push dates for querychat and commons are marginally newer now (2026-09-10) than the table's stated 2026-09-09/2026-08-22 snapshot values, which is expected drift given the doc explicitly states "measured 2026-09-09" — not a factual error, just the natural staleness of a dated snapshot.

No new issues found, and the previously-flagged bibliography corruption remains fixed and unaffected by the subsequent merge commits.

Verdict

Ready for merge

Structured Review Data (JSON)
{
  "schema_version": "1.1",
  "reviewer": "claude",
  "commit_sha": "c53874408afcd68c4c51dd201cb41878b7acad9d",
  "verdict": "CLEAN",
  "findings": [],
  "detailed_assessment": "references.bib retains 73 balanced entries with the previously corrupted posit_dev_positron entry intact, and all 17 posit_dev citations plus four cross-reference labels resolve correctly in the new fragment.",
  "holistic_assessment": "This round's diff range only merges in the separately-merged opencode-ecosystem PR content, leaving this PR's own scope, WORDLIST justifications, table structure, and fact-checked star counts unchanged and validated."
}

Reviewed commit: c3a750e

@github-actions

Copy link
Copy Markdown
Contributor

💰 Cost: $0.4095 (review) — run

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟢 Approval recommended

Changes are low-risk documentation updates with one minor style-guideline tweak suggested for readability.

Review details

Suppressed comments (1)

chapters/ai-tools/posit-dev-ai-repos.qmd:17

  • The sentence listing the non-AI parts of the posit-dev org contains 3+ technical items in comma-separated prose. Repo style guidance asks for a bullet list (with a blank line before it) for lists of 3+ items to improve readability in .qmd files (see .github/copilot-instructions.md:24-51).
The rest of the organization is Positron and its extensions,
Shiny for Python, `great-tables`, `pointblank`, `air`, `ggsql`,
Posit Team deployment tooling, container images, and workshop material.
  • Files reviewed: 4/4 changed files
  • Comments generated: 0 new
  • Review effort level: Lite

@dem-extra1
dem-extra1 merged commit 1540065 into main Sep 10, 2026
15 checks passed
@dem-extra1
dem-extra1 deleted the review-posit-dev-106 branch September 10, 2026 09:13
@github-actions

Copy link
Copy Markdown
Contributor
PR Preview Action v1.8.1
Preview removed because the pull request was closed.
2026-09-10 09:13 UTC

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

review all of https://github.com/posit-dev/

2 participants