Add AI agent onboarding and Copilot coding agent configuration by obenland · Pull Request #344 · WordPress/wporg-two-factor

obenland · 2026-03-24T13:18:40Z

Summary

Adds AGENTS.md with project overview, build/test/lint commands, repository layout, CI workflow details, and coding conventions
Adds CLAUDE.md that references AGENTS.md
Adds .github/copilot-instructions.md with full autonomous workflow instructions: reading issues, understanding code history, writing secure code with tests, and validating with Playwright + wp-env
Adds .github/workflows/copilot-setup-steps.yml to set up the agent environment (Node 24, PHP 8.3, Composer, Playwright, wp-env)
Adds path-specific instructions for PHP, JS, and test files in .github/instructions/
Reduces repeated codebase exploration by AI coding agents, helping them produce correct changes faster

Test plan

Verify AGENTS.md content is accurate and up to date
Verify copilot-instructions.md covers the right workflows and URLs
Verify copilot-setup-steps.yml runs successfully (trigger via workflow_dispatch)
Verify CI passes (no source changes)

🤖 Generated with Claude Code

Provides agents with project overview, build/test/lint commands, repository layout, CI checks, and coding conventions so they can work efficiently without repeated codebase exploration. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

obenland · 2026-03-24T13:30:55Z

@dd32 This repo feels like a good candidate to experiment with Github's autonomous agents to go through the backlog of (I assume low-to-medium priority) issues, curious what you think?

I'd probably add a layer of copilot-specific instructions to respond to assigned issues and enable MCP access to Playwright or Puppeteer or something so it can spin up wp-env and test its changes.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

dd32 · 2026-03-25T02:50:28Z

@obenland Sounds like a sane choice to me. I'm not 100% that all of the backlog are things we want to do, which is why I mostly haven't just let AI loose on many things.

I hadn't yet dug into directing copilot, and I didn't realise it had Playwright available to it (I assumed I'd have to install it into the env), I guess when I've used it I haven't properly prompted CoPilot to use wp-env properly, so it had no ability to use playwright anyway.. Partly due to the complexity of the bootup process for the local environments...

obenland · 2026-03-25T16:09:27Z

I'm not 100% that all of the backlog are things we want to do

Yeah, agreed. If you find the time, maybe you could close some of the obvious-to-you wontfix ones? Obviously low priority. I'd probably assign the agent to individual issues to start.

it had no ability to use playwright anyway. Partly due to the complexity of the bootup process for the local environments

This is mainly what the experiment would be about for me. Can we setup copilot through MCPs and agent instructions to where it can act on issues independently. And as a secondary thought, can it be replicated for other (wp-env-based) repos.

obenland · 2026-03-25T16:10:49Z

Could I ask for your help giving me access to the settings necessary to enabled MCPs for this repo?

dd32 · 2026-03-26T02:38:51Z

@obenland ~~I don't see any settings related to enabling MCPs, AFAICT they're enabled automatically for copilot?~~ Found them: https://github.com/WordPress/wporg-two-factor/settings/copilot/coding_agent

I've bumped Meta team (which still includes you) from Maintain to Admin on this repo though.

obenland · 2026-03-26T15:30:19Z

Thanks! The setting is within the "Code and automation" group under Copilot > Copilot coding agent, at the bottom of the page.

I added Playwright, will experiment with copilot instructions next

Adds instructions and environment setup so GitHub Copilot coding agents can work on issues end-to-end: understand the codebase and its history, write fixes with tests, and validate changes using Playwright and wp-env. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

Copilot

Pull request overview

Adds AI-agent onboarding documentation and GitHub Copilot-specific instruction/config files to reduce repeated repository exploration and standardize local/CI setup expectations.

Changes:

Add AGENTS.md and CLAUDE.md for AI agent onboarding and cross-referencing.
Add GitHub Copilot instruction files under .github/instructions/ plus .github/copilot-instructions.md.
Add a copilot-setup-steps GitHub Actions workflow and ignore .claude/settings.local.json.

Reviewed changes

Copilot reviewed 7 out of 8 changed files in this pull request and generated 5 comments.

Show a summary per file

File	Description
`CLAUDE.md`	Adds a reference to `AGENTS.md` for Claude-based agents.
`AGENTS.md`	Introduces a consolidated project overview, repo layout, commands, CI, and conventions.
`.gitignore`	Ignores local Claude settings file.
`.github/workflows/copilot-setup-steps.yml`	Adds an opt-in workflow to stand up wp-env and run tests/lint.
`.github/instructions/tests.instructions.md`	Adds testing guidance for changes under `tests/**`.
`.github/instructions/php.instructions.md`	Adds PHP conventions guidance for `*/.php`.
`.github/instructions/js.instructions.md`	Adds JS/React conventions guidance for `settings/*/.{js,jsx,ts,tsx}`.
`.github/copilot-instructions.md`	Adds broader Copilot agent guidance on architecture, security, and validation.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

.github/workflows/copilot-setup-steps.yml

.github/copilot-instructions.md

AGENTS.md

The push/pull_request path triggers cause unnecessary CI runs whenever the workflow file is changed in a PR. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

Cache node_modules, Playwright browsers, and Docker images to avoid re-downloading everything on each agent run. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

Remove reference to nonexistent .editorconfig, align codeCoverageIgnore guidance with phpunit.xml.dist philosophy, and correct mu-plugin label to network-activated plugin. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

…files Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

Copilot

Pull request overview

Copilot reviewed 8 out of 9 changed files in this pull request and generated 4 comments.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

AGENTS.md

.nvmrc

.github/workflows/copilot-setup-steps.yml

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

Only cache images from wp-env containers instead of all local images, and use nullglob to prevent errors when loading from an empty cache. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

Copilot

Pull request overview

Copilot reviewed 8 out of 9 changed files in this pull request and generated 2 comments.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

.github/instructions/php.instructions.md

.github/workflows/copilot-setup-steps.yml

Drop the ambiguous PHPDoc/covers bullet from PHP instructions. Pin Playwright version in copilot setup for reproducible builds. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

Playwright is provided by the MCP server, not used as a direct dependency. No need to install browsers in the setup workflow. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

Copilot

Pull request overview

Copilot reviewed 8 out of 9 changed files in this pull request and generated no new comments.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

obenland · 2026-03-26T18:35:21Z

@dd32 Are you up for me giving this a try?

dd32 · 2026-03-30T05:49:14Z

Thanks! The setting is within the "Code and automation" group under Copilot > Copilot coding agent, at the bottom of the page.

Yeah I read this as "Playwright MCP is already enabled"; Rendering there to be no need to add it as a Mcpserver 🤷

The GitHub and Playwright MCP servers are enabled by default.

You can configure your own MCP servers by adding JSON configuration below.

obenland · 2026-03-30T13:21:17Z

Oh, I think you're right! Didn't catch that

obenland · 2026-03-30T13:23:39Z

Test session with the agent.md and copilot instructions: https://github.com/WordPress/wporg-two-factor/tasks/2be2a4ed-b0ae-4246-9d4c-ef2dd0a7e70d

Use GitHub repo refs instead of zip downloads for plugins (Gutenberg, bbPress, WebAuthn provider) to speed up environment setup in CI. The copilot setup workflow and instructions now use --config=.wp-env.copilot.json. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

…nfig Move GitHub repo refs for plugins and core into the shared .wp-env.json instead of maintaining a separate copilot-specific config. Simplifies all wp-env commands by removing --config flags everywhere. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

…n GitHub refs in PR #344 Agent-Logs-Url: https://github.com/WordPress/wporg-two-factor/sessions/76d8b648-031c-4444-8535-48498a512de1 Co-authored-by: obenland <1398304+obenland@users.noreply.github.com>

wp-env validates config strictly and rejects unknown keys. Document the GitHub repo ref requirement in copilot-instructions.md instead. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

The repo is bbpress/bbPress, not WordPress/bbpress. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

The sjinks/wp-two-factor-provider-webauthn GitHub repo requires composer install for its vendor/autoload.php. The zip download from wordpress.org includes built dependencies and works out of the box. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

The WebAuthn provider GitHub source needs composer install, so use the pre-built release zip from GitHub instead. Remove the explicit WordPress core ref — wp-env's default core download is much faster than cloning WordPress/WordPress with all its branches. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

Copilot agents can't download from api.wordpress.org. Use the GitHub archive zip which is fast (~97s vs ~17min for git clone) and available inside the Copilot sandbox. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

obenland and others added 3 commits March 24, 2026 14:37

Fix inaccuracies in AGENTS.md from audit

bd3c996

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

Clarify wp-env and lifecycle script descriptions in AGENTS.md

8e5a212

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

Add .claude/settings.local.json to .gitignore

768f82a

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

Copilot AI review requested due to automatic review settings March 26, 2026 16:26

Copilot started reviewing on behalf of obenland March 26, 2026 16:26 View session

obenland changed the title ~~Add AGENTS.md and CLAUDE.md for AI agent onboarding~~ Add AI agent onboarding and Copilot coding agent configuration Mar 26, 2026

Copilot AI reviewed Mar 26, 2026

View reviewed changes

obenland and others added 5 commits March 26, 2026 13:50

Build: Only trigger copilot-setup-steps on manual dispatch

329b84d

The push/pull_request path triggers cause unnecessary CI runs whenever the workflow file is changed in a PR. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

Build: Cache dependencies in copilot-setup-steps

fbb93d7

Cache node_modules, Playwright browsers, and Docker images to avoid re-downloading everything on each agent run. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

Update .nvmrc to Node 24, use node-version-file in copilot setup

52afc72

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

Use canonical PHP lint command and cross-reference agent instruction …

a006129

…files Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

obenland requested a review from Copilot March 26, 2026 18:07

Copilot started reviewing on behalf of obenland March 26, 2026 18:07 View session

Copilot AI reviewed Mar 26, 2026

View reviewed changes

AGENTS.md Outdated Show resolved Hide resolved

.nvmrc Show resolved Hide resolved

.github/workflows/copilot-setup-steps.yml Outdated Show resolved Hide resolved

.github/workflows/copilot-setup-steps.yml Show resolved Hide resolved

obenland and others added 2 commits March 26, 2026 14:12

Update AGENTS.md

77332ff

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

Build: Harden Docker image caching in copilot setup

61e7eda

Only cache images from wp-env containers instead of all local images, and use nullglob to prevent errors when loading from an empty cache. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

obenland requested a review from Copilot March 26, 2026 18:14

Copilot started reviewing on behalf of obenland March 26, 2026 18:15 View session

Copilot AI reviewed Mar 26, 2026

View reviewed changes

.github/instructions/php.instructions.md Outdated Show resolved Hide resolved

.github/workflows/copilot-setup-steps.yml Outdated Show resolved Hide resolved

obenland and others added 2 commits March 26, 2026 14:24

Remove PHPDoc instruction, pin Playwright to 1.58.2

2ae40d6

Drop the ambiguous PHPDoc/covers bullet from PHP instructions. Pin Playwright version in copilot setup for reproducible builds. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

Build: Remove Playwright install from copilot setup

4771fbb

Playwright is provided by the MCP server, not used as a direct dependency. No need to install browsers in the setup workflow. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

obenland requested a review from Copilot March 26, 2026 18:27

Copilot started reviewing on behalf of obenland March 26, 2026 18:27 View session

Copilot AI reviewed Mar 26, 2026

View reviewed changes

obenland and others added 4 commits March 30, 2026 10:35

Make E2E verification mandatory for all Copilot PRs

4462ef3

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

Add explicit WordPress core ref to copilot wp-env config

9af270f

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

Copilot AI mentioned this pull request Mar 30, 2026

Handle error properly in revalidate modal's maybeRefreshUser #346

Closed

6 tasks

obenland and others added 5 commits March 30, 2026 10:59

Remove invalid comment from .wp-env.json

0de0f0a

wp-env validates config strictly and rejects unknown keys. Document the GitHub repo ref requirement in copilot-instructions.md instead. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

Fix bbPress GitHub repo ref in wp-env config

720db4b

The repo is bbpress/bbPress, not WordPress/bbpress. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

Conversation

obenland commented Mar 24, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Test plan

Uh oh!

obenland commented Mar 24, 2026

Uh oh!

dd32 commented Mar 25, 2026

Uh oh!

obenland commented Mar 25, 2026

Uh oh!

obenland commented Mar 25, 2026

Uh oh!

dd32 commented Mar 26, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

obenland commented Mar 26, 2026

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

obenland commented Mar 26, 2026

Uh oh!

dd32 commented Mar 30, 2026

Uh oh!

obenland commented Mar 30, 2026

Uh oh!

obenland commented Mar 30, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

obenland commented Mar 24, 2026 •

edited

Loading

dd32 commented Mar 26, 2026 •

edited

Loading