Add Trojan Skill Hunter agent for auditing AI customization contributions 🤖🤖🤖#2423
Open
sjiyani wants to merge 2 commits into
Open
Add Trojan Skill Hunter agent for auditing AI customization contributions 🤖🤖🤖#2423sjiyani wants to merge 2 commits into
sjiyani wants to merge 2 commits into
Conversation
…tributions Adds a new agent that audits .agent.md, SKILL.md, .instructions.md, hooks.json, and MCP/plugin manifests for hidden prompt injection, MCP-style tool poisoning/shadowing, unicode steganography, excessive-agency scope mismatches, and rug-pull/supply-chain drift before contributions are merged, installed, or trusted. Mapped to the OWASP Top 10 for LLM Applications (2025) and Invariant Labs' MCP Tool Poisoning Attack research. Includes an explicit self-defense rule so the agent treats reviewed content as untrusted data, never instructions to obey.
Contributor
🔒 PR Risk Scan ResultsScanned 2 changed file(s).
✅ No matching risk patterns were detected in changed files.
|
Contributor
🔍 Vally Lint Results
Summary
Full linter output |
…ives The Rule Zero bullet and two rug-pull/unpinned-fetch examples quoted the exact literal phrases (e.g. 'ignore previous instructions', 'curl | bash') that the repo's automated PR Risk Scan greps for. Reworded to convey the identical meaning without the literal trigger strings - confirmed locally with 'node eng/pr-risk-scan.mjs' (0 high/medium/info findings, was 3 high).
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Pull Request Checklist
npm startand verified thatREADME.mdis up to date.mainbranch for this pull request.Description
Adds Trojan Skill Hunter, an agent that audits AI agent/skill/instruction/hook/MCP-config contributions for hidden prompt injection and supply-chain risks before they are merged, installed, or trusted.
This repo's
agents/,skills/,instructions/, andhooks/files get loaded directly into another developer's Copilot context, which makes them a real supply-chain trust boundary. I reviewed the existing security-focused agents and skills in this repo (agent-owasp-compliance,agent-supply-chain,mcp-security-audit,threat-model-analyst,security-review,se-security-reviewer,sast-sca-security-analyzer, etc.) and found they all audit application code or configuration - none of them audit the markdown customization content itself for hidden instructions aimed at the AI reader rather than the human reviewer.Trojan Skill Hunter fills that gap. It checks for:
<IMPORTANT>-style tags invisible in a rendered preview)Findings are mapped to the OWASP Top 10 for LLM Applications (2025) and produced as a structured Markdown report with a PASS/FAIL/NEEDS-HUMAN-REVIEW verdict - it never auto-merges, auto-executes, or auto-rejects. It also has an explicit "Rule Zero": it treats everything it scans as untrusted data to analyze, never instructions to obey, so it can't itself be hijacked by the payloads it's hunting for.
Type of Contribution
Additional Notes
Validated locally before opening this PR:
npm ci && npm run buildon a fresh branch cut from up-to-dateorigin/main- clean run, onlydocs/README.agents.mdregenerated plus the new agent fileeng/fix-line-endings.shrun, no stray diffsagents/andskills/directories for name collisions and overlapping scope - confirmed no duplicateBy submitting this pull request, I confirm that my contribution abides by the Code of Conduct and will be licensed under the MIT License.