Improve harness-creator skill

Author: sanbuphy

skills/README-CN.md

@@ -21,10 +21,10 @@
 
 面向 AI 编程智能体的生产级 harness 工程技能。帮助创建、评估和改进 agent harness 文件（AGENTS.md、功能清单、验证工作流、会话连续性机制）。
 
-- **5 个参考模式**：记忆持久化、上下文工程、工具注册、多智能体协调、生命周期与引导
-- **模板**：AGENTS.md、feature-list.json、init.sh、progress.md
-- **5 个内置评估测试用例**
-- **双语支持**：English + 中文
+- **7 个参考模式**：记忆持久化、技能运行时、上下文工程、工具注册、多智能体协调、生命周期与引导、陷阱
+- **模板**：AGENTS.md/CLAUDE.md、feature-list.json、init.sh、progress.md、session-handoff.md
+- **脚本**：脚手架生成、校验、HTML 评估报告、结构化 benchmark
+- **10 个内置评估测试用例**
 
 详见 [harness-creator/README.md](harness-creator/README.md)。
 
@@ -49,10 +49,12 @@ skills/
 ├── README-VI.md                 # 越南文说明
 ├── README-DE.md                 # 德文说明
 └── harness-creator/             # Harness 工程技能
-    ├── SKILL.md                 # 主技能定义（双语）
+    ├── SKILL.md                 # 主技能定义
     ├── SKILL.md.en              # 英文版
     ├── README.md                # 详细文档
     ├── metadata.json            # 技能元数据与触发词
+    ├── agents/                  # 技能 UI 元数据
+    ├── scripts/                 # 脚手架、校验和 benchmark 辅助脚本
     ├── evals/                   # 测试用例
     ├── templates/               # 脚手架模板
     └── references/              # 深入的模式参考文档
@@ -75,7 +77,8 @@ skills/
 - 无后门、隐藏 URL 或编码载荷
 - 无数据泄露或硬编码凭证
 - 无命令注入漏洞
-- `init.sh` 仅运行标准 npm 生命周期命令
+- 脚本仅使用 Node.js 内置模块
+- 生成的 `init.sh` 运行检测到的项目验证命令
 
 ## 许可证
 

skills/README.md

@@ -21,10 +21,10 @@ This directory contains reusable AI agent skills for the Learn Harness Engineeri
 
 Production harness engineering skill for AI coding agents. Helps create, assess, and improve agent harness files (AGENTS.md, feature lists, verification workflows, session continuity mechanisms).
 
-- **5 reference patterns**: Memory Persistence, Context Engineering, Tool Registry, Multi-Agent Coordination, Lifecycle & Bootstrap
-- **Templates**: AGENTS.md, feature-list.json, init.sh, progress.md
-- **5 built-in eval test cases**
-- **Bilingual**: English + 中文
+- **7 reference patterns**: Memory Persistence, Skill Runtime, Context Engineering, Tool Registry, Multi-Agent Coordination, Lifecycle & Bootstrap, Gotchas
+- **Templates**: AGENTS.md/CLAUDE.md, feature-list.json, init.sh, progress.md, session-handoff.md
+- **Scripts**: scaffold, validate, render HTML assessment, run structural benchmark
+- **10 built-in eval test cases**
 
 See [harness-creator/README.md](harness-creator/README.md) for full documentation.
 
@@ -49,10 +49,12 @@ skills/
 ├── README-VI.md                 # Vietnamese version
 ├── README-DE.md                 # German version
 └── harness-creator/             # Harness engineering skill
-    ├── SKILL.md                 # Main skill definition (bilingual)
+    ├── SKILL.md                 # Main skill definition
     ├── SKILL.md.en              # English-only version
     ├── README.md                # Detailed documentation
     ├── metadata.json            # Skill metadata & triggers
+    ├── agents/                  # Skill UI metadata
+    ├── scripts/                 # Scaffold, validate, benchmark helpers
     ├── evals/                   # Test cases
     ├── templates/               # Scaffold templates
     └── references/              # Deep-dive pattern docs
@@ -75,7 +77,8 @@ All files in this directory have been audited for security:
 - No backdoors, hidden URLs, or encoded payloads
 - No data exfiltration or hardcoded credentials
 - No command injection vulnerabilities
-- `init.sh` runs only standard npm lifecycle commands
+- Scripts use only Node.js built-in modules
+- Generated `init.sh` runs detected project verification commands
 
 ## License
 

skills/harness-creator/README.md

@@ -1,206 +1,83 @@
-<p align="center">
-  <a href="../README.md"><img alt="English" src="https://img.shields.io/badge/English-d9d9d9"></a>
-  <a href="../README-CN.md"><img alt="简体中文" src="https://img.shields.io/badge/简体中文-d9d9d9"></a>
-  <a href="../README-ZH-TW.md"><img alt="繁體中文" src="https://img.shields.io/badge/繁體中文-d9d9d9"></a>
-  <a href="../README-JA.md"><img alt="日本語" src="https://img.shields.io/badge/日本語-d9d9d9"></a>
-  <a href="../README-ES.md"><img alt="Español" src="https://img.shields.io/badge/Español-d9d9d9"></a>
-  <a href="../README-FR.md"><img alt="Français" src="https://img.shields.io/badge/Français-d9d9d9"></a>
-  <a href="../README-KO.md"><img alt="한국어" src="https://img.shields.io/badge/한국어-d9d9d9"></a>
-  <a href="../README-AR.md"><img alt="العربية" src="https://img.shields.io/badge/العربية-d9d9d9"></a>
-  <a href="../README-VI.md"><img alt="Tiếng_Việt" src="https://img.shields.io/badge/Tiếng_Việt-d9d9d9"></a>
-  <a href="../README-DE.md"><img alt="Deutsch" src="https://img.shields.io/badge/Deutsch-d9d9d9"></a>
-</p>
+# harness-creator
 
-# harness-creator Skill
+A compact skill for building and auditing harnesses around AI coding agents.
 
-Production harness engineering skill for AI coding agents, distilled from Learn Harness Engineering course and industry best practices.
+It helps a repository provide five things agents need: instructions, state, verification, scope boundaries, and lifecycle handoff.
 
-## Installation
+## Install
 
 ```bash
 npx skills add walkinglabs/learn-harness-engineering --skill harness-creator
 ```
 
-Or manually copy the `skills/harness-creator/` directory to your skill path.
+Or copy `skills/harness-creator/` into your skill path.
 
-## What This Skill Does
+## Use
 
-This skill helps you:
-- **Create harnesses from scratch** — AGENTS.md, feature lists, verification workflows
-- **Improve existing harnesses** — Five-subsystem assessment with prioritized improvements  
-- **Design session continuity** — Memory persistence, progress tracking, handoff procedures
-- **Benchmark effectiveness** — Before/after comparison with quantitative metrics
-- **Apply production patterns** — Memory, context engineering, tool safety, multi-agent coordination
-
-## Core Framework: Five Subsystems
-
-Every harness consists of five subsystems:
-
-1. **Instructions** — AGENTS.md as routing layer, progressive disclosure via docs/ hierarchy
-2. **State** — feature_list.json, progress.md, session handoff files
-3. **Verification** — Explicit commands that agent MUST run before claiming done
-4. **Scope** — One-feature-at-a-time policy, clear definition of done
-5. **Lifecycle** — init.sh, clean-state checklists, session continuity mechanisms
-
-## Reference Patterns
-
-This skill includes 6 deep-dive reference documents:
-
-| Pattern | When to Use |
-|---------|-------------|
-| [Memory Persistence](references/memory-persistence-pattern.md) | Agent forgets between sessions, need persistent project knowledge |
-| [Context Engineering](references/context-engineering-pattern.md) | Context budget management, JIT loading, delegation isolation |
-| [Tool Registry](references/tool-registry-pattern.md) | Tool safety, concurrency control, permission pipelines |
-| [Multi-Agent Coordination](references/multi-agent-pattern.md) | Parallelism, specialization, researcher→implementer workflows |
-| [Lifecycle & Bootstrap](references/lifecycle-bootstrap-pattern.md) | Hooks, background tasks, initialization sequences |
-| [Gotchas](references/gotchas.md) | 15 non-obvious failure modes with fixes |
-
-## Usage Examples
-
-### Create Minimal Harness
-
-```
-User: "I need to set up AGENTS.md for my TypeScript project"
-
-Skill will:
-1. Ask about project context (stack, size, agent tool)
-2. Generate AGENTS.md with startup workflow and working rules
-3. Create feature_list.json template with placeholder features
-4. Create init.sh with verification commands
-5. Explain how to use each file
-```
-
-### Assess Existing Harness
-
-```
-User: "My agent still breaks things even with AGENTS.md"
-
-Skill will:
-1. Request current AGENTS.md content
-2. Score each of 5 subsystems (1-5 scale)
-3. Identify the lowest-scoring subsystem as the highest-priority improvement area
-4. Provide prioritized improvement plan with concrete steps
-```
-
-### Design Session Continuity
-
-```
-User: "Agent forgets everything between sessions"
-
-Skill will:
-1. Explain memory layers (instruction vs auto-memory)
-2. Design progress.md template for session tracking
-3. Create session-handoff.md structure
-4. Implement two-step save invariant (topic file → index)
+```bash
+node skills/harness-creator/scripts/create-harness.mjs --target /path/to/project
+node skills/harness-creator/scripts/validate-harness.mjs --target /path/to/project
+node skills/harness-creator/scripts/run-benchmark.mjs --target /path/to/project --html /path/to/report.html
 ```
 
-## When to Trigger
+The scripts use only Node.js built-in modules. They can be run after copying the skill directory into another repository.
 
-This skill triggers on:
-- "Create AGENTS.md / CLAUDE.md"
-- "Improve agent reliability"
-- "Agent forgets between sessions"
-- "Multi-session continuity needed"
-- "Benchmark harness effectiveness"
-- "Design verification workflow"
-- "Memory persistence patterns"
-- "Context engineering for agents"
+## What It Creates
 
-## When NOT to Use
+- `AGENTS.md` or `CLAUDE.md`
+- `feature_list.json`
+- `progress.md`
+- `init.sh`
+- `session-handoff.md`
 
-This skill does NOT cover:
-- Prompt engineering or system prompt design
-- Model selection or fine-tuning
-- Generic software architecture
-- LLM API integration basics
+`create-harness.mjs` detects common project types and package managers. It supports Node/npm/pnpm/yarn/bun, Python, Go, Rust, Maven, Gradle, and .NET at a basic verification-command level.
 
-## Templates Included
+## What It Checks
 
-- `templates/agents.md` — AGENTS.md scaffold with working rules
-- `templates/feature-list.json` — JSON Schema + example
-- `templates/init.sh` — Standard initialization script
-- `templates/progress.md` — Session progress log template
-- `templates/session-handoff.md` — Handoff structure
+`validate-harness.mjs` scores the five harness subsystems:
 
-## Evaluation Framework
+1. Instructions
+2. State
+3. Verification
+4. Scope
+5. Lifecycle
 
-5 test cases in `evals/evals.json`:
-1. **Minimal Harness Creation** — Full setup from scratch
-2. **Session Continuity Setup** — Memory and handoff design
-3. **Harness Assessment** — Five-subsystem scoring
-4. **Verification Workflow Design** — Force agent to verify before done
-5. **Memory Taxonomy Design** — What to save vs skip
+The score is structural. It tells you whether the harness is present and coherent; it does not replace real before/after agent-session testing.
 
-Run evaluation with skill-creator framework for quantitative benchmarks.
+## Status
 
-## Compatibility
+- [x] Minimal harness scaffolding
+- [x] Five-subsystem validation
+- [x] HTML assessment report
+- [x] Structural benchmark report
+- [x] 10 eval cases
+- [x] Generic verification detection for common stacks
+- [ ] Optional real before/after agent-session replay
 
-- **Agents**: Claude Code, Codex, Cursor, Windsurf, generic
-- **License**: MIT
-- **Languages**: English / 中文 (bilingual support in SKILL.md)
+## Files
 
-## 兼容性
-
-- **代理工具**: Claude Code, Codex, Cursor, Windsurf, generic
-- **许可证**: MIT
-- **语言**: 英文 / 中文 (SKILL.md 中双语支持)
-
-## Project Structure
-
-```
+```text
 harness-creator/
-├── SKILL.md                          # Main skill definition
-├── metadata.json                     # Skill metadata, triggers, compatibility
-├── evals/
-│   └── evals.json                    # 5 test cases with expectations
+├── SKILL.md
+├── metadata.json
+├── agents/openai.yaml
+├── scripts/
+│   ├── create-harness.mjs
+│   ├── validate-harness.mjs
+│   ├── render-assessment-html.mjs
+│   ├── run-benchmark.mjs
+│   └── lib/harness-utils.mjs
 ├── templates/
-│   ├── agents.md                     # AGENTS.md template
-│   ├── feature-list.json             # Feature tracker template
-│   ├── init.sh                       # Initialization script
-│   └── progress.md                   # Session progress template
-└── references/
-    ├── memory-persistence-pattern.md
-    ├── context-engineering-pattern.md
-    ├── tool-registry-pattern.md
-    ├── multi-agent-pattern.md
-    ├── lifecycle-bootstrap-pattern.md
-    └── gotchas.md                    # 15 failure modes
+│   ├── agents.md
+│   ├── feature-list.json
+│   ├── feature-list.schema.json
+│   ├── init.sh
+│   ├── progress.md
+│   └── session-handoff.md
+├── references/
+└── evals/evals.json
 ```
 
-## Development Roadmap
-
-- [x] Chinese translation in SKILL.md (bilingual support added)
-- [ ] Python scripts for automated harness generation
-- [ ] HTML viewer for harness assessment results
-- [ ] Expanded eval set (10+ test cases)
-- [ ] Integration with skill-creator benchmark framework
-- [ ] Full Chinese localization (harness-creator-zh directory)
-
-## 开发路线图
-
-- [x] SKILL.md 中文翻译（已添加双语支持）
-- [ ] Harness 自动生成 Python 脚本
-- [ ] Harness 评估结果 HTML 查看器
-- [ ] 扩展测试用例（10+ 个）
-- [ ] 集成 skill-creator 基准测试框架
-- [ ] 完整中文本地化（harness-creator-zh 目录）
-
-## Contributing
-
-Issues and PRs welcome. Key areas for contribution:
-- Additional reference patterns (skill runtime, hook lifecycle, etc.)
-- More eval test cases covering edge cases
-- Script automation for common harness tasks
-- Case studies from production deployments
-
-## License
-
-MIT — See LICENSE file for details.
-
-## Acknowledgments
+## Boundaries
 
-This skill synthesizes:
-- Learn Harness Engineering course framework
-- OpenAI Harness Engineering principles
-- Anthropic effective harnesses research
-- Agentic Harness Patterns skill (pattern extraction methodology)
+This skill is for harness engineering, not model selection, prompt tuning alone, or app architecture. Keep project-specific facts in the target repository.