Skip to content

Commit a0a9edc

Browse files
committed
Lock v1 plan after multi-agent review and design pass
Integrates counselors feedback and locks remaining decisions: - Safety via --tools allowlist (verified empirically against claude CLI) - Read-only default with opt-in write mode; writes confined to per-run outputs/ via settings.json permission rules - Per-variant Haiku judge on a 0-100 rubric (no winner) - Flat run folders under agents/mdredd/ with full disk-authoritative state - Editing lock while any column is running; Start new button - README reconciled with plan (two-or-three columns, per-column prompts, per-variant scoring)
1 parent 9db6c15 commit a0a9edc

3 files changed

Lines changed: 365 additions & 116 deletions

File tree

.gitignore

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
/agents

README.md

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -12,22 +12,22 @@ Without a structured way to compare variants, every instruction tweak is a guess
1212

1313
## What mdredd does
1414

15-
mdredd runs two (or more) versions of the same instruction file against the same prompt, in parallel, and shows you the full results side by side. An optional judge model scores them on a rubric (Accuracy, Completeness, Instruction Adherence, Clarity) and picks a winner.
15+
mdredd runs two or three versions of the same instruction file in parallel — each with its own prompt — and shows you the full results side by side. An optional judge model scores each variant independently on a rubric (Accuracy, Completeness, Adherence, Clarity) so you can compare them at a glance.
1616

1717
## What you can do with it
1818

19-
- Compare two versions of your project's `CLAUDE.md` on the same prompt
19+
- Compare two or three versions of your project's `CLAUDE.md`, each with a tailored prompt
2020
- See whether a skill you wrote actually shapes the output the way you expect
2121
- A/B test different wordings in an agent definition
2222
- Inspect full transcripts — tool calls, reasoning, final answer — for every variant
23-
- Get a structured rubric score and winner from a judge model
23+
- Get structured rubric scores for each variant from a judge model
2424

2525
## How it fits your workflow
2626

2727
- Run `mdredd` from any project directory
28-
- A browser UI opens locally with two variant columns (add more with `+`)
28+
- A browser UI opens locally with two variant columns (add a third with `+`)
2929
- Paste or pick instruction-file variants; write a prompt per column; click Run
30-
- Each variant runs in an isolated sandbox — your source files stay untouched
30+
- Variants run with a read-only tool allowlist by default — your source files stay untouched. A Write mode lets variants produce files into a per-run folder, still without modifying your source
3131
- Results stream live; judge scores appear once runs complete
3232

3333
## Requirements

0 commit comments

Comments
 (0)