feat: inline LLM judge + V2 leaderboard 6-tab toggle + reproduce-leaderboard recipe - #196

Merged

reacher-z merged 19 commits into

mainfrom

May 22, 2026

Commits on May 9, 2026

docs: spec for v2 corpus + HF dataset announcement update
reacher-z
committed
8eadcda

Commits on May 20, 2026

docs: README leaderboard 6-tab toggle + Reproduce the leaderboard section
reacher-z
committed
de60981

Commits on May 21, 2026

feat: lenient (default) judge + reproduce CLI + eval_results output
reacher-z
committed
551911f
refactor: lift rescore/reproduce into clawbench.eval package + sh wrappers
reacher-z
committed
7705b8f
docs: tighten Reproduce-the-leaderboard section into two clear paths
reacher-z
committed
6e21834
feat: flip clawbench-batch default --cases-suite to v2
reacher-z
committed
1b3ebf0
docs(rescore): clarify --judge-model help text (ds-v4-pro -> deepseek-v4-pro)
reacher-z
committed
4143390
docs(README): add 2026-05-20 News entry — V2 default, lenient judge, six harnesses
reacher-z
committed
647ed8f
chore: restore claw-eval entry in CASE_SUITES on feat/llm-judge
reacher-z
committed
3f829b6
ci: retrigger checks
reacher-z
committed
850e070
docs: rewrite V2 trace dataset + leaderboard space URLs to TIGER-Lab
reacher-z
committed
27d45f3
docs(rebuttal): point ICLR-2026 review-1 leaderboard refs at TIGER-Lab/ClawBench
reacher-z
committed
a3c5dad
chore(static): update hero strapline to 130 TASKS / 64 LIVE WEBSITES
reacher-z
committed
52b804e
docs(README): switch bibtex from @misc/eprint to @article/journal form
reacher-z
committed
2a5bd2b
merge: main into feat/llm-judge
reacher-z
committed
b9de40e
docs(README): condense News to single-line bullets with Details links (limited-attention principle)
reacher-z
committed
3671e2c

Commits on May 22, 2026

chore: format and type fix
Perry2004
committed
837484b
chore: remove unrelated docs
Perry2004
committed
bee06cd
Merge branch 'main' into feat/llm-judge
Perry2004
committed
8035097