Releases: TIGER-AI-Lab/ClawBench
Releases · TIGER-AI-Lab/ClawBench
Release list
v0.3.3
What's Changed
- feat: port some claw-eval tasks #72 by @Perry2004 in #168
- Feat/172 more run meta by @Perry2004 in #173
- docs: add Contact section to README (en + zh) by @reacher-z in #164
- Test/interface sanity test by @Perry2004 in #174
- ci: run tests by @Perry2004 in #175
- test: tui tests with mock questionary by @Perry2004 in #176
- Fix/59 sysconf on windows by @Perry2004 in #177
- build: 0.3.3 patch release by @Perry2004 in #178
Full Changelog: https://github.com/reacher-z/ClawBench/blob/main/CHANGELOG.md
v0.3.2
What's Changed
- fix: remove dangling log files by @Perry2004 in #165
- chore: shell format fix by @Perry2004 in #166
- build: v0.3.2 release by @Perry2004 in #167
Full Changelog: https://github.com/reacher-z/ClawBench/blob/main/CHANGELOG.md
v0.3.1
What's Changed
- docs(news): V2 leaderboard ships + V2Trace dataset announce by @reacher-z in #149
- docs: add 'What are you looking for?' audience-targeted entry grid by @reacher-z in #144
- docs: scoring logic — 2-stage rubric, judge prompt, reproducibility by @reacher-z in #148
- Docs/add logo by @Perry2004 in #151
- fix: README scoring.md links → eval/scoring.md by @reacher-z in #150
- docs: update readme FAQ by @Perry2004 in #156
- docs(news): announce TIGER-Lab/ClawBench canonical Space + collection by @reacher-z in #155
- fix: remove ASPCA-related tasks by @Perry2004 in #161
- docs: v0.3.1 patch changelog by @Perry2004 in #162
- build: v0.3.1 patch release by @Perry2004 in #163
Full Changelog: https://github.com/reacher-z/ClawBench/blob/main/CHANGELOG.md
v0.3.0
What's Changed
- docs: update CD and PiPI news by @Perry2004 in #138
- feat: inline LLM judge as second scoring stage by @reacher-z in #139
- feat: add --resume flag to batch runner to skip completed jobs by @erenup in #140
- style: ruff format judge.py and run.py (unblocks main + all open PRs) by @reacher-z in #141
- docs: announce ClawBenchV1Trace dataset + add Datasets section by @reacher-z in #142
- Feat/126 support pi coding agent by @Perry2004 in #143
New Contributors
Full Changelog: https://github.com/reacher-z/ClawBench/blob/main/CHANGELOG.md
v0.2.2
What's Changed
- chore: migrate package to clawbench-eval by @Perry2004 in #137
Full Changelog: https://github.com/reacher-z/ClawBench/blob/main/CHANGELOG.md
v0.2.1
What's Changed
- docs: post v0.2.0 release doc by @Perry2004 in #134
- fix: include static assets into the build artifact so markdowns rende… by @Perry2004 in #136
Full Changelog: https://github.com/reacher-z/ClawBench/blob/main/CHANGELOG.md
v0.2.0
What's Changed
- Add stars badge, funding config, clean up demos by @reacher-z in #20
- Add evaluation guide and rubric under eval/ by @reacher-z in #22
- Simplify feature cards and add language switcher by @reacher-z in #23
- Add Advisors section to READMEs by @reacher-z in #25
- Add ClawBench-Lite v0.1 (20-task curated subset) by @reacher-z in #27
- Add ClawBench-Lite intro section to READMEs by @reacher-z in #29
- tools: add ClawBench-Lite upstream encrypted-blob builder by @reacher-z in #32
- README: brand colors and logos for badges by @reacher-z in #31
- README: add example walkthrough and expand quickstart by @reacher-z in #33
- test-driver: TUI overhaul, build UX, and runtime improvements by @reacher-z in #35
- README: feature layout and TUI callout by @reacher-z in #36
- README: condense LLM Quick Start to one line by @reacher-z in #37
- README: one-liner clone+run under Human Quick Start by @reacher-z in #38
- README: remove middot separators from feature row by @reacher-z in #39
- README: richer hero, publicity badges, star history chart by @reacher-z in #40
- README: hero refresh with icon badges, wand callout, star history by @reacher-z in #41
- README: hero refresh with icon badges, one-line command callout, star history by @reacher-z in #44
- Package ClawBench as pip install claw-bench by @reacher-z in #45
- README: surface both install paths in Human Quick Start by @reacher-z in #47
- TUI: add Configure secrets screen for parity with CLI by @reacher-z in #50
- Publish second wave of defensive PyPI aliases by @reacher-z in #48
- test-driver: record task.json sha256 in run-meta.json (#28) by @reacher-z in #30
- Publish third wave of defensive PyPI aliases (research-themed) by @reacher-z in #49
- feat: support opencode harness by @Perry2004 in #55
- Add Star-us prompts across TUI, CLI, and README by @reacher-z in #51
- Growth kit v1: leaderboard hero, Discord+Codespaces badges, HF Space, launch playbook by @reacher-z in #52
- Remove outdated scoreboard from README; add Star CTA badge by @reacher-z in #58
- Align PyPI name to clawbench-eval across pyproject and source by @reacher-z in #60
- Update Readme Community part by @Infinite-Ng in #63
- feat: support claude code by @Perry2004 in #75
- Add #3 Paper of the Day and DeepWiki badges to README by @reacher-z in #76
- Beautify README header in Stagehand-style layout by @reacher-z in #79
- Revert "Beautify README header in Stagehand-style layout" by @reacher-z in #80
- Add CI, PyPI, license, and issues badges to README by @reacher-z in #73
- Add date-released field to CITATION.cff by @reacher-z in #74
- Add HarnessBench cross-reference to READMEs by @reacher-z in #77
- Expose harnesses as plugin surface (toolkit groundwork) by @reacher-z in #78
- Trim README badge row to six essentials by @reacher-z in #81
- Add neuralcomputer-style hero SVG to README by @reacher-z in #82
- README: Featured-in strip, direct-answer intro, related-work table, FAQ by @reacher-z in #84
- README: add activity/velocity badges by @reacher-z in #85
- fix: restrict commands for claude code by @Perry2004 in #86
- feat: support codex (closes #14) by @Perry2004 in #88
- docs: news section by @Perry2004 in #89
- README: add News section with harness-support milestones (FA icons) by @reacher-z in #90
- README: drop duplicate emoji News section by @reacher-z in #91
- Feat/15 support browser use by @Perry2004 in #92
- README: remove duplicate emoji News section reintroduced by browser-use merge by @reacher-z in #93
- feat: support claw code by @Perry2004 in #95
- feat: support claude code browser extension by @Perry2004 in #96
- feat: support hermes harness #70 by @Perry2004 in #97
- fix: remove buggy eval schema by @Perry2004 in #24
- Drop harness-bench from alias list (handed to HarnessBench) by @reacher-z in #83
- chore: remove stall files by @Perry2004 in #98
- feat: devcontainer by @Perry2004 in #99
- Refactor/merge two path by @Perry2004 in #106
- refactor: move nodejs installation to harness layers #107 by @Perry2004 in #108
- Ci/check docker build ci by @Perry2004 in #109
- fix: check docker build workflow by @Perry2004 in #110
- fix: markdown rendering from workflow by @Perry2004 in #111
- ci: merge gatekeeper by @Perry2004 in #112
- ci: ruff static check by @Perry2004 in #113
- refactor: extra package layer as a better package structure by @Perry2004 in #114
- Add V2 corpus and runner entrypoints by @reacher-z in #116
- docs: update faq by @Perry2004 in #117
- refactor: a better package structure for building and releasing #123 by @Perry2004 in #124
- docs: update news for 2026.05.04 refactoring by @Perry2004 in #128
- CD: release to PyPI #132 by @Perry2004 in #133
New Contributors
- @Infinite-Ng made their first contribution in #63
Full Changelog: https://github.com/reacher-z/ClawBench/blob/main/CHANGELOG.md