All notable changes to this project are documented here. The format is based on Keep a Changelog, and this project adheres to Semantic Versioning.
0.2.0 - 2026-06-05
- Docker image and a published container entry point.
- Continuous integration across Python 3.10, 3.11 and 3.12.
- Expanded documentation, including verdicts and limitations.
0.1.0 - 2026-06-02
proportionscommand: two-proportion z-test on two aggregate accuracies and their sample sizes.pairedcommand: McNemar's test on paired per-example correctness, exact for small samples and chi-squared for large ones.- A four-way verdict (improvement, unchanged, noise, regression) that fails CI
only on a significant regression, with a configurable
--alpha.