Skip to content

Releases: jmweb-org/evalgate

evalgate 0.2.0

Choose a tag to compare

@delcenjo delcenjo released this 29 Jun 19:35
  • Docker image and container entry point.
  • CI across Python 3.10, 3.11 and 3.12.
  • Expanded documentation, including verdicts and limitations.

See CHANGELOG.md for the full history.

evalgate 0.1.0

Choose a tag to compare

@delcenjo delcenjo released this 29 Jun 19:35

First working release.

  • proportions: two-proportion z-test on two aggregate accuracies and their sample sizes.
  • paired: McNemar's test on paired per-example correctness, exact for small samples and chi-squared for large ones.
  • A four-way verdict (improvement, unchanged, noise, regression) that fails CI only on a significant regression, with a configurable --alpha.