Skip to content

Relax MNIST convergence canary threshold (97% → 96%) - #26

Merged
ausimian merged 1 commit into
mainfrom
fix-flaky-mnist-threshold
Apr 16, 2026
Merged

Relax MNIST convergence canary threshold (97% → 96%)#26
ausimian merged 1 commit into
mainfrom
fix-flaky-mnist-threshold

Conversation

@ausimian

Copy link
Copy Markdown
Owner

Summary

  • Lower @target_accuracy from 0.97 to 0.96 in mnist_full_test.exs
  • Eliminates stochastic flaps where accuracy lands at ~96.99%
  • The test is a convergence sanity gate, not a performance benchmark

Test plan

  • mix precommit passes
  • All 303 tests pass (training_full is excluded by default, threshold change is trivial)

🤖 Generated with Claude Code

The training_full test occasionally flaps at 96.99% accuracy due to
stochastic variation. Lower the gate to 96% — this test is a
convergence sanity check, not a performance benchmark.
@ausimian
ausimian merged commit 8df48f1 into main Apr 16, 2026
1 check passed
@ausimian
ausimian deleted the fix-flaky-mnist-threshold branch April 16, 2026 11:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant