Add automatic tests for metrics - #939

Merged

NathanHB merged 34 commits into

mainfrom

nathan-add-tests-for-metrics

Sep 17, 2025

Commits on Aug 27, 2025

Fixe Sampling Metrics and Evals
NathanHB
committed
d8cfc2e
remove breakpoint
NathanHB
committed
7ae5da5
add auto tests for metrics
NathanHB
committed
a00f3c0
Merge branch 'main' into nathan-add-tests-for-metrics
NathanHB
authored
a892260
Delete tests/unit/metrics/test_cases/README.md
NathanHB
authored
bf25211
Delete tests/unit/metrics/test_unit_harness_metrics.py
NathanHB
authored
2b65d08
add pip as test dependency, for spacy to work correctly
NathanHB
committed
594b942
Merge branch 'nathan-add-tests-for-metrics' of github.com:huggingface/lighteval into nathan-add-tests-for-metrics
NathanHB
committed
6db8263

Commits on Aug 28, 2025

fix tests and reorg files
NathanHB
committed
9f7c2be
fix tests and reorg files
NathanHB
committed
e1a55ac

Commits on Sep 1, 2025

Commits on Sep 2, 2025

fix faithfullness metric
NathanHB
committed
0c4a554

Commits on Sep 3, 2025

adds corpus level metric testing
NathanHB
committed
594c269
fix bleu metric
NathanHB
committed
fc01e6b
fix bleu metric
NathanHB
committed
c574035

Commits on Sep 8, 2025

Commits on Sep 9, 2025

fix avg at k
NathanHB
committed
b5b82a8

Commits on Sep 15, 2025

Commits on Sep 16, 2025

Update tests/unit/metrics/test_metrics_automated.py

NathanHB
and
Copilot
authored
23e9714
fix tests
NathanHB
committed
048b407
remove breakpoint
NathanHB
committed
c4aebce
remove breakpoint
NathanHB
committed
432345e
Merge branch 'main' into nathan-add-tests-for-metrics
NathanHB
authored
dab1dae
fix quality
NathanHB
committed
fd27034