Skip to content

Actions: neuralmagic/lm-evaluation-harness

Actions

All workflows

Actions

Loading...
Loading

Showing runs from all workflows
34 workflow runs
34 workflow runs

Filter by Event

Filter by Status

Filter by Branch

Filter by Actor

Fix duplicate BOS issue; add_bos_token defaults to None (#3347) Tasks Modified #19: Commit 5302f2a pushed by brian-dellabetta
2m 9s main
main
2m 9s
Fix duplicate BOS issue; add_bos_token defaults to None (#3347) Unit Tests #19: Commit 5302f2a pushed by brian-dellabetta
5m 11s main
main
5m 11s
[longbench] fix metric calculation (#2983) Unit Tests #18: Commit 147e9d6 pushed by anmarques
5m 36s main
main
5m 36s
[longbench] fix metric calculation (#2983) Tasks Modified #18: Commit 147e9d6 pushed by anmarques
1m 54s main
main
1m 54s
add arab_culture task (#3006) Tasks Modified #17: Commit 8bc4aff pushed by anmarques
7m 27s main
main
7m 27s
add arab_culture task (#3006) Unit Tests #17: Commit 8bc4aff pushed by anmarques
5m 31s main
main
5m 31s
change multimodal check in evaluate (#3013) Tasks Modified #16: Commit e1a7a39 pushed by anmarques
15s main
main
15s
change multimodal check in evaluate (#3013) Unit Tests #16: Commit e1a7a39 pushed by anmarques
5m 52s main
main
5m 52s
use np.NaN (#2937) Tasks Modified #15: Commit fc5019e pushed by anmarques
2m 3s main
main
2m 3s
use np.NaN (#2937) Unit Tests #15: Commit fc5019e pushed by anmarques
6m 1s main
main
6m 1s
Longbench bugfix (#2895) Unit Tests #14: Commit 930d837 pushed by anmarques
5m 40s main
main
5m 40s
Longbench bugfix (#2895) Tasks Modified #14: Commit 930d837 pushed by anmarques
1m 29s main
main
1m 29s
Add --samples Argument for Fine-Grained Task Evaluation in `lm-eva… Unit Tests #13: Commit d693dcd pushed by anmarques
4m 10s main
main
4m 10s
Add --samples Argument for Fine-Grained Task Evaluation in `lm-eva… Tasks Modified #13: Commit d693dcd pushed by anmarques
14s main
main
14s
Add GSM8K Platinum (#2771) Unit Tests #12: Commit 11ac352 pushed by anmarques
2m 47s main
main
2m 47s
Add GSM8K Platinum (#2771) Tasks Modified #12: Commit 11ac352 pushed by anmarques
11s main
main
11s
Add MMLU-ProX task (#2811) Unit Tests #11: Commit 8aeff14 pushed by anmarques
5m 4s main
main
5m 4s
Add MMLU-ProX task (#2811) Tasks Modified #11: Commit 8aeff14 pushed by anmarques
1m 36s main
main
1m 36s
Add INCLUDE tasks (#2769) Tasks Modified #10: Commit 6fbebb4 pushed by anmarques
21m 2s main
main
21m 2s
Add INCLUDE tasks (#2769) Unit Tests #10: Commit 6fbebb4 pushed by anmarques
5m 19s main
main
5m 19s
Add various social bias tasks (#1185) Tasks Modified #9: Commit 150a185 pushed by anmarques
2m 33s main
main
2m 33s
Add various social bias tasks (#1185) Unit Tests #9: Commit 150a185 pushed by anmarques
5m 22s main
main
5m 22s
Update evaluator.py (#2786) Tasks Modified #8: Commit 0f94477 pushed by anmarques
16s main
main
16s
Update evaluator.py (#2786) Unit Tests #8: Commit 0f94477 pushed by anmarques
4m 27s main
main
4m 27s
Fix max_tokens handling in vllm_vlms.py (#2637) Unit Tests #7: Commit 370e2f9 pushed by anmarques
7m 22s main
main
7m 22s