Skip to content

Pull requests: huggingface/lighteval

New pull request New
20 Open 194 Closed
20 Open 194 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Nanotron greedy_until() fix
#344 opened Oct 4, 2024 by vsabolcec Loading…
Serbian LLM Benchmark Task
#340 opened Oct 3, 2024 by DeanChugall Loading…
4
Misc-multilingual tasks
#339 opened Oct 2, 2024 by hynky1999 Loading…
refacto judge and add mixeval
#337 opened Sep 30, 2024 by NathanHB Loading…
3 tasks done
15
bump lighteval version
#328 opened Sep 24, 2024 by NathanHB Loading…
1
Add tools to doc and to prompt
#321 opened Sep 20, 2024 by srossi93 Loading…
2
Fix BLEURT evaluation errors
#316 opened Sep 16, 2024 by chuandudx Loading…
10
Selecting tasks using their superset
#308 opened Sep 14, 2024 by hynky1999 Loading…
12
Allow AdapterModels to have custom tokens
#306 opened Sep 14, 2024 by mapmeld Loading…
adding documentation
#282 opened Aug 28, 2024 by NathanHB • Draft
20
Adding chat completion task to endpoint models
#281 opened Aug 27, 2024 by sadra-barikbin Loading…
9
[FT] adding a logprob metric with varying contexts, not choices
#253 opened Aug 8, 2024 by clefourrier Loading…
15
Fix an issue in reproducibility in some cases
#251 opened Aug 2, 2024 by sadra-barikbin Loading…
1
Considering the case empty request list is given to base model
#250 opened Aug 2, 2024 by sadra-barikbin Loading…
10
Added option for specifying model config directly, for programmatic use
#245 opened Jul 29, 2024 by shaltielshmid Loading…
1
Keep target_for_fewshot_sorting for another purpose
#241 opened Jul 28, 2024 by sadra-barikbin Loading…
1
1
Adding OZ Eval task
#225 opened Jul 15, 2024 by Stopwolf Loading…
18
Tiny improvements to endpoint_model.py, base_model.py,...
#219 opened Jul 8, 2024 by sadra-barikbin Loading…
2
Nanotron tests
#160 opened Apr 19, 2024 by zzhhjjj Loading…
5
Add optimum model
#106 opened Mar 11, 2024 by echarlaix • Draft
ProTip! Exclude everything labeled bug with -label:bug.