Skip to content

Pull requests: huggingface/trl

New pull request New
76 Open 1,482 Closed
76 Open 1,482 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

⏩ Train on completion only
#3329 opened Apr 20, 2025 by qgallouedec Loading…
5 tasks
1
🏁 Fix adding special tokens in SFT
#3328 opened Apr 20, 2025 by qgallouedec Loading…
1
3
🍡 Fix using reward model and DeepSpeed ZeRO 3
#3326 opened Apr 18, 2025 by qgallouedec Loading…
1
3
[GRPO] adds experimental support for the SSR replay buffer
#3325 opened Apr 18, 2025 by edbeeching • Draft
feat(draft): support base_url parameter for vLLM client initialization
#3324 opened Apr 18, 2025 by re-imagined • Draft
Add support for FSDP2
#3317 opened Apr 17, 2025 by lewtun Loading…
1 of 5 tasks
1
[doc] Update sft_trainer.md in table x->✓
#3313 opened Apr 17, 2025 by HERIUN Loading…
3 of 5 tasks
🗂️ Data Parallel for vLLM server
#3310 opened Apr 16, 2025 by qgallouedec Loading…
43
Define default chat template for SFT
#3309 opened Apr 16, 2025 by lewtun Loading…
5 tasks
1
Allow for saving the PPOTrainer value model (critic model)
#3308 opened Apr 16, 2025 by AMindToThink Loading…
[DPO] Model forward pass padding side fix
#3307 opened Apr 16, 2025 by LeonEricsson Loading…
2 of 5 tasks
1
Fix typo in text_environments.md
#3305 opened Apr 16, 2025 by sunjin-k Loading…
1 of 5 tasks
vllm-dp-support
#3303 opened Apr 16, 2025 by shirinyamani Loading…
5 tasks
3
PPO value_model can't be None, so it shouldn't be Optional
#3300 opened Apr 15, 2025 by AMindToThink Loading…
5
Fix unset tokenizer pad_token
#3290 opened Apr 14, 2025 by LeonEricsson Loading…
4 of 5 tasks
1
8
Modified GRPOTrainer to accumulate gradient within a single training batch
#3288 opened Apr 13, 2025 by jarrelscy Loading…
3 of 5 tasks
2
add vllm support for token ids as input
#3280 opened Apr 11, 2025 by wybryan Loading…
1
Reward takes completion ids
#3272 opened Apr 9, 2025 by qgallouedec • Draft
5 tasks
🦙 Llama 4
#3267 opened Apr 9, 2025 by qgallouedec • Draft
5 tasks
[NOT MEANT TO BE MERGED] Log correct/incorrect lengths
#3263 opened Apr 8, 2025 by qgallouedec • Draft
[SFT] support for ring_attn in SFTTrainer
#3262 opened Apr 8, 2025 by kashif Loading…
5 tasks
2
[🐯+GRPO] Support FSDP + Fix bug when using LigerGRPO with DDP
#3260 opened Apr 8, 2025 by shivam15s Loading…
1 of 5 tasks
@kashif
5
Add a raw generate API to the vLLM server
#3227 opened Apr 3, 2025 by wilrop Loading…
5 tasks
4
Support iterable datasets in GRPO
#3226 opened Apr 3, 2025 by wilrop Loading…
5 tasks
1
8
feat(trainer): Support multi-role & consecutive turns in DataCollatorForCompletionOnlyLM (#3223)
#3224 opened Apr 3, 2025 by Kirili4ik Loading…
4 tasks done
1
ProTip! Exclude everything labeled bug with -label:bug.