Skip to content

Pull requests: huggingface/trl

New pull request New
70 Open 1,373 Closed
70 Open 1,373 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

add cli dict parsing for grpo_config
#3082 opened Mar 14, 2025 by Tavish9 Loading…
2 of 5 tasks
Flexible_reward
#3079 opened Mar 13, 2025 by shirinyamani Loading…
2 of 5 tasks
12
🕊️ Padding-free for SFT
#3076 opened Mar 13, 2025 by qgallouedec Loading…
5 tasks
1
[GRPO] add vlm training capabilities to the trainer
#3072 opened Mar 13, 2025 by CompN3rd Loading…
3 of 5 tasks
5
Fix: Multi gpu hang for ORPO and CPO Trainer
#3069 opened Mar 13, 2025 by NanoCode012 Loading…
1 of 5 tasks
1
2
[WIP] PEFT 🤝 Liger DPO
#3065 opened Mar 12, 2025 by SalmanMohammadi • Draft
5 tasks
1
Static cache GRPO
#3023 opened Mar 7, 2025 by qgallouedec • Draft
5 tasks
1
[WIP] Iterative training scripts for SPIN and SPPO
#3011 opened Mar 5, 2025 by jkx19 • Draft
3 of 5 tasks
Fast packing and truncation
#3009 opened Mar 4, 2025 by mariosasko Loading…
3 of 5 tasks
6
Fixing GRPO reward_func being a model with DeepSpeed ZeRO-3
#2984 opened Feb 28, 2025 by jamesbraza Loading…
4
Feature: Add SGLang as inference backend for generation in GRPO
#2981 opened Feb 28, 2025 by jhinpan Loading…
5 tasks done
30
Support ReMax Algorithm
#2955 opened Feb 25, 2025 by liziniu Loading…
3 tasks done
7
[Models] Activation checkpointing from TrorchTune
#2954 opened Feb 25, 2025 by kashif • Draft
11
Agents
#2936 opened Feb 23, 2025 by August-murr Loading…
27
Provide more accurate error messages to make the program more robust.
#2932 opened Feb 22, 2025 by dignfei Loading…
4 tasks
3
Add the metrics completion_length_max and completion_length_min
#2930 opened Feb 22, 2025 by dignfei Loading…
4 tasks
4
Supporting multi-vLLM inference for GRPO
#2929 opened Feb 22, 2025 by ghrua Loading…
2 of 5 tasks
10
Liger GRPO support
#2926 opened Feb 21, 2025 by SalmanMohammadi • Draft
4 tasks
2
Remove CUDA synchronization in mean_token_accuracy
#2902 opened Feb 19, 2025 by cyyever Loading…
1 task done
5
GRPOTrainer adds support for OpenAI API-compatible servers to models that generate samples
#2901 opened Feb 19, 2025 by ZYM66 • Draft
2 of 5 tasks
6
[Discussion] Agentic Framework Based on VLLM and E2B for RL
#2880 opened Feb 17, 2025 by August-murr • Draft
1
[GRPO] Reduce steps where loss starts to remain at 0, accelerate training
#2869 opened Feb 15, 2025 by zhangsheng377 Loading…
4
BCOTrainer version upgrade fixes
#2867 opened Feb 15, 2025 by claralp Loading…
3 of 5 tasks
6
Using model_wrapped can improve the generation speed by approximately 10 times on a single GPU.
#2859 opened Feb 14, 2025 by dignfei Loading…
2
[Liger] Liger KTO support
#2812 opened Feb 10, 2025 by vaibhavjindal Loading…
3 of 5 tasks
3
ProTip! Adding no:label will show everything without a label.