-
Notifications
You must be signed in to change notification settings - Fork 3k
Pull requests: huggingface/trl
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
Bump the "github-actions-and-pre-commit" group with 2 updates across multiple ecosystems
dependencies
Pull requests that update a dependency file
github_actions
Pull requests that update GitHub Actions code
#7192
opened Sep 12, 2026 by
dependabot
Bot
Loading…
docs: fix the clip explanation in the GRPO trainer page
#7190
opened Sep 12, 2026 by
JiangLLM
Loading…
4 of 8 tasks
[GRPO] Multiply the KL term by the per-token importance sampling ratio
#7188
opened Sep 11, 2026 by
Alexander230
Loading…
4 of 6 tasks
Train the tiny DeepSeek-R1-Distill model in the SFT test
#7187
opened Sep 11, 2026 by
albertvillanova
Member
Loading…
Retire three tiny model generators with no test consumer
#7186
opened Sep 11, 2026 by
albertvillanova
Member
Loading…
Use the canonical id for the tiny GPTNeoX sequence classification model
#7185
opened Sep 11, 2026 by
albertvillanova
Member
Loading…
Move the latest release tests from T4 to L40S
#7184
opened Sep 11, 2026 by
albertvillanova
Member
Loading…
Drop the Slack action checkout workaround from the latest release tests
#7183
opened Sep 11, 2026 by
albertvillanova
Member
Loading…
[Exploratory] Drop
accelerate launch: the CLI, docs and examples launch with torchrun
#7180
opened Sep 10, 2026 by
qgallouedec
Member
•
Draft
Remove outdated "under construction" banners from docs
#7177
opened Sep 10, 2026 by
qgallouedec
Member
Loading…
AsyncGRPO: cancel stale in-flight rollouts and survive generation fai…
#7176
opened Sep 10, 2026 by
AmineDiro
Member
Loading…
[AsyncGRPO] Run sync tools on a thread pool and support async tools
#7175
opened Sep 10, 2026 by
AmineDiro
Member
Loading…
Key the doc build concurrency group on the pull request number
#7174
opened Sep 10, 2026 by
albertvillanova
Member
Loading…
Section the auto-generated release notes by label
#7166
opened Sep 10, 2026 by
albertvillanova
Member
Loading…
2 tasks
Publish to PyPI on tag push and guard VERSION against the tag
#7165
opened Sep 10, 2026 by
albertvillanova
Member
Loading…
fix: validate fractions in get_dataset to prevent ZeroDivisionError
#7164
opened Sep 10, 2026 by
CJstate
Loading…
5 of 6 tasks
Reject use_liger_kernel in GMPOTrainer
#7163
opened Sep 10, 2026 by
YeonwooSung
Contributor
Loading…
5 of 8 tasks
Restore generation unwrap state if generate() raises
#7162
opened Sep 10, 2026 by
YeonwooSung
Contributor
Loading…
4 of 8 tasks
Fail fast when GRPO combines Liger with the MoE auxiliary loss
#7161
opened Sep 10, 2026 by
YeonwooSung
Contributor
Loading…
4 of 8 tasks
feat(grpo): add compute_metrics support to GRPOTrainer
#7144
opened Sep 9, 2026 by
behroozazarkhalili
Collaborator
Loading…
4 of 5 tasks
feat: add activation_offloading to GRPOTrainer and RLOOTrainer
#7143
opened Sep 9, 2026 by
behroozazarkhalili
Collaborator
Loading…
4 of 5 tasks
fix: validate dataset mixture fractions before loading
#7142
opened Sep 9, 2026 by
behroozazarkhalili
Collaborator
Loading…
4 of 5 tasks
fix: score think_format_reward when <think> is prefilled in the prompt
#7141
opened Sep 9, 2026 by
behroozazarkhalili
Collaborator
Loading…
4 of 5 tasks
Previous Next
ProTip!
Exclude everything labeled
bug with -label:bug.