Search results

LLVM error during GRPO training with Apple M4 Max

🏋 GRPORelated to GRPORelated to GRPO

🐛 bugSomething isn't workingSomething isn't working

Status: Open.

#4692 In huggingface/trl;

· neslihaneti opened on Dec 14, 2025

[SFT] High vRAM consumption during eval loop

⚡ PEFTRelated to PEFTRelated to PEFT

🏋 SFTRelated to SFTRelated to SFT

🐛 bugSomething isn't workingSomething isn't working

Status: Open.

#4679 In huggingface/trl;

· Khreas opened on Dec 11, 2025

[GRPO] evaluation at start fails, due to missing current_gradient_accumulation_step

🏋 GRPORelated to GRPORelated to GRPO

🐛 bugSomething isn't workingSomething isn't working

Status: Open.

#4669 In huggingface/trl;

· SonuDixit opened on Dec 11, 2025

CI fails with dev dependencies: AssertionError

🐛 bugSomething isn't workingSomething isn't working

Status: Open.

Bug

#4658 In huggingface/trl;

· albertvillanova opened on Dec 10, 2025

GRPOTrainer and bnb quantization configs are incomptiable

🏋 GRPORelated to GRPORelated to GRPO

🐛 bugSomething isn't workingSomething isn't working

Status: Open.

#4634 In huggingface/trl;

· JitheshPavan opened on Dec 6, 2025

[Bug] DeepSpeed ZeRO-2 is unstable with GRPOTrainer using Qwen3-VL MoE

Status: Open.

#4631 In huggingface/trl;

· casper-hansen opened on Dec 5, 2025

VLLM deprecated GuidedDecodingParams -> StructuredOutputsParams

🏋 GRPORelated to GRPORelated to GRPO

🐛 bugSomething isn't workingSomething isn't working

🧒 good second issueGood for contributors with basic project familiarityGood for contributors with basic project familiarity

Status: Open.

#4617 In huggingface/trl;

· ed-pai opened on Dec 4, 2025

GRPOTrainer: liger_kernel loss implementation ignores PEFT/LoRA adapters on lm_head

⚡ PEFTRelated to PEFTRelated to PEFT

🏋 GRPORelated to GRPORelated to GRPO

🐛 bugSomething isn't workingSomething isn't working

Status: Open.

#4612 In huggingface/trl;

· junho328 opened on Dec 3, 2025

SFTTrainer: Logging Experts Statistics

⚡ PEFTRelated to PEFTRelated to PEFT

✨ enhancementNew feature or requestNew feature or request

🏋 SFTRelated to SFTRelated to SFT

Status: Open.

#4611 In huggingface/trl;

· shon-otmazgin opened on Dec 2, 2025

AttributeError: Qwen2Tokenizer has no attribute response_schema

🐛 bugSomething isn't workingSomething isn't working

Status: Open.

#4609 In huggingface/trl;

· albertvillanova opened on Dec 2, 2025

openai-compatible responses and chat completions endpoints in vllm_serve.py

✨ enhancementNew feature or requestNew feature or request

Status: Open.

#4602 In huggingface/trl;

· cmunley1 opened on Nov 29, 2025

CI fails with dev dependencies: AttributeError: 'Qwen2_5_VLForConditionalGeneration' object has no attribute 'language_model'

🏋 GRPORelated to GRPORelated to GRPO

🐛 bugSomething isn't workingSomething isn't working

Status: Open.

#4601 In huggingface/trl;

· albertvillanova opened on Nov 28, 2025