Search results

Type hint problem in formatting_func argument in SFTTrainer

🏋 SFTRelated to SFTRelated to SFT

🐛 bugSomething isn't workingSomething isn't working

Status: Open.

#3583 In huggingface/trl;

· MaiqiVerse opened on Jun 13, 2025

FSDP 2 + DPO Error: 'MixedPrecisionPolicy' object has no attribute '_module_classes_to_ignore'

🏋 DPORelated to DPORelated to DPO

🐛 bugSomething isn't workingSomething isn't working

Status: Open.

#3581 In huggingface/trl;

· JVP15 opened on Jun 13, 2025

Clarification on default data collator for SFTTrainer

❓ questionSeeking clarification or more informationSeeking clarification or more information

🏋 SFTRelated to SFTRelated to SFT

Status: Open.

#3580 In huggingface/trl;

· jiosephlee opened on Jun 13, 2025

PPO dataset formatter : why transformers to tokenizerd input ids in official ppo scripts demo?

❓ questionSeeking clarification or more informationSeeking clarification or more information

🏋 PPORelated to PPORelated to PPO

Status: Open.

#3579 In huggingface/trl;

· caoyang-sufe opened on Jun 13, 2025

GRPOTrainer Is Extremely Slow on Small Dataset (5MB)

❓ questionSeeking clarification or more informationSeeking clarification or more information

🏋 GRPORelated to GRPORelated to GRPO

🐛 bugSomething isn't workingSomething isn't working

Status: Open.

#3574 In huggingface/trl;

· zahraajamali opened on Jun 12, 2025

[GRPO] Entropy metric

Status: Open.

#3571 In huggingface/trl;

· LeonEricsson opened on Jun 12, 2025

TRL GRPOtrainer truncation problem: The decoder prompt (length 3353) is longer than the maximum model length of 2560.

⚡ PEFTRelated to PEFTRelated to PEFT

🏋 GRPORelated to GRPORelated to GRPO

🐛 bugSomething isn't workingSomething isn't working

Status: Open.

#3569 In huggingface/trl;

· aladinggit opened on Jun 11, 2025

GRPO per_device_eval_batch_size can't be set as 1, when there is only 1 GPU

✨ enhancementNew feature or requestNew feature or request

🏋 GRPORelated to GRPORelated to GRPO

🐛 bugSomething isn't workingSomething isn't working

Status: Open.

#3566 In huggingface/trl;

· CasanovaLLL opened on Jun 11, 2025

function call initialization failed, code from https://github.com/huggingface/trl/pull/2455#issue-2729366606

🐛 bugSomething isn't workingSomething isn't working

Status: Open.

#3564 In huggingface/trl;

· summerrain321 opened on Jun 10, 2025

add generation_kwargs to <code>GRPOTrainer</code>, so people have more control when training

✨ enhancementNew feature or requestNew feature or request

🏋 GRPORelated to GRPORelated to GRPO

Status: Open.

#3562 In huggingface/trl;

· avishaiElmakies opened on Jun 10, 2025

GRPOTrainer: Parallelism for updating named params

✨ enhancementNew feature or requestNew feature or request

🏋 GRPORelated to GRPORelated to GRPO

Status: Open.

#3557 In huggingface/trl;

· dhruvmullick opened on Jun 10, 2025

Question about the k3 KL estimator implementation

❓ questionSeeking clarification or more informationSeeking clarification or more information

🏋 PPORelated to PPORelated to PPO

Status: Open.

#3556 In huggingface/trl;

· ZhangShiyue opened on Jun 9, 2025