Skip to content

[GRPO] Multiply the KL term by the per-token importance sampling ratio - #7188

Open
Alexander230 wants to merge 1 commit into
huggingface:mainfrom
Alexander230:fix/6586-grpo-kl-bias-correction-seq-level
Open

[GRPO] Multiply the KL term by the per-token importance sampling ratio#7188
Alexander230 wants to merge 1 commit into
huggingface:mainfrom
Alexander230:fix/6586-grpo-kl-bias-correction-seq-level

Commits

Commits on Sep 11, 2026