[dpo] Add LoRA-DPO support to Levanter#4637

Open

ahmeda14960 wants to merge 3 commits intomainfrom

Commits on Apr 10, 2026

[dpo] Add LoRA-DPO support to Levanter

ahmeda14960
and
claude
committed
[dpo] Revert unrelated changes to uncheatable evals and models

ahmeda14960
and
claude
committed
[dpo] Revert unrelated change to launch.py

ahmeda14960
and
claude
committed