[dpo] Revive LoRA-DPO on canonical train_dpo#4634

Open

ahmeda14960 wants to merge 83 commits intomainfrom

Commits on Jan 22, 2026

dpo init
ahmeda14960
committed

Commits on Jan 24, 2026

Commits on Jan 31, 2026

Commits on Feb 5, 2026

Commits on Feb 9, 2026

Add LoRA-DPO training: single-copy DPO via implicit reference model

ahmeda14960
and
claude
committed
Add temporary test config for 70B LoRA-DPO with tensor parallelism

ahmeda14960
and
claude
committed
Merge remote-tracking branch 'origin/main' into dpo_lora
ahmeda14960
committed

Commits on Feb 13, 2026

Commits on Mar 12, 2026

Commits on Mar 25, 2026

Merge remote-tracking branch 'origin/main' into dpo_lora
ahmeda14960
committed

Commits on Mar 29, 2026

Unify DPO and LoRA DPO training
ahmeda14960
committed

Commits on Mar 30, 2026

Improve DPO eval tooling and configs
ahmeda14960
committed

Commits on Apr 6, 2026

[dpo] Add comparison runs and W&B tag repair
ahmeda14960
committed

Commits on Apr 10, 2026

Commits on Apr 12, 2026

Merge remote-tracking branch 'origin/main' into dpo-lora
ahmeda14960
committed

Commits on Apr 13, 2026