RLLM - #1232

Open

swarnaHub wants to merge 40 commits into

online_trainingfrom

swarna/skyworkv2

Commits on Jul 22, 2025

skywork and some qwrn changes
swarna
committed
6095032
Removing think tokens
swarna
committed
f3d876a
Merge branch 'ot_merge' into swarna/skyworkv2
swarnaHub
authored
d7e9fd0

Commits on Jul 23, 2025

Fixing GRMs
swarna
committed
164458b
Merge branch 'swarna/skyworkv2' of github.com:facebookresearch/fairseq2 into swarna/skyworkv2
swarna
committed
b162c05
Black
swarna
committed
4fc9aea

Commits on Jul 29, 2025

Merge branch online_training
swarna
committed
a6ad0a8
Import issue
swarna
committed
f829d82

Commits on Aug 6, 2025

add missing sw import
chenxwh user
committed
9392f0d

Commits on Aug 7, 2025

Different configs for pairwise GRM
swarna
committed
55dc622
Minor fix and more logging
swarna
committed
ee17161
Online dpo: pairwise GRM should sample at least two rollouts
swarna
committed
18ff4c4
zero reward for rollouts not involved in pairwise judgments
swarna
committed
585b744
simplifying
swarna
committed
510bdf2

Commits on Aug 9, 2025

SequenceBatch seq_lens type ensure to be a list
chenxwh user
committed
38aaf53

Commits on Aug 13, 2025

add pairwsie J1 with reference answer
chenxwh user
committed
a6ab8b0

Commits on Aug 18, 2025

fix None ref answer
chenxwh user
committed
2004533

Commits on Aug 19, 2025

Pairwise with pivot changes
swarna
committed
bfc255b

Commits on Aug 20, 2025

New pivot changes + cleanup
swarna
committed
1f942d7
Fix
swarna
committed
5eee4ee
Making pair type configurable
swarna
committed
5cdb6b9

Commits on Aug 21, 2025

Config change
swarna
committed
e14421d

Commits on Aug 24, 2025

update prompt
chenxwh user
committed
8831f36

Commits on Aug 27, 2025

some more logging
swarna
committed
9fc9dbb
Merge branch 'swarna/skyworkv2' of github.com:facebookresearch/fairseq2 into swarna/skyworkv2
swarna
committed
d14fb90
Fixing typo in comment
swarna
committed
b1ba0e2

Commits on Sep 2, 2025

kwise judgment support
swarna
committed
d47ef15

Commits on Sep 3, 2025

Adding support for acemath
swarna
committed
d474070

Commits on Sep 4, 2025

Skywork-RM from hf
swarna
committed
1162d60

Commits on Sep 6, 2025

add parsed ref
chenxwh user
committed
4ea811d

Commits on Sep 7, 2025

update prompt template
chenxwh user
committed
6703f1b

Commits on Sep 10, 2025

all comparisons in k-wise
chenxwh user
committed
fe84d9e

Commits on Sep 30, 2025

Jacklanchantin/qwen (#1260)
jacklanchantin
authored
e7137ac
octothinker assets
swarna
committed
dfb958a
Changes
swarna
committed
a746129
Merging
swarna
committed
1116f02

Commits on Oct 16, 2025

Minor changes
swarnadeep user
committed
9355ce6

Commits on Oct 22, 2025

Logging judge input
swarnadeep user
committed
474a537

Commits on Oct 29, 2025

Tracking a second reward (for debugging)
swarnadeep user
committed
8211664

Commits on Jan 2, 2026

Clean up and principia changes
swarnadeep user
committed
b9681ad