Jacklanchantin/verifiable nonverifiable - #1173

Draft

jacklanchantin wants to merge 35 commits into

online_trainingfrom

jacklanchantin/verifiable_nonverifiable

Commits on May 2, 2025

change var name
jacklanchantin
committed
18dace7

Commits on May 3, 2025

check if self._step_nr exists when syncing (#1160)
jacklanchantin
committed
c6fc816

Commits on May 6, 2025

force_sync bug fix
jacklanchantin
committed
7df6271

Commits on May 9, 2025

2 verifiers
jacklanchantin
committed
c27b822
brute force vllm reward synchronization
jacklanchantin
committed
e22fbed
working ckpt
jacklanchantin
committed
fcb6755
reward mapper
jacklanchantin
committed
76c6775
superclass
jacklanchantin
committed
0c9d658
change class
jacklanchantin
committed
cc0d6b1
Merge branch 'online_training' of github.com:facebookresearch/fairseq2 into jacklanchantin/verifiable_nonverifiable
jacklanchantin
committed
da29581
cleanup
jacklanchantin
committed
a63bbd4
cleanup
jacklanchantin
committed
5db1f99
reorder
jacklanchantin
committed
d135ee5
log
jacklanchantin
committed
dc72481
separate val logging
jacklanchantin
committed
52563e9
Merge branch 'jacklanchantin/normalized_rewards' of github.com:facebookresearch/fairseq2 into jacklanchantin/verifiable_nonverifiable
jacklanchantin
committed
4e425c9
log tasks during training
jacklanchantin
committed
31200d3

Commits on May 10, 2025

bug
jacklanchantin
committed
c7328a8
comm sleep
jacklanchantin
committed
74a4f85
new ray.get method for reward model
jacklanchantin
committed
fbf29f0

Commits on May 12, 2025

mult rewards
jacklanchantin
committed
5aad554
comment
jacklanchantin
committed
754fd82
remove math tokenizer/wrapper
jacklanchantin
committed
dabea7a
log
jacklanchantin
committed
9fe1a89
logs
jacklanchantin
committed
59cf67b
force athene verifier if batch mismatch
jacklanchantin
committed
e6debd5

Commits on May 20, 2025

neurips checkpoint
jacklanchantin
committed
1a9ea63

Commits on May 21, 2025

merge
jacklanchantin
committed
49c31c2

Commits on May 27, 2025

merge
jacklanchantin
committed
e6d2146

Commits on Jun 4, 2025

merge
jacklanchantin
committed
a790b85
typo
jacklanchantin
committed
ee71556
merge fixes
jacklanchantin
committed
924a02e

Commits on Jun 6, 2025

Merge branch 'online_training' of github.com:facebookresearch/fairseq2 into jacklanchantin/verifiable_nonverifiable
jacklanchantin
committed
0a1d1d4

Commits on Jun 10, 2025

Merge branch 'online_training' of github.com:facebookresearch/fairseq2 into jacklanchantin/verifiable_nonverifiable
jacklanchantin
committed
df7325f

Commits on Jun 27, 2025

cant throw error for mixed tasks yet
jacklanchantin
committed
692f79a