Commit 2460770
authored
marin: port export/levanter_checkpoint.py to fray v2 (#4980)
🤖
## Summary
Ports `lib/marin/src/marin/export/levanter_checkpoint.py` from
`fray.v1.cluster.*` to `fray.v2`, mirroring the pattern in
`lib/marin/src/marin/evaluation/log_probs.py` (already on v2). Public
API — `ConvertCheckpointStepConfig`, `convert_checkpoint_to_hf`,
`convert_checkpoint_to_hf_step` — is unchanged.
This is Bucket 2 PR-B in the Ray-removal roadmap. Part of
[#4453](#4453).
## Why medium-risk
This file backs the Marin HF model-release pipeline
(`experiments/tootsie/exp_1246_upload_datasets.py` and
`experiments/tootsie/exp1984_convert_32b_phases.py`). The port preserves
every public-facing signature; only the job-submission internals change.
## Test plan
- [x] `./infra/pre-commit.py --all-files --fix` — green.
- [x] `uv run pyrefly` — no new errors vs `origin/main` baseline.
- [x] Import check: `marin.export` + both tootsie experiments import
cleanly.
- [x] Any `marin.export`-importing tests pass.
- [x] No `fray.v1` references remain under
`lib/marin/src/marin/export/`.1 parent a2f4a1a commit 2460770
1 file changed
Lines changed: 14 additions & 8 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
7 | 7 | | |
8 | 8 | | |
9 | 9 | | |
10 | | - | |
| 10 | + | |
| 11 | + | |
11 | 12 | | |
12 | 13 | | |
13 | | - | |
| 14 | + | |
14 | 15 | | |
15 | 16 | | |
16 | 17 | | |
17 | | - | |
| 18 | + | |
18 | 19 | | |
19 | 20 | | |
20 | 21 | | |
| |||
109 | 110 | | |
110 | 111 | | |
111 | 112 | | |
| 113 | + | |
| 114 | + | |
| 115 | + | |
| 116 | + | |
| 117 | + | |
| 118 | + | |
| 119 | + | |
112 | 120 | | |
113 | 121 | | |
114 | 122 | | |
115 | 123 | | |
116 | | - | |
| 124 | + | |
117 | 125 | | |
118 | | - | |
119 | | - | |
120 | | - | |
121 | | - | |
| 126 | + | |
| 127 | + | |
122 | 128 | | |
123 | 129 | | |
124 | 130 | | |
| |||
0 commit comments