Commit 416fec3
committed
docs: retire Ray launcher references; route to Iris
Sweep out `ray_run.py` / `scripts/ray/*` / `ray up` / `ray down` references
from user-facing docs, agent skills, runbooks, and experiment docstrings, in
preparation for the Ray cluster retirement (#4453). Replacements point at the
live Iris launcher pattern documented in `experiments/ferries/OPS.md`:
uv run iris --cluster=marin job run ...
Rewrites (preserve prior flags/run-selection semantics):
- docs/explanations/executor.md — Ray section rewritten as Fray/Iris
- docs/tutorials/train-an-lm.md, train-dpo.md — ray_run snippets → iris job run
- docs/recipes/add_scaling_heuristic.md — two ray_run commands → iris job run
- docs/tutorials/storage-bucket.md, local-gpu.md, first-experiment.md,
executor-101.md, installation.md — prose references → Iris/Fray
- docs/explanations/{evaluation,experiments,guidelines,marin-prefix}.md,
references/resource-config.md, harbor-integration.md — prose scrubs
- .agents/skills/ferries/SKILL.md — daily launch cmd + "Ray job id" labels
- .agents/skills/architecture/SKILL.md — entry point + infra references
- .agents/projects/ferry_framework.md — launch shape + run-record fields
- experiments/tootsie/BABYSITTING.md — five runbook snippets
(propose-then-handoff; review requested from dlwh/Helw150/rjpower)
- experiments/grug/README.md, experiments/README_sft.md
- experiments/ferries/daily.py — prose docstring
- experiments/tutorials/exp1077_reproduce_dclm_1b1x.py,
exp1078_reproduce_dclm_7b1x.py — docstring example
- experiments/rollout_data/*.py (7 files) — identical `Usage:` docstring
Deletions (docs describing soon-retired code):
- docs/dev-guide/rebuilding-cluster.md — entirely about `ray up`/
`scripts/ray/cluster.py` rebuild flow
- docs/tutorials/tpu-cluster-setup.md — whole tutorial is "ray up / ray submit /
ray dashboard"; removed from mkdocs.yml nav; installation.md link retargeted
at lib/iris/OPS.md
- lib/levanter/docs/design/Ray-Job-Manager.md — design doc for the Ray TPU
job manager (deleted in #5031)
- .agents/docs/fray-migration.md — past migration plan, superseded
Levanter `Getting-Started-TPU-VM.md`: removed the "Using the Ray Autoscaler"
section (launch_on_ray.py was deleted in #5031), kept `launch.py` guidance.
Scope is doc-only. Not touched in this commit: `scripts/ray/*`,
`lib/marin/src/marin/run/ray_run.py`, `infra/marin-*.yaml`,
`infra/README.md`'s "Maintaining a Ray Cluster" section, and Ray references
inside historical design/logbook docs (`.agents/projects/20251114_fray_design.md`,
`linear_ce_loss.md`). Those belong to other retirement stages.
Refs: #4453 (parent), #5029 (doc sweep tracker)1 parent 75d22e5 commit 416fec3
37 files changed
Lines changed: 175 additions & 794 deletions
File tree
- .agents
- docs
- projects
- skills
- architecture
- ferries
- docs
- dev-guide
- explanations
- recipes
- references
- tutorials
- experiments
- ferries
- grug
- rollout_data
- tootsie
- tutorials
- lib/levanter/docs
- design
This file was deleted.
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
150 | 150 | | |
151 | 151 | | |
152 | 152 | | |
153 | | - | |
| 153 | + | |
154 | 154 | | |
155 | 155 | | |
156 | 156 | | |
| |||
179 | 179 | | |
180 | 180 | | |
181 | 181 | | |
182 | | - | |
| 182 | + | |
183 | 183 | | |
184 | 184 | | |
185 | 185 | | |
| |||
274 | 274 | | |
275 | 275 | | |
276 | 276 | | |
277 | | - | |
278 | | - | |
279 | | - | |
280 | | - | |
| 277 | + | |
| 278 | + | |
281 | 279 | | |
282 | 280 | | |
283 | 281 | | |
| |||
344 | 342 | | |
345 | 343 | | |
346 | 344 | | |
347 | | - | |
| 345 | + | |
348 | 346 | | |
349 | 347 | | |
350 | 348 | | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
5 | 5 | | |
6 | 6 | | |
7 | 7 | | |
8 | | - | |
| 8 | + | |
9 | 9 | | |
10 | 10 | | |
11 | 11 | | |
12 | 12 | | |
13 | 13 | | |
14 | | - | |
| 14 | + | |
15 | 15 | | |
16 | | - | |
| 16 | + | |
17 | 17 | | |
18 | 18 | | |
19 | 19 | | |
| |||
24 | 24 | | |
25 | 25 | | |
26 | 26 | | |
27 | | - | |
| 27 | + | |
28 | 28 | | |
29 | 29 | | |
30 | 30 | | |
| |||
55 | 55 | | |
56 | 56 | | |
57 | 57 | | |
58 | | - | |
59 | | - | |
| 58 | + | |
| 59 | + | |
60 | 60 | | |
61 | 61 | | |
62 | 62 | | |
| |||
72 | 72 | | |
73 | 73 | | |
74 | 74 | | |
75 | | - | |
| 75 | + | |
76 | 76 | | |
77 | 77 | | |
78 | 78 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
39 | 39 | | |
40 | 40 | | |
41 | 41 | | |
42 | | - | |
| 42 | + | |
43 | 43 | | |
44 | 44 | | |
45 | 45 | | |
| |||
124 | 124 | | |
125 | 125 | | |
126 | 126 | | |
127 | | - | |
128 | | - | |
129 | | - | |
130 | | - | |
| 127 | + | |
| 128 | + | |
131 | 129 | | |
132 | 130 | | |
133 | 131 | | |
134 | | - | |
| 132 | + | |
135 | 133 | | |
136 | 134 | | |
137 | 135 | | |
138 | 136 | | |
139 | 137 | | |
140 | 138 | | |
141 | | - | |
142 | | - | |
143 | | - | |
144 | | - | |
145 | | - | |
| 139 | + | |
| 140 | + | |
| 141 | + | |
146 | 142 | | |
147 | 143 | | |
148 | 144 | | |
| |||
158 | 154 | | |
159 | 155 | | |
160 | 156 | | |
161 | | - | |
| 157 | + | |
162 | 158 | | |
163 | 159 | | |
164 | 160 | | |
| |||
174 | 170 | | |
175 | 171 | | |
176 | 172 | | |
177 | | - | |
| 173 | + | |
178 | 174 | | |
179 | 175 | | |
180 | 176 | | |
| |||
0 commit comments