Skip to content

Clarify Speedrun starter discovery for new contributors#6269

Open
esaran1 wants to merge 1 commit into
marin-community:mainfrom
esaran1:evan-docs-speedrun-template-clarity
Open

Clarify Speedrun starter discovery for new contributors#6269
esaran1 wants to merge 1 commit into
marin-community:mainfrom
esaran1:evan-docs-speedrun-template-clarity

Conversation

@esaran1

@esaran1 esaran1 commented Jun 7, 2026

Copy link
Copy Markdown

Speedrun onboarding_setup.sh referenced a missing hackable starter template and
a broken submitting-speedrun doc link. Fall back to train_125m_fineweb_edu_gpu.py,
document --dry_run true, and note that the script requires a GPU (not Mac).

@esaran1 esaran1 force-pushed the evan-docs-speedrun-template-clarity branch from a2e3f8f to e66ad42 Compare June 7, 2026 20:43
@dlwh

dlwh commented Jun 8, 2026

Copy link
Copy Markdown
Member

Hi @esaran1 we're kinda moving away from speedrun for now and toward the agent-moe experiemnt gates for most things. What are you most interested in speedrun?

@dlwh

dlwh commented Jun 8, 2026

Copy link
Copy Markdown
Member

(I recognize we should clarify this!)

@esaran1

esaran1 commented Jun 8, 2026

Copy link
Copy Markdown
Author

Thanks for the context.

I hit the broken speedrun onboarding path while trying to get started as a new
contributor (missing hackable_transformer_starter_template.py). This PR is
mostly meant to unblock that discovery issue, not to push a specific speedrun
leaderboard submission yet.

My underlying interest is compute-efficient LM training: reproduce a clean
baseline, then test controlled training-recipe changes (LR schedule, AdamW
settings) with fair BPB/FLOP comparisons before scaling. I started with
speedrun because that was the public onboarding direction, but I'm happy to
align with the current canonical path if that's Grug/MoE gates now.

Could you point me to the recommended entry point for a new contributor today?
(e.g. experiments/grug/base or the moe gate workflow). I'm on Mac for dev and have HPC access.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants