Skip to content

Pull requests: allenai/OLMo-core

New pull request New
46 Open 467 Closed
46 Open 467 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Add a model ladder for "more norms" and other internal ladder improvements
#535 opened Jan 6, 2026 by epwalsh Loading…
9
Add Gemma 3 support with HF weight conversion
#534 opened Jan 5, 2026 by finbarrtimbers Loading…
4 tasks done
12
Add Qwen3 model support (0.6B-32B)
#533 opened Jan 5, 2026 by finbarrtimbers • Draft
4 tasks done
Tyler/anejs/linear rnns
#530 opened Jan 1, 2026 by tyler-romero • Draft
Support for Muon and Dion Optimizers
#528 opened Dec 30, 2025 by tyler-romero Loading…
20
Anejs/linear rnns
#506 opened Dec 17, 2025 by tyler-romero • Draft
Add a Llama-like 7B training script for data ablations
#505 opened Dec 16, 2025 by epwalsh Loading…
1
Add DataMixtureMonitorCallback for per-source data mixture metrics
#501 opened Dec 15, 2025 by DivijChawla Loading…
Use MixedPrecision config for DDP
#489 opened Dec 1, 2025 by tyler-romero • Draft
Add --print-shape debug flag for logits shape debugging
#483 opened Nov 29, 2025 by computerologykj-maker Loading…
6
2B config
#470 opened Nov 20, 2025 by dirkgr • Draft
3
[WIP] nsys profiler integration
#463 opened Nov 17, 2025 by tyler-romero • Draft
Tyler/olmoe dev v2 fork
#462 opened Nov 17, 2025 by tyler-romero • Draft
Jacobm flex olmo sft
#461 opened Nov 16, 2025 by jacob-morrison • Draft
Kevinf/gradient dumper
#438 opened Oct 30, 2025 by farhatkevin Loading…
22
[WIP] Add support for parametrizations like muP
#436 opened Oct 29, 2025 by 2015aroras • Draft
@dirkgr @epwalsh
olmo3-32b midtraining
#433 opened Oct 24, 2025 by aetting Loading…
33
Adds a gradient dumper callback, and a script that uses it.
#432 opened Oct 24, 2025 by dirkgr • Draft
Flex Attention support with sinks
#417 opened Oct 9, 2025 by aman-17 Loading…
6
bnb style adamw implemenation (better numerical properties)
#385 opened Sep 23, 2025 by tyler-romero • Draft
3
Optionally don't load optimizer state
#367 opened Sep 11, 2025 by dirkgr Loading…
3
OLMo 2.5 1B
#358 opened Aug 30, 2025 by dirkgr Loading…
1
Add option to greedily pack documents with the padded FSL dataset
#346 opened Aug 15, 2025 by epwalsh Loading…
1
MuP partial implementation
#339 opened Aug 7, 2025 by 2015aroras • Draft
Benjaminm/tok
#336 opened Aug 5, 2025 by tyler-romero • Draft
ProTip! Filter pull requests by the default branch with base:main.