Skip to content

Pull requests: EleutherAI/gpt-neox

New pull request New
31 Open 821 Closed
31 Open 821 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Torch Run Launcher
#1388 opened Jun 2, 2026 by aflah02 Contributor Loading…
Eval Crash Fix
#1387 opened May 25, 2026 by aflah02 Contributor Loading…
Handle pkg_resources deprecation
#1386 opened May 19, 2026 by Quentin-Anthony Member Loading…
1
feat: add WSD (Warmup-Stable-Decay) learning rate scheduler
#1375 opened Feb 28, 2026 by Rakshitha-Ireddi Loading…
1
Bump pip from 23.3.2 to 26.0 in /requirements dependencies Pull requests that update a dependency file python Pull requests that update python code
#1369 opened Feb 3, 2026 by dependabot Bot Loading…
Default to only applying QK norm over the head dimension
#1367 opened Jan 6, 2026 by christianazinn Loading…
5
Update local_setup.yml
#1366 opened Nov 6, 2025 by dannyandchantellebailey-design Loading…
1
L1 Norm Logging for Activations
#1362 opened Jun 9, 2025 by Quentin-Anthony Member Loading…
Log from all ranks
#1361 opened Jun 9, 2025 by Quentin-Anthony Member Loading…
Add verbosity and refactor startup logging
#1359 opened Jun 9, 2025 by Quentin-Anthony Member Loading…
Add unit tests for dmoe, context parallelism, and muP
#1358 opened Jun 7, 2025 by Quentin-Anthony Member Loading…
fix bug in EvalHarnessAdapter when pipe parallel size is set to 1
#1356 opened Apr 26, 2025 by MarisaJH Loading…
1
4
Update Evaluation Logic to Latest lm_eval (0.4.8) and Support Automatic Benchmark Evals w/o Validation Set dependencies Pull requests that update a dependency file
#1348 opened Mar 21, 2025 by Kyle1668 Contributor Loading…
6
update deeperspeed version
#1333 opened Jan 29, 2025 by Quentin-Anthony Member • Draft
CUDA/Pytorch multiprocessing workaround and test fixes
#1304 opened Oct 14, 2024 by AI-WAIFU Contributor • Draft
pytest-forked alternative to get around CUDA/pytorch multiprocessing limitation
#1303 opened Oct 14, 2024 by AI-WAIFU Contributor • Draft
Add support for context parallelism
#1299 opened Oct 1, 2024 by bclyang Contributor Loading…
2
TE integration via full TransformerLayer
#1297 opened Sep 30, 2024 by tf-nv Contributor Loading…
4
Add initial ring flash attention support
#1266 opened Sep 4, 2024 by dmahan93 Contributor • Draft
1
Add tensor parallelism for RWKV
#1237 opened Jun 19, 2024 by jahatef Collaborator Loading…
10
Add lora support
#1225 opened May 20, 2024 by mkerin Contributor • Draft
Adding replay into GPT-NeoX
#1200 opened Apr 13, 2024 by AIproj Contributor Loading…
@AIproj
3
Added infinite lr schedules
#1194 opened Mar 25, 2024 by kshitijkg Contributor Loading…
Add DS inference
#1130 opened Jan 25, 2024 by yang Contributor • Draft
[muP] Rework
#1087 opened Dec 1, 2023 by lintangsutawika Contributor Loading…
@Quentin-Anthony
27
ProTip! Type g i on any issue or pull request to go back to the issue listing page.