Skip to content
 
 

Latest commit

 

History

9,946 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 

Repository files navigation

Megatron Lite

This lite branch provides VERL users with a preview of Megatron Lite and its integration with VERL. Megatron Lite is under active upstream development, and mlite is the project's prototype name. The upstream plan is to merge validated features incrementally into the NVIDIA Megatron-LM dev branch and adopt the name Agent Compose (agent_compose) once feature parity is reached. This preview branch will track and synchronize compatible upstream updates throughout that transition.

This branch contains only the experimental Megatron Lite source tree.

Upstream on https://github.com/NVIDIA/Megatron-LM/tree/dev

About

Ongoing research training transformer models at scale

Resources

Stars

3 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages