Skip to content

Release ltp-megatron-lm v0.0.5

Latest
Latest

Choose a tag to compare

View all tags
@yzygitzh yzygitzh released this 11 Jul 03:07
· 1 commit to release/v0.0.5 since this release
v0.0.5
9c0df79
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

ltp-megatron-lm v0.0.5 Release Notes

CI/CD

  1. Fix failures in tests/unit_tests/test_checkpointing.py (#51)
  2. Fix unit tests caused by torch.load API change (#59)
  3. Recover single-session tests (#64)
  4. Adjust enabled and disabled tests (#69)

Framework Features

MoE

  1. Fix all-reduce for global-batch load balancing loss (#68)
Assets 2
Loading