Skip to content

Pretrain release

Choose a tag to compare

View all tags
@openconstruct openconstruct released this 03 Aug 17:02
· 1 commit to main since this release
0.25
1fe3d1e
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

The model had only trained on about 5B tokens at this point, not very close to done, but I thought it would be fun to release

Assets 3
Loading