Skip to content

v0.4.5

Choose a tag to compare

View all tags
@mobicham mobicham released this 06 May 07:40
· 351 commits to master since this release
0.4.5
5f88f7b
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
  • Update caches for 48GB gpus (Qwen2 VL/Llama3 8B)
  • Add cpu-side packing
  • Relax min size to 32
  • fp16 acc fix
  • add persistent SPLIT_K version
  • fix tl.contiguous hint
  • make m,n block sizes safe
  • add BitNet support in helper
  • add custom load_state_dict to allow weight serialization
  • Update swizzle
Assets 2
Loading