Code

Support 4bit on CPU backend#1206

Code

Merged

Titus-von-Koeller merged 6 commits intobitsandbytes-foundation:multi-backend-refactorbitsandbytes-foundation/bitsandbytes:multi-backend-refactorfrom Xia-Weiwen:multi-backend-refactor-cpu-4bitXia-Weiwen/bitsandbytes:multi-backend-refactor-cpu-4bitCopy head branch name to clipboardMay 24, 2024

Commits

Commits on May 8, 2024

• Support NF4 on CPU backend

  Xia-Weiwen

  committed
  09cc153

  Copy full SHA for 09cc153

Commits on May 10, 2024

• Minor improvements

  Xia-Weiwen

  committed
  177bd39

  Copy full SHA for 177bd39

Commits on May 11, 2024

• Add fp4 support; add UT; fix lint issues

  Xia-Weiwen

  committed
  881b5fc

  Copy full SHA for 881b5fc

• Reduce memory usage

  Xia-Weiwen

  committed
  dd15734

  Copy full SHA for dd15734

• Fix UT

  Xia-Weiwen

  committed
  85a01b0

  Copy full SHA for 85a01b0

• reduce memory usage for nf4

  Xia-Weiwen

  committed
  2c489f8

  Copy full SHA for 2c489f8