Skip to content

Add Q4_K/Q5_K/Q6_K GPU support via Q8_0 dequantization#108

Merged
orionpapadakis merged 2 commits into
beehive-lab:mainfrom
AdamBien:main
May 29, 2026
Merged

Add Q4_K/Q5_K/Q6_K GPU support via Q8_0 dequantization#108
orionpapadakis merged 2 commits into
beehive-lab:mainfrom
AdamBien:main

Commits

Commits on Apr 19, 2026