Skip to content

Add Q4_K/Q5_K/Q6_K GPU support via Q8_0 dequantization#108

Merged
orionpapadakis merged 2 commits into
beehive-lab:mainfrom
AdamBien:main
May 29, 2026
Merged

Add Q4_K/Q5_K/Q6_K GPU support via Q8_0 dequantization#108
orionpapadakis merged 2 commits into
beehive-lab:mainfrom
AdamBien:main

support for Q4 quantization added

58f7e2a
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 warning
code-quality
succeeded Apr 19, 2026 in 15s