Skip to content

Add Q4_K/Q5_K/Q6_K GPU support via Q8_0 dequantization #37

Add Q4_K/Q5_K/Q6_K GPU support via Q8_0 dequantization

Add Q4_K/Q5_K/Q6_K GPU support via Q8_0 dequantization #37

Job log options

This job was skipped