Search results

Issue with Quantized Inference on Mistral-7B v0.1

Status: Open.

#10 In SqueezeBits/QUICK;

· acousticsmh opened on Nov 8, 2024

why does de-quantization introduce bank conflict?

Status: Open.

#9 In SqueezeBits/QUICK;

· sleepwalker2017 opened on May 16, 2024

kernel speed compare base on Llama7b

Status: Open.

#8 In SqueezeBits/QUICK;

· shiqingzhangCSU opened on Mar 4, 2024

Kernel benchmarks script

Status: Open.

#7 In SqueezeBits/QUICK;

· shiqingzhangCSU opened on Mar 4, 2024

ModuleNotFoundError: No module named 'quick'

Status: Open.

#5 In SqueezeBits/QUICK;

· Quang-elec44 opened on Feb 28, 2024

marlin 커널 과의 속도 비교

Status: Open.

#2 In SqueezeBits/QUICK;

· qwopqwop200 opened on Feb 19, 2024