How did you quantize the model?

I have been trying to use other kernels with this implementation but none of them load the state dict without mismatch. I don't know if marlin AWQ is special, but in any case, it would be nice to know how to quantize models. Even with this implementation we don't have schnell.

Please post a quanting script or give some hints.