[Feature] Why not just make a Linear layer?

[jaretburkett]

Rebuilding every model in C just seems like hitting a tiny noil with an enormous sledge hammer. Why not just make a simple linear layer that can replace the linear layers of other models like every other quantization method does?

[lmxyy]

As in our roadmap, we will try to modularize our 4-bit linear in the future release.