What are the requirements to run this model? Is there support for 4-bit or 8-bit quantization?
What are the requirements to run this model? Is there support for 4-bit or 8-bit quantization?