Is it necessary to do the quantization on edge device #295
Description
Hi I want to deploy NVILA-AWQ on Jetson Orin AGX, I wonder do I have to do the quantization on Jetson device or I can just quantize the model on a ubuntu server.
{{ message }}
Hi I want to deploy NVILA-AWQ on Jetson Orin AGX, I wonder do I have to do the quantization on Jetson device or I can just quantize the model on a ubuntu server.