Quantisation of the inputs

[nicolas-dufour]

Hey, wanted to ask, are you using precomputed quantized int8 VAE states?
I see you do it for T5 but not sure for VAE states?
If so have you seen any quality degradation?

Thanks!

[cloneofsimo]

The reason is rather funny. Only becase VAE were TINY compared to T5, it really didnt make sense to quantize it hahaha