Crashing When Running Inference.py file

[rishabh-akridata]

Hi @gray311 @vlm-driver ,
Thanks for the amazing work. I am trying to run the inference.py file but it is crashing on both local and on gpu machine. Please let me know how can I solve this issue?

Thanks.

[rishabh-akridata]

@gray311 @vlm-driver. I found out that this is happening because the model is consuming too much compute both cuda memory and RAM memory. Is there any way to run this model in less compute?

Thanks