OnnxTR & GPU

[mykolamelnykml]

How to enable to use GPU for OnnxTR?

[felixdittrich92]

Hi @kolia1985 👋;

Would be better to ask Onnx related things directly in https://github.com/felixdittrich92/OnnxTR/discussions :)

• first: You need to install CUDA be careful from my experience this needs to match exactly with the versions provided in Versions and your host machine (nvidia-smi / nvcc --version) - Unfortunately this part is a bit tricky (by onnxruntime)
• sec: Then you can install pip install "onnxtr[gpu]" and it should auto detect your GPU and prefer it

[mykolamelnykml]

Thank you