I initially tried to get this running with CUDA on my rack server which has a Quadro P2200 - but it would always fail with a device error (this was with the latest CUDA driver).
I'm now trying this on Windows/docker and It seems that the RTX 5000 series might be too new for the version of torch this project is set up to use my 5080.
[UltraSinger] ********************************
[UltraSinger] UltraSinger Version: 0.0.13-dev8
[UltraSinger] ********************************
[UltraSinger] Checking GPU support.
/app/UltraSinger/.venv/lib/python3.10/site-packages/torch/cuda/__init__.py:209: UserWarning:
NVIDIA GeForce RTX 5080 with CUDA capability sm_120 is not compatible with the current PyTorch installation.
The current PyTorch install supports CUDA capabilities sm_50 sm_60 sm_70 sm_75 sm_80 sm_86 sm_90.
If you want to use the NVIDIA GeForce RTX 5080 GPU with PyTorch, please check the instructions at https://pytorch.org/get-started/locally/
Are there any ways forward with this? Or do I have to live with CPU evaluation :(