Installing on WSL2 with RTX 5090

[dcgsteve]

Just in case it helps anybody!

Followed Nvidia website to install latest CUDA 13 (https://developer.nvidia.com/cuda-downloads?target_os=Linux&target_arch=x86_64&Distribution=WSL-Ubuntu&target_version=2.0&target_type=deb_local)

wget https://developer.download.nvidia.com/compute/cuda/repos/wsl-ubuntu/x86_64/cuda-wsl-ubuntu.pin
sudo mv cuda-wsl-ubuntu.pin /etc/apt/preferences.d/cuda-repository-pin-600
wget https://developer.download.nvidia.com/compute/cuda/13.0.1/local_installers/cuda-repo-wsl-ubuntu-13-0-local_13.0.1-1_amd64.deb
sudo dpkg -i cuda-repo-wsl-ubuntu-13-0-local_13.0.1-1_amd64.deb
sudo cp /var/cuda-repo-wsl-ubuntu-13-0-local/cuda-*-keyring.gpg /usr/share/keyrings/
sudo apt-get update
sudo apt-get -y install cuda-toolkit-13-0

Used ENVs to force install to use right CUDA version:

export CUDA_PATH=/usr/local/cuda-13.0
export CUDACXX=/usr/local/cuda-13.0/bin/nvcc
export CMAKE_CUDA_COMPILER=/usr/local/cuda-13.0/bin/nvcc
export CUDA_ARCHITECTURES="100"
export CMAKE_CUDA_ARCHITECTURES="100"
cargo install --git https://github.com/Michael-A-Kuykendall/shimmy --features huggingface --features llama-cuda

🖥️ GPU Backend Information

🔧 llama.cpp Backend: CUDA
📋 Available GPU Features:
✅ CUDA support enabled

[Michael-A-Kuykendall]

Great info!