For those having issues... have you tried turning it off and turning it back on again?

[ParkerrDev]

In all seriousness, I encourage those having setup issues on Linux or any other OS to reboot your system after installing dependencies, as I've spent hours trying to get this to work with no luck, until having realized this.

A few other tips if you're on Fedora Linux:

Installing NVIDIA & CUDA Drivers:

sudo dnf install akmod-nvidia "kernel-devel-uname-r == $(uname -r)"

sudo dnf install *xorg-x11-drv-nvidia-cuda

reboot

Check if CUDA drivers are installed:

nvidia-smi | grep CUDA #If this does not return anything, it didn't work

Proceed with Tortoise-TTS installation:

conda create --name tortoise python=3.9 numba inflect
conda activate tortoise
conda install pytorch torchvision torchaudio pytorch-cuda=11.8 -c pytorch -c nvidia
conda install transformers=4.29.2
cd ~ && git clone https://github.com/neonbjb/tortoise-tts.git
cd tortoise-tts
python setup.py install
reboot