Some corrections for Ubuntu #1170
MartinsRepo
started this conversation in
General
Replies: 1 comment
-
|
An installation on Windows 11 also failed: |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
(1) In the virtual conda environment should be installed python 3.9.
Instead of conda create -n textgen python=3.10.9 it should be
conda create -n textgen python=3..9
with this requirements.txt is resolved
(2) pip3 install torch torchvision torchaudio won't work, you should run in the conda environment:
conda install pytorch torchvision torchaudio pytorch-cuda=11.7 -c pytorch -c nvidia
(3) Running python server.py results in an error:
~/miniconda3/envs/textgen/lib/python3.9/site-packages/bitsandbytes/cextension.py:33: UserWarning: The installed version of bitsandbytes was compiled without GPU support. 8-bit optimizers, 8-bit multiplication, and GPU quantization are unavailable.
The error is using CPU libs ~/miniconda3/envs/textgen/lib/python3.9/site-packages/bitsandbytes/libbitsandbytes_cpu.so
This would mean a rebuild of https://github.com/TimDettmers/bitsandbytes
Beta Was this translation helpful? Give feedback.
All reactions