Is it possible that use candle library without CUDA? #2270
-
|
I've recently been using the candle library for text generation. The model files I used were from here: Later, I added I looked into Currently, I am stuck here. I'm hesitant to try installing the Display driver from CUDA because I'm worried it might conflict with my AMD GPU. |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
|
Solved, that's my mistake, I accidently turned on |
Beta Was this translation helpful? Give feedback.
Solved, that's my mistake, I accidently turned on
flash_attn.When I turned it off, everything is fine.