Question regarding CUDA 11.7 support #4355
geroldmanders
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
Seems that till build 0.30, there were always 2 CUDA builds, one for 11.7 and one for 12.x.
In build 0.31 there is only the CUDA 12.x build.
Now I have an older NVidia GFX 1650 (4 GB VRAM) card and am self-hosting tabby on that machine. Even though the models I can use are small, it is a pleasure to use tabby.
To my knowledge my card does not support CUDA 12.x, meaning that I cannot upgrade to Tabby version 0.31. May I ask what is the reasoning (for dropping 11.7)?
Beta Was this translation helpful? Give feedback.
All reactions