Quantization #1079
d3ztr0yur3000
started this conversation in
Ideas
Quantization
#1079
Replies: 1 comment
-
|
Yes Quantization is planned for next year! We also want to support QLora as well, but I'm not sure when it will land. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
As this library is weighted toward performance and resource efficiency are there any plans to support Quantization and model formats such as GGUF? Will you also support quantized training as well using methods such as QLoRA?
Beta Was this translation helpful? Give feedback.
All reactions