既然Qlora微调之后参数不支持合并，那如何进行vllm部署呢 #1133
Unanswered
Terminaldienst
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
还是说只能先标准精度微调，合并之后量化，然后才能用vllm部署
Beta Was this translation helpful? Give feedback.
All reactions