想请教一下,ktransfromers相比于其他本地部署推理框架如llama.cpp、vllm等,使用的核心技术是什么,有什么样的优势呢? #1260
sun666666ai
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
如题,我对这方面还不太清楚
Beta Was this translation helpful? Give feedback.
All reactions