Some question about sglang_router #7915
Unanswered
Zhangmj0621
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
In readme and sglang doc, I found that both the two document say SGLang router is a standalone module implemented in Rust to achieve data parallelism. I wonder if I don't have dp, but I have multiply workers with dp = 1, will sglang_router have effects?
Beta Was this translation helpful? Give feedback.
All reactions