[Router] Support load balancing in PD router - #587

[Router] Support load balancing in PD router#587

zhouwfang wants to merge 11 commits into

vllm-project:mainvllm-project/production-stack:mainfrom

zhouwfang:support-load-balancing-in-pd-routerzhouwfang/production-stack:support-load-balancing-in-pd-routerCopy head branch name to clipboard