[Router][Bugfix] Defensive fallbacks in kvaware routing: 503 on no endpoints, session/QPS on unmapped instance - #1061

[Router][Bugfix] Defensive fallbacks in kvaware routing: 503 on no endpoints, session/QPS on unmapped instance#1061

tyler2cr wants to merge 2 commits into

vllm-project:mainvllm-project/production-stack:mainfrom

tyler2cr:router-defensive-fallbackstyler2cr/production-stack:router-defensive-fallbacksCopy head branch name to clipboard