[Bugfix][Router] Run KvawareRouter /tokenize fallback in executor to avoid blocking event loop - #1069

[Bugfix][Router] Run KvawareRouter /tokenize fallback in executor to avoid blocking event loop#1069

Asthenia0412 wants to merge 2 commits into

vllm-project:mainvllm-project/production-stack:mainfrom

Asthenia0412:fix/kvaware-router-sync-requestsAsthenia0412/production-stack:fix/kvaware-router-sync-requestsCopy head branch name to clipboard