Skip to content

fix: Use per-model tokenizer in KvawareRouter for multi-model setups - #1066

Open
Asthenia0412 wants to merge 2 commits into
vllm-project:mainfrom
Asthenia0412:fix/kvaware-multi-model-tokenizer
Open

fix: Use per-model tokenizer in KvawareRouter for multi-model setups#1066
Asthenia0412 wants to merge 2 commits into
vllm-project:mainfrom
Asthenia0412:fix/kvaware-multi-model-tokenizer