fix(vllm): report an exhausted KV pool as a scheduling miss, not a crash - #453

fix(vllm): report an exhausted KV pool as a scheduling miss, not a crash#453

RixinLiu merged 1 commit into

mainovg-project/kvcached:mainfrom

fix/pool-exhaustion-is-a-scheduling-missovg-project/kvcached:fix/pool-exhaustion-is-a-scheduling-missCopy head branch name to clipboard