burst prefix-cache affinity for prompt-sharing requests#1727

elevran merged 18 commits into

llm-d:mainllm-d/llm-d-router:mainfrom

ezrasilvera:burst-scorer-longest-prefixezrasilvera/llm-d-inference-scheduler:burst-scorer-longest-prefixCopy head branch name to clipboard