feat(prefix): auto-tune prefix match cap from model max_model_len#1721

mayur-tolexo wants to merge 1 commit into

llm-d:mainllm-d/llm-d-router:mainfrom

mayur-tolexo:feat-autotune-max-prefix-tokensmayur-tolexo/llm-d-router:feat-autotune-max-prefix-tokensCopy head branch name to clipboard