[None][perf] Chat frontend fastpath: single template render + suffix token-id cache + to_thread offload - #7

[None][perf] Chat frontend fastpath: single template render + suffix token-id cache + to_thread offload#7

lingjiew wants to merge 1 commit into

nv-guomingz:user/guomingz/qwen3.5_agentxnv-guomingz/TensorRT-LLM:user/guomingz/qwen3.5_agentxfrom

lingjiew:user/lingjiew/chat_frontend_fastpathlingjiew/TensorRT-LLM:user/lingjiew/chat_frontend_fastpathCopy head branch name to clipboard