Skip to content

[None][perf] Offload chat template rendering to the input-processor pool - #16231

Closed
lingjiew wants to merge 1 commit into
NVIDIA:mainfrom
lingjiew:user/lingjiew/chat_frontend_fastpath_main
Closed

[None][perf] Offload chat template rendering to the input-processor pool#16231
lingjiew wants to merge 1 commit into
NVIDIA:mainfrom
lingjiew:user/lingjiew/chat_frontend_fastpath_main