Skip to content

Port of #1558 Adapt multi_model_api_server to vLLM ServingTokenizatio… - #1559

Open
iboiko-habana wants to merge 6 commits into
mainfrom
iboiko/pre_releases/v0.24.0
Open

Port of #1558 Adapt multi_model_api_server to vLLM ServingTokenizatio…#1559
iboiko-habana wants to merge 6 commits into
mainfrom
iboiko/pre_releases/v0.24.0

Port of: Detach shared MoE gate when experts is the MoERunner (vLLM #…

4f79f41
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar