Skip to content

add configurable gateway replicas#280

Open
nicole-lihui wants to merge 1 commit into
llm-d-incubation:mainfrom
nicole-lihui:configurable-gateway-replicas
Open

add configurable gateway replicas#280
nicole-lihui wants to merge 1 commit into
llm-d-incubation:mainfrom
nicole-lihui:configurable-gateway-replicas

Conversation

@nicole-lihui
Copy link
Copy Markdown
Contributor

use gateway.gatewayParameters.replicas to configure gateway replicas.

in production env, gateway replica count must be configurable, but this is not supported today.

@nicole-lihui nicole-lihui changed the title add configurable gateway replicas use add configurable gateway replicas add configurable gateway replicas use gateway.gatewayParameters.replicas Mar 31, 2026
@nicole-lihui nicole-lihui force-pushed the configurable-gateway-replicas branch from b55c173 to 0889693 Compare March 31, 2026 11:53
@nicole-lihui nicole-lihui changed the title add configurable gateway replicas use gateway.gatewayParameters.replicas add configurable gateway replicas Mar 31, 2026
…icas`

Signed-off-by: nicole-lihui <nicole.li@daocloud.io>
@nicole-lihui nicole-lihui force-pushed the configurable-gateway-replicas branch from 0889693 to c29116c Compare March 31, 2026 12:24
@github-actions
Copy link
Copy Markdown

This PR is marked as stale after 21d of inactivity. After an additional 14d of inactivity (7d to become rotten, then 7d more), it will be closed. To prevent this PR from being closed, add a comment or remove the lifecycle/stale label.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant