Skip to content

Commit 76d21cc

Browse files
committed
chore: remove explicit --vllm-port=8200 from sidecar configs
- llm-d-router disagg sidecar now defaults --vllm-port to 8200 (llm-d/llm-d-router#1723), making the explicit flag redundant Signed-off-by: Wen Zhou <wenzhou@redhat.com>
1 parent 20551d6 commit 76d21cc

8 files changed

Lines changed: 1 addition & 9 deletions

File tree

guides/agentic-serving/modelserver/gpu/vllm/nemotron-3-ultra/patch-decode.yaml

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,6 @@ spec:
1111
image: ghcr.io/llm-d/llm-d-router-disagg-sidecar:main
1212
args:
1313
- --port=8000
14-
- --vllm-port=8200
1514
- --kv-connector=nixlv2
1615
- --zap-log-level=4
1716
- --secure-proxy=false

guides/multimodal-serving/e-disaggregation/modelserver/gpu/vllm/e-p-d/base/patch-decode.yaml

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,6 @@ spec:
1010
- name: routing-proxy
1111
args:
1212
- --port=8000
13-
- --vllm-port=8200
1413
- --kv-connector=nixlv2
1514
- --ec-connector=ec-nixl
1615
- --zap-log-level=1

guides/multimodal-serving/e-disaggregation/modelserver/gpu/vllm/e-pd/base/patch-decode.yaml

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,6 @@ spec:
1111
imagePullPolicy: Always
1212
args:
1313
- --port=8000
14-
- --vllm-port=8200
1514
- --kv-connector=nixlv2
1615
- --ec-connector=ec-nixl
1716
- --zap-log-level=1

guides/recipes/modelserver/base/single-host/pd/sglang/patch-sidecar.yaml

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -9,7 +9,6 @@ spec:
99
- name: routing-proxy
1010
args:
1111
- --port=8000
12-
- --vllm-port=8200
1312
- --kv-connector=sglang
1413
- --zap-log-level=1
1514
- --secure-proxy=false

guides/recipes/modelserver/base/single-host/pd/vllm/patch-sidecar.yaml

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -9,7 +9,6 @@ spec:
99
- name: routing-proxy
1010
args:
1111
- --port=8000
12-
- --vllm-port=8200
1312
- --kv-connector=nixlv2
1413
- --zap-log-level=1
1514
- --secure-proxy=false

guides/wide-ep-lws/modelserver/gpu/vllm-deepseek-v4/base/decode.yaml

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -24,7 +24,6 @@ spec:
2424
- name: routing-proxy
2525
args:
2626
- --port=8000
27-
- --vllm-port=8200
2827
- --kv-connector=nixlv2
2928
- --zap-log-level=1
3029
- --secure-proxy=false

guides/wide-ep-lws/modelserver/gpu/vllm/base/decode.yaml

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -27,11 +27,10 @@ spec:
2727
initContainers:
2828
- name: routing-proxy
2929
args:
30-
# sidecar proxy is started with --port 8000, --vllm-port 8200, and --data-parallel-size 8,
30+
# sidecar proxy is started with --port 8000 and --data-parallel-size 8,
3131
# so it listens on ports in the range [port:port+data-parallel-size-1] and forwards
3232
# requests each to the corresponding vllm port.
3333
- --port=8000
34-
- --vllm-port=8200
3534
- --data-parallel-size=8
3635
- --kv-connector=nixlv2
3736
- --zap-log-level=1

guides/wide-ep-lws/modelserver/xpu/vllm/decode.yaml

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -31,7 +31,6 @@ spec:
3131
- name: routing-proxy
3232
args:
3333
- --port=8000
34-
- --vllm-port=8200
3534
- --kv-connector=nixlv2
3635
- --zap-log-level=1
3736
- --secure-proxy=false

0 commit comments

Comments
 (0)