Skip to content

Commit 2f1e2df

Browse files
authored
[Currency] SGLang 0.5.7 v2 (#5588)
* [Currency] SGLang 0.5.7 Signed-off-by: sirutBuasai <sirutbuasai27@outlook.com> * break system packages Signed-off-by: sirutBuasai <sirutbuasai27@outlook.com> * use uv venv Signed-off-by: sirutBuasai <sirutbuasai27@outlook.com> * source venv Signed-off-by: sirutBuasai <sirutbuasai27@outlook.com> * fix venv test Signed-off-by: sirutBuasai <sirutbuasai27@outlook.com> --------- Signed-off-by: sirutBuasai <sirutbuasai27@outlook.com>
1 parent 14474b8 commit 2f1e2df

File tree

2 files changed

+9
-3
lines changed

2 files changed

+9
-3
lines changed

.github/workflows/pr-sglang.yml

Lines changed: 7 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -16,7 +16,7 @@ env:
1616
# Common
1717
CONTAINER_TYPE: "general"
1818
FRAMEWORK: "sglang"
19-
SGLANG_VERSION: "0.5.6"
19+
SGLANG_VERSION: "0.5.7"
2020
PYTHON_VERSION: "py312"
2121
CUDA_VERSION: "cu129"
2222
OS_VERSION: "ubuntu22.04"
@@ -247,6 +247,9 @@ jobs:
247247
run: |
248248
docker exec ${CONTAINER_ID} sh -c '
249249
set -eux
250+
# https://github.com/sgl-project/sglang/blob/v0.5.7/scripts/ci/ci_install_dependency.sh#L78C8-L80
251+
# our CI suffers the same issue
252+
export IS_BLACKWELL=1
250253
251254
bash scripts/ci/ci_install_dependency.sh
252255
'
@@ -424,6 +427,9 @@ jobs:
424427
run: |
425428
docker exec ${CONTAINER_ID} sh -c '
426429
set -eux
430+
# https://github.com/sgl-project/sglang/blob/v0.5.7/scripts/ci/ci_install_dependency.sh#L78C8-L80
431+
# our CI suffers the same issue
432+
export IS_BLACKWELL=1
427433
428434
bash scripts/ci/ci_install_dependency.sh
429435
'

docker/sglang/Dockerfile

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
# Declare the argument as default to use as input
22
# base image: https://hub.docker.com/r/lmsysorg/sglang/tags
3-
ARG BASE_IMAGE=lmsysorg/sglang:v0.5.6-cu129-amd64
3+
ARG BASE_IMAGE=lmsysorg/sglang:v0.5.7-cu129-amd64
44

55
# Use input argument as base image
66
FROM $BASE_IMAGE AS base
@@ -47,7 +47,7 @@ RUN chmod +x /usr/local/bin/deep_learning_container.py \
4747
&& chmod +x /usr/local/bin/bash_telemetry.sh \
4848
&& chmod +x /usr/local/bin/start_cuda_compat.sh \
4949
&& rm /tmp/bash_telemetry.sh.template \
50-
&& uv pip install --system botocore \
50+
&& uv pip install --system --break-system-packages botocore \
5151
&& uv cache clean
5252

5353
# Install EFA and remove vulnerable nvjpeg

0 commit comments

Comments
 (0)