Skip to content

Commit a6ab948

Browse files
committed
tmp: pin modelscope
Signed-off-by: sirutBuasai <sirutbuasai27@outlook.com>
1 parent 707728e commit a6ab948

2 files changed

Lines changed: 6 additions & 2 deletions

File tree

docker/vllm/Dockerfile.amzn2023

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -199,7 +199,9 @@ RUN --mount=type=cache,target=/root/.cache/uv uv pip install \
199199
--extra-index-url https://flashinfer.ai/whl/cu$(echo $CUDA_VERSION | cut -d. -f1,2 | tr -d '.')
200200

201201
# Install serving extras
202-
RUN --mount=type=cache,target=/root/.cache/uv uv pip install accelerate modelscope \
202+
# modelscope<1.38: 1.38+ removed the `revision` kwarg from LegacyHubApi.get_model_files(),
203+
# breaking vLLM's repo_utils.py. Unpin after upstream vLLM adapts to the new API.
204+
RUN --mount=type=cache,target=/root/.cache/uv uv pip install accelerate "modelscope<1.38" \
203205
"bitsandbytes>=0.46.1" "timm>=1.0.17" "runai-model-streamer[s3,gcs,azure]>=0.15.7"
204206

205207
# Audio deps for voxtral / ASR serving (mistral_common is an optional import in vLLM 0.24.0)

test/vllm/scripts/vllm_regression_test.sh

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -9,5 +9,7 @@ fi
99

1010
# Regression Test # 7min
1111
cd vllm_source/tests
12-
uv pip install $UV_FLAGS modelscope
12+
# modelscope<1.38: 1.38+ removed `revision` kwarg from LegacyHubApi.get_model_files(),
13+
# breaking vLLM's repo_utils.py. Unpin after upstream vLLM adapts to the new API.
14+
uv pip install $UV_FLAGS "modelscope<1.38"
1315
pytest -v -s test_regression.py

0 commit comments

Comments
 (0)