Skip to content

Commit 7df0e53

Browse files
authored
Bump vllm minimum version to 0.19.1 (#286)
Pick up vllm 0.19.1, which ships transformers v5 officially upstream (#30566). Drops the post-install override from #169 and aligns pyproject's transformers pin to >=5.5.1. Signed-off-by: RickyChen / 陳昭儒 <rickychen@infinirc.com>
1 parent b669f18 commit 7df0e53

2 files changed

Lines changed: 3 additions & 8 deletions

File tree

install.sh

Lines changed: 1 addition & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -123,7 +123,7 @@ main() {
123123

124124
ensure_venv "$venv"
125125

126-
local vllm_v="0.19.0"
126+
local vllm_v="0.19.1"
127127
local url_base="https://github.com/vllm-project/vllm/releases/download"
128128
local filename="vllm-$vllm_v.tar.gz"
129129
curl -OL $url_base/v$vllm_v/$filename
@@ -138,12 +138,6 @@ main() {
138138
cd -
139139
rm -rf vllm-$vllm_v*
140140

141-
# Upgrade transformers beyond vllm's <5 pin.
142-
# mlx-lm 0.30+ and mlx-vlm 0.3.10+ require transformers>=5.0.0 for newer
143-
# model architectures (Qwen3.5, Nemotron, etc.). vllm works fine with v5 —
144-
# upstream is tracking the official upgrade in vllm-project/vllm#30566.
145-
uv pip install 'transformers>=5.0.0'
146-
147141
if [[ -n "$local_lib" && -f "$local_lib" ]]; then
148142
uv pip install .
149143
else

pyproject.toml

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -32,7 +32,8 @@ dependencies = [
3232
"mlx-lm>=0.31.0; platform_system == 'Darwin' and platform_machine == 'arm64'",
3333
"mlx-vlm>=0.4.0; platform_system == 'Darwin' and platform_machine == 'arm64'", # Vision-language model support
3434
# Model loading and weights
35-
"transformers>=5.0.0",
35+
# Lower bound aligned with vllm 0.19.1's exclude list in requirements/common.txt
36+
"transformers>=5.5.1",
3637
"accelerate>=0.26.0",
3738
"safetensors>=0.4.0",
3839
# Native Metal extension JIT build

0 commit comments

Comments
 (0)