Skip to content

Commit 7c35342

Browse files
sglang-botFridge003
authored andcommitted
chore: bump flashinfer version to 0.6.7.post3 (#22382)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
1 parent dc50501 commit 7c35342

4 files changed

Lines changed: 5 additions & 5 deletions

File tree

docker/Dockerfile

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -19,7 +19,7 @@ ARG PIP_DEFAULT_INDEX
1919
ARG UBUNTU_MIRROR
2020
ARG GITHUB_ARTIFACTORY=github.com
2121
ARG INSTALL_FLASHINFER_JIT_CACHE=0
22-
ARG FLASHINFER_VERSION=0.6.7.post2
22+
ARG FLASHINFER_VERSION=0.6.7.post3
2323
ARG MOONCAKE_VERSION=0.3.9
2424
#if need other arg please add in MOONCAKE_COMPILE_ARG
2525
ARG MOONCAKE_COMPILE_ARG="-DUSE_HTTP=ON -DUSE_MNNVL=ON -DUSE_CUDA=ON -DWITH_EP=ON"

python/pyproject.toml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -27,8 +27,8 @@ dependencies = [
2727
"datasets",
2828
"einops",
2929
"fastapi",
30-
"flashinfer_python==0.6.7.post2", # keep it aligned with jit-cache version in Dockerfile
31-
"flashinfer_cubin==0.6.7.post2",
30+
"flashinfer_python==0.6.7.post3", # keep it aligned with jit-cache version in Dockerfile
31+
"flashinfer_cubin==0.6.7.post3",
3232
"gguf",
3333
"interegular",
3434
"llguidance>=0.7.11,<0.8.0",

python/sglang/srt/entrypoints/engine.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1128,7 +1128,7 @@ def _set_envs_and_config(server_args: ServerArgs):
11281128
if server_args.attention_backend == "flashinfer":
11291129
assert_pkg_version(
11301130
"flashinfer_python",
1131-
"0.6.7.post2",
1131+
"0.6.7.post3",
11321132
"Please uninstall the old version and "
11331133
"reinstall the latest version by following the instructions "
11341134
"at https://docs.flashinfer.ai/installation.html.",

python/sglang/srt/utils/common.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1023,7 +1023,7 @@ def check_pkg_version_at_least(pkg: str, min_version: str) -> bool:
10231023
10241024
Args:
10251025
pkg: Package name (distribution name, e.g., "flashinfer-python")
1026-
min_version: Minimum version required (e.g., "0.6.7.post2")
1026+
min_version: Minimum version required (e.g., "0.6.7.post3")
10271027
10281028
Returns:
10291029
True if package is installed and version >= min_version, False otherwise

0 commit comments

Comments
 (0)