Skip to content

Commit 32e78d8

Browse files
committed
fix sglang
Signed-off-by: sirutBuasai <sirutbuasai27@outlook.com>
1 parent 4e5d55c commit 32e78d8

File tree

5 files changed

+32
-13
lines changed

5 files changed

+32
-13
lines changed

docs/src/data/sglang/0.5.5-gpu-sagemaker.yml

Lines changed: 7 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -17,11 +17,15 @@ announcements:
1717

1818
packages:
1919
sglang: "0.5.5"
20+
sgl-kernel: "0.3.16.post5"
2021
pytorch: "2.8.0"
2122
torchvision: "0.23.0"
2223
torchaudio: "2.8.0"
24+
torchao: "0.9.0"
2325
transformers: "4.57.1"
26+
flashinfer: "0.5.0"
2427
cuda: "12.9.1"
25-
cudnn: "9.16.0.29"
26-
nccl: "2.28.3"
27-
efa: "1.46.0"
28+
cudnn: "9.10.2.21-1"
29+
nccl: "2.27.3-1"
30+
efa: "1.43.3"
31+
gdrcopy: "2.5.1"

docs/src/data/sglang/0.5.6-gpu-sagemaker.yml

Lines changed: 7 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -17,11 +17,15 @@ announcements:
1717

1818
packages:
1919
sglang: "0.5.6"
20+
sgl-kernel: "0.3.18.post2"
2021
pytorch: "2.9.1"
2122
torchvision: "0.24.1"
2223
torchaudio: "2.9.1"
24+
torchao: "0.9.0"
2325
transformers: "4.57.1"
26+
flashinfer: "0.5.3"
2427
cuda: "12.9.1"
25-
cudnn: "9.16.0.29"
26-
nccl: "2.28.3"
27-
efa: "1.46.0"
28+
cudnn: "9.10.2.21-1"
29+
nccl: "2.27.3-1"
30+
efa: "43.3"
31+
gdrcopy: "2.5.1"

docs/src/data/sglang/0.5.7-gpu-sagemaker.yml

Lines changed: 6 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -18,11 +18,15 @@ announcements:
1818

1919
packages:
2020
sglang: "0.5.7"
21+
sgl-kernel: "0.3.20"
2122
pytorch: "2.9.1"
2223
torchvision: "0.24.1"
2324
torchaudio: "2.9.1"
25+
torchao: "0.9.0"
2426
transformers: "4.57.1"
27+
flashinfer: "0.5.3"
2528
cuda: "12.9.1"
26-
cudnn: "9.16.0.29"
27-
nccl: "2.28.3"
29+
cudnn: "9.10.2.21-1"
30+
nccl: "2.27.3-1"
2831
efa: "1.46.0"
32+
gdrcopy: "2.5.1"

docs/src/data/sglang/0.5.8-gpu-sagemaker.yml

Lines changed: 9 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -19,11 +19,15 @@ announcements:
1919

2020
packages:
2121
sglang: "0.5.8"
22-
pytorch: "2.8.0"
23-
torchvision: "0.23.0"
24-
torchaudio: "2.8.0"
22+
sgl-kernel: "0.3.21"
23+
pytorch: "2.9.1"
24+
torchvision: "0.24.1"
25+
torchaudio: "2.9.1"
26+
torchao: "0.9.0"
2527
transformers: "4.57.1"
28+
flashinfer: "0.6.1"
2629
cuda: "12.9.1"
27-
cudnn: "9.16.0.29"
28-
nccl: "2.28.3"
30+
cudnn: "9.10.2.21-1"
31+
nccl: "2.27.3-1"
2932
efa: "1.46.0"
33+
gdrcopy: "2.5.1"

docs/src/global.yml

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -94,12 +94,15 @@ display_names:
9494
torchvision: "TorchVision"
9595
torchaudio: "TorchAudio"
9696
torchdata: "TorchData"
97+
torchao: "TorchAO"
9798
torchtnt: "TorchTNT"
9899
torchtext: "TorchText"
99100
torchserve: "TorchServe"
101+
sgl-kernel: "SGLang Kernel"
100102
transformers: "Transformers"
101103
transformer_engine: "Transformer Engine"
102104
flash_attn: "Flash Attention"
105+
flashinfer: "FlashInfer"
103106
neuronx_sdk: "NeuronX SDK"
104107
openmpi: "OpenMPI"
105108
sagemaker_pytorch_inference: "SageMaker PyTorch Inference Toolkit"

0 commit comments

Comments
 (0)