Skip to content

Commit b9a28f3

Browse files
committed
adding fix for sglang benchmark
1 parent 28ad169 commit b9a28f3

1 file changed

Lines changed: 15 additions & 0 deletions

File tree

.github/workflows/sglang-benchmark.yml

Lines changed: 15 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -186,6 +186,21 @@ jobs:
186186
# Verify installations
187187
echo "$(pwd)/sgl_server_env/bin" >> $GITHUB_PATH
188188
189+
- name: Install NVCC
190+
if: env.DEVICE_NAME == 'cuda'
191+
shell: bash
192+
run: |
193+
set -eux
194+
sudo apt-get update
195+
sudo apt-get install -y wget gnupg
196+
wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2204/x86_64/cuda-keyring_1.1-1_all.deb
197+
sudo dpkg -i cuda-keyring_1.1-1_all.deb
198+
sudo apt-get update
199+
sudo apt-get install -y --no-install-recommends cuda-toolkit-12-8
200+
sudo ln -s /usr/local/cuda-12.8 /usr/local/cuda || true
201+
echo "CUDA_HOME=/usr/local/cuda-12.8" >> $GITHUB_ENV
202+
echo "/usr/local/cuda-12.8/bin" >> $GITHUB_PATH
203+
189204
- name: Setup benchmark tests
190205
env:
191206
MODELS: ${{ matrix.models }}

0 commit comments

Comments
 (0)