Skip to content

Commit 555261e

Browse files
committed
deploy: add GPU smoke-test job for Lambda
Minimal CUDA Job that runs nvidia-smi with runtimeClassName: nvidia and a GPU limit. Run after setup-k3s-gpu.sh to confirm the K3s + RuntimeClass + device-plugin chain schedules GPU pods, isolating infrastructure issues before the longer vLLM cold-start runs.
1 parent fa08777 commit 555261e

1 file changed

Lines changed: 25 additions & 0 deletions

File tree

deploy/lambda/gpu-smoke-test.yaml

Lines changed: 25 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,25 @@
1+
# Smoke test: verify the cluster can schedule a GPU pod before deploying vLLM.
2+
# Runs nvidia-smi in a minimal CUDA container and exits. If this Job completes
3+
# and its logs show the GPU, the K3s + RuntimeClass + device-plugin chain works
4+
# and the operator's GPU path will too. Run after setup-k3s-gpu.sh:
5+
# kubectl apply -f gpu-smoke-test.yaml
6+
# kubectl wait --for=condition=complete job/gpu-smoke-test --timeout=120s
7+
# kubectl logs job/gpu-smoke-test
8+
apiVersion: batch/v1
9+
kind: Job
10+
metadata:
11+
name: gpu-smoke-test
12+
namespace: default
13+
spec:
14+
backoffLimit: 1
15+
template:
16+
spec:
17+
runtimeClassName: nvidia
18+
restartPolicy: Never
19+
containers:
20+
- name: cuda
21+
image: "nvidia/cuda:12.4.1-base-ubuntu22.04"
22+
command: ["nvidia-smi"]
23+
resources:
24+
limits:
25+
nvidia.com/gpu: 1

0 commit comments

Comments
 (0)