Skip to content

Commit 19e71b1

Browse files
committed
chore: update vllm
1 parent 8f6448e commit 19e71b1

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

tinfoil-config.yml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -16,7 +16,7 @@ containers:
1616
"--runtime", "nvidia",
1717
"--gpus", "all",
1818
"--ipc", "host",
19-
"vllm/vllm-openai:v0.12.0@sha256:6766ce0c459e24b76f3e9ba14ffc0442131ef4248c904efdcbf0d89e38be01fe",
19+
"vllm/vllm-openai:v0.13.0@sha256:d623253f2ba246378421c9642e20885e65257f38418ff26d48c81aea1702521b",
2020
"--model", "/tinfoil/mpk/mpk-81993809d5510f60b216a144a27d4a2ca1df6b5ddaa6b7f0096a040bb5b1bf07",
2121
"--enable-expert-parallel",
2222
"--data-parallel-size", "8",

0 commit comments

Comments
 (0)