Create New Base Docker Image for vLLM - #204
Open
AryanAhadinia wants to merge 3 commits into
Open
Conversation
3 tasks
AryanAhadinia
commented
Aug 12, 2026
|
|
||
| # libibverbs/libnuma back the RDMA and NUMA paths on Grace nodes; ffmpeg and | ||
| # libsndfile1 decode audio/video inputs; curl serves the router health checks. | ||
| # hadolint ignore=DL3008 |
AryanAhadinia
commented
Aug 12, 2026
Comment on lines
+33
to
+49
| # JIT and compile caches. Left unset they default under $HOME, which is NFS -- | ||
| # the worst filesystem here for the many small concurrent writes that | ||
| # torch.compile and Triton produce. These live on capstor instead, which is | ||
| # already mounted above and persists between jobs; node-local /tmp is tmpfs, so | ||
| # it would consume node RAM and be discarded at job end, recompiling on every | ||
| # launch. | ||
| # | ||
| # The paths are literal because variable references are not expanded reliably | ||
| # on the launch path, and an unexpanded ${SCRATCH} collapses to an unwritable | ||
| # root path. The cache is therefore shared across the infra01 group rather than | ||
| # per user; the directories carry setgid and group write so members can | ||
| # populate them. Entries are keyed by GPU architecture and library versions, so | ||
| # different users, models and images coexist without colliding. | ||
| # | ||
| # TORCHINDUCTOR_CACHE_DIR is deliberately absent: vLLM sets it itself, to a | ||
| # subdirectory of VLLM_CACHE_ROOT, so setting it here is silently discarded. | ||
| # TRITON_CACHE_DIR and CUDA_CACHE_PATH are not covered by VLLM_CACHE_ROOT. |
AryanAhadinia
commented
Aug 12, 2026
| @@ -0,0 +1,61 @@ | |||
| image = "/capstor/store/cscs/swissai/infra01/container-images/ci/pr-204/vllm_base-{arch}.sqsh" | |||
Member
Author
There was a problem hiding this comment.
Don't forget to fix the path before merge.
AryanAhadinia
force-pushed
the
AA/vllm-new-image
branch
from
August 25, 2026 16:04
0b4cb15 to
ed9f066
Compare
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.