Skip to content

Commit 9bd74a4

Browse files
[CI/Build] add directions for CPU image upload to Docker Hub
vLLM builds CPU images, but these are only put on ECR and not Docker Hub, where other public production images are hosted. While CPU images should not be used for production usage, they can be very good for CI and Developer usage. This commit updates the 'annotate-release.sh' script with directions on how to properly tag and upload these CPU images to Docker Hub Signed-off-by: Nathan Weinberg <nweinber@redhat.com>
1 parent e535d90 commit 9bd74a4

File tree

1 file changed

+23
-1
lines changed

1 file changed

+23
-1
lines changed

.buildkite/scripts/annotate-release.sh

Lines changed: 23 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -86,5 +86,27 @@ docker manifest create vllm/vllm-openai:latest-cu130 vllm/vllm-openai:latest-x86
8686
docker manifest create vllm/vllm-openai:v${RELEASE_VERSION}-cu130 vllm/vllm-openai:v${RELEASE_VERSION}-x86_64-cu130 vllm/vllm-openai:v${RELEASE_VERSION}-aarch64-cu130
8787
docker manifest push vllm/vllm-openai:latest-cu130
8888
docker manifest push vllm/vllm-openai:v${RELEASE_VERSION}-cu130
89+
90+
# CPU images (vllm/vllm-openai-cpu)
91+
docker pull public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:${RELEASE_VERSION}
92+
docker pull public.ecr.aws/q9t5s3a7/vllm-arm64-cpu-release-repo:${RELEASE_VERSION}
93+
94+
docker tag public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:${RELEASE_VERSION} vllm/vllm-openai-cpu:x86_64
95+
docker tag vllm/vllm-openai-cpu:x86_64 vllm/vllm-openai-cpu:latest-x86_64
96+
docker tag vllm/vllm-openai-cpu:x86_64 vllm/vllm-openai-cpu:v${RELEASE_VERSION}-x86_64
97+
docker push vllm/vllm-openai-cpu:latest-x86_64
98+
docker push vllm/vllm-openai-cpu:v${RELEASE_VERSION}-x86_64
99+
100+
docker tag public.ecr.aws/q9t5s3a7/vllm-arm64-cpu-release-repo:${RELEASE_VERSION} vllm/vllm-openai-cpu:arm64
101+
docker tag vllm/vllm-openai-cpu:arm64 vllm/vllm-openai-cpu:latest-arm64
102+
docker tag vllm/vllm-openai-cpu:arm64 vllm/vllm-openai-cpu:v${RELEASE_VERSION}-arm64
103+
docker push vllm/vllm-openai-cpu:latest-arm64
104+
docker push vllm/vllm-openai-cpu:v${RELEASE_VERSION}-arm64
105+
106+
docker manifest rm vllm/vllm-openai-cpu:latest || true
107+
docker manifest create vllm/vllm-openai-cpu:latest vllm/vllm-openai-cpu:latest-x86_64 vllm/vllm-openai-cpu:latest-arm64
108+
docker manifest create vllm/vllm-openai-cpu:v${RELEASE_VERSION} vllm/vllm-openai-cpu:v${RELEASE_VERSION}-x86_64 vllm/vllm-openai-cpu:v${RELEASE_VERSION}-arm64
109+
docker manifest push vllm/vllm-openai-cpu:latest
110+
docker manifest push vllm/vllm-openai-cpu:v${RELEASE_VERSION}
89111
\`\`\`
90-
EOF
112+
EOF

0 commit comments

Comments
 (0)