Dockerhub doesn't have ARM images

[borowis]

Hey folks! I was trying to use a LiteLLM image from Dockerhub:

    docker pull litellm/litellm:1.80.15-stable.1

But go an error:

No matching manifest for linux/arm64/v8 in the manifest list entries

It works fine though when pulling from ghcr.io. Is there any particular reason why ARM images are not pushed to Dockerhub?

[mwaldheim]

+1 for this issue. We urgently need native multi-arch (linux/arm64) manifests pushed to Docker Hub.

Relying on amd64 images via emulation on Apple Silicon Macs is no longer just a performance bottleneck—it's about to become a hard blocker. Apple has officially announced the phase-out of Rosetta 2, and macOS is already starting to warn users about the impending discontinuation of Intel-translation features. Once Rosetta 2 is removed in the upcoming major macOS releases, developers on Apple Silicon will simply not be able to run these Docker Hub images anymore.

While ghcr.io is a temporary workaround, Docker Hub is the default registry for most setups. Could the CI/CD pipeline please be updated to push ARM builds to Docker Hub as well before this breaks local development for all Mac users?

[ibondarenko1]

short-term workaround: pull from ghcr.io instead, the multi-arch manifests there do include linux/arm64.

docker pull ghcr.io/berriai/litellm:main-stable
# or for a pinned tag:
docker pull ghcr.io/berriai/litellm:litellm_stable_release_branch-v1.80.15-stable

the dockerhub push in the BerriAI release workflow only builds linux/amd64. ghcr.io publishes the multi-arch manifest as part of the same release, so the same SHA is available there with arm64.

actual fix on the maintainer side is one buildx flag in the dockerhub job, something like --platform linux/amd64,linux/arm64 on the buildx command, plus matching docker manifest create if they push as separate tags. if the BerriAI team is open to it, that's a small PR to .github/workflows/ghcr_deploy.yml (or wherever the dockerhub push lives), it just bloats the release time by a few minutes.

@mwaldheim's rosetta-2 point makes this not optional past macOS Tahoe, so worth raising visibility on it. for now ghcr unblocks Apple Silicon and ARM CI runners.