llm-nim not found

[alvaradojl]

I tried your command, even though the docker login succeeded and i can see nim-llm in the container registry, it doesn't seem to allow access:

$ docker login nvcr.io
Authenticating with existing credentials...
Login Succeeded

$ export NIM_IMAGE=llm-nim
export HF_TOKEN=hf_...
export MODEL=hf://microsoft/Phi-3-mini-4k-instruct-gguf
export NGC_API_KEY=nv...
export LOCAL_NIM_CACHE=~/.cache/nim
docker run --rm --gpus all \
  --shm-size=16GB \
  --network=host \
  -u $(id -u) \
  -v $(pwd)/nim_cache:/opt/nim/.cache \
  -v $(pwd):$(pwd) \
  -e HF_TOKEN=$HF_TOKEN \
  -e NIM_TENSOR_PARALLEL_SIZE=1 \
  -e NIM_MODEL_NAME=$MODEL \
  -e NGC_API_KEY \
  -e NIM_RELAX_MEM_CONSTRAINTS=1 \
  $NIM_IMAGE
Unable to find image 'llm-nim:latest' locally
docker: Error response from daemon: pull access denied for llm-nim, repository does not exist or may require 'docker login': denied: requested access to the resource is denied.
See 'docker run --help'.

[nealvaidya]

Hi @alvaradojl -- you'll need to use the full image path nvcr.io/nim/nvidia/llm-nim:latest rather than llm-nim or llm-nim:latest