Portainer EE - GPU cannot be activated

[boospy]

Ask a Question!

Hello all,

technical tools:

• Ubuntu 24.04 Server LTS
• Portainer EE 2.33.6 LTS
• GPU Nvidia RTX A2000 → working fine with other software

I would like to use the GPU in Portainer as well. However, I have not yet managed to make it available. What I have done so far – my results:

Install Nvidia Toolkit: https://nvidia.github.io/libnvidia-container/stable/

Set the default runtime to nvidia:

docker info | grep "Default Runtime"
Default Runtime: nvidia

And I've modified the Start-Exec for portainer with GPU

docker run -d -p 9443:9443 --name portainer --gpus=all --restart=always -v /var/run/docker.sock:/var/run/docker.sock -v /usr/local/share/ca-certificates/ucs-root-01.crt:/etc/ssl/certs/ucs-root-01.crt -v /usr/local/share/ca-certificates/ucs-root-wildcard1.crt:/etc/ssl/certs/ucs-root-wildcard1.crt -v portainer_data:/data -v /docker/appdata/certs:/certs portainer/portainer-ee:lts --sslcert /certs/ucs-apache.crt --sslkey /certs/ucs-apache.key

But it still starts with “runc.” Why is that? What am I missing here?

docker inspect portainer | grep  Runtime
            "Runtime": "runc",
            "CpuRealtimeRuntime": 0,

Thank you :)

[boospy]

I just ran a GPU test with a container “nvidia/cuda:12.6.2-base-ubuntu24.04” → but that works. So I suspect that Portainer is obviously displaying an error message that no GPUs are being used. Strange.