Add vLLM (#4631) (#4913)

* Add vLLM app to community catalog

   Adds vLLM (high-performance LLM inference server with OpenAI-compatible API)
   as a TrueNAS community app, addressing issue #4631.

   Features:
   - NVIDIA CUDA and AMD ROCm image selector
   - GPU passthrough via definitions/gpu_configuration
   - IPC host mode for PyTorch shared memory
   - Model name as command argument (--model)
   - HuggingFace token for gated models
   - HF_HOME=/data for model cache storage
   - HTTP healthcheck on /health endpoint
   - ROCm-specific SYS_PTRACE capability and seccomp:unconfined
   - Port 30422 (next free port in catalog)
   - 8192 MB default memory (vLLM is memory-hungry)

   Closes #4631

* Fix vLLM container crash: add HOME env var for UID 568

* Fix vLLM CI: add USER env var and vendored library

* Fix vLLM CI: CPU image on gh runners

* Add --port flag to vLLM command so it listens on the configured port inside the container (default 8000 was not mapped)

* Fix vLLM CI: give vllm more time to start in poor env

* add image to renovate-bot list

* no need for custom versioning, its semver

* update lib

* meta

* not really needed, unless another container had a depends on chain against it.

* huh. weird

* svg

---------

Co-authored-by: blazej karabin <blazej@cynergybank.co.uk>
Co-authored-by: Stavros Kois <47820033+stavros-k@users.noreply.github.com>
Co-authored-by: Stavros Kois <s.kois@outlook.com>

Author: 3 people

cspell.config.yaml

@@ -534,6 +534,7 @@ words:
   - vhost
   - vikunja
   - vitransfer
+  - vllm
   - wabayang
   - warracker
   - webapi

ix-dev/community/vllm/README.md

@@ -0,0 +1,3 @@
+# vLLM
+
+[vLLM](https://github.com/vllm-project/vllm) is a high-throughput and memory-efficient inference and serving engine for LLMs with an OpenAI-compatible API.

ix-dev/community/vllm/app.yaml

@@ -0,0 +1,36 @@
+app_version: v0.20.0
+capabilities: []
+categories:
+- ai
+changelog_url: https://github.com/vllm-project/vllm/releases
+date_added: '2026-04-30'
+description: vLLM is a high-throughput and memory-efficient inference and serving
+  engine for LLMs with an OpenAI-compatible API.
+home: https://github.com/vllm-project/vllm
+host_mounts: []
+icon: https://media.sys.truenas.net/apps/vllm/icons/icon.svg
+keywords:
+- ai
+- llm
+- inference
+- openai
+- gpu
+lib_version: 2.3.5
+lib_version_hash: c0d042e3de6350fae9aee546d3c79bc0accf1f2011da89cc1ebff29421aa7fc9
+maintainers:
+- email: dev@truenas.com
+  name: truenas
+  url: https://www.truenas.com/
+name: vllm
+run_as_context:
+- description: Container [vllm] can run as any non-root user and group.
+  gid: 568
+  group_name: Host group is [apps]
+  uid: 568
+  user_name: Host user is [apps]
+screenshots: []
+sources:
+- https://github.com/vllm-project/vllm
+title: vLLM
+train: community
+version: 1.0.0

ix-dev/community/vllm/item.yaml

@@ -0,0 +1,10 @@
+categories:
+- ai
+icon_url: https://media.sys.truenas.net/apps/vllm/icons/icon.svg
+screenshots: []
+tags:
+- ai
+- llm
+- inference
+- openai
+- gpu

ix-dev/community/vllm/ix_values.yaml

@@ -0,0 +1,17 @@
+images:
+  image:
+    repository: vllm/vllm-openai
+    tag: v0.20.0
+  rocm_image:
+    repository: vllm/vllm-openai-rocm
+    tag: v0.20.0
+  cpu_image:
+    repository: vllm/vllm-openai-cpu
+    tag: v0.20.0
+  container_utils_image:
+    repository: ixsystems/container-utils
+    tag: 1.0.2
+
+consts:
+  vllm_container_name: vllm
+  perms_container_name: permissions