Skip to content

Latest commit

 

History

History
12 lines (8 loc) · 500 Bytes

File metadata and controls

12 lines (8 loc) · 500 Bytes

(containers)=

Pre-built release container images on NGC

Pre-built TensorRT LLM releases are made available as container images on NGC. This is likely the simplest way to obtain TensorRT LLM. Please refer to the documentation in NGC for usage instructions.

{{container_tag_admonition}}

Containers can also be built locally, see https://github.com/NVIDIA/TensorRT-LLM/tree/main/docker for all related options.