TensorRT-RTX 1.1 Release
This OSS release supports TensorRT-RTX 1.1, and contains sample code to showcase its capabilities and recommended usage.
Details are available in the release notes. Notable features in this release include:
- Added the
IRuntime::getEngineValidity()API to programmatically check whether a TensorRT-RTX engine file is valid on the current system or needs to be rebuilt due to incompatibilities in the software version, compute capability, and so on. This API only checks the file header and therefore does not require loading the entire engine file into memory, which results in a more efficient check. - Compilation time has been greatly improved, particularly for models with many memory-bound kernels. On average a 1.5x improvement is observed across a variety of model architectures.