-
-
Notifications
You must be signed in to change notification settings - Fork 425
Description
I am trying to run DeepStream-YOLO with a YOLOv8 INT8 model on Jetson Orin Nano. I followed the official calibration steps as described in the Ultralytics DeepStream guide (https://docs.ultralytics.com/guides/deepstream-nvidia-jetson/), but the INT8 calibration table (calib.table) is not being generated. DeepStream crashes with a segmentation fault during engine build. I want to run multiple stream with smooth & lowest latency, so I thats why im trying to generate int8 engine model.
System Information:
deepstream-app --version-all
deepstream-app version 7.1.0
DeepStreamSDK 7.1.0
CUDA Driver Version: 12.6
CUDA Runtime Version: 12.6
TensorRT Version: 10.3
cuDNN Version: 9.0
libNVWarp360 Version: 2.0.1d3
nvcc --version
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2024 NVIDIA Corporation
Built on Wed_Aug_14_10:14:07_PDT_2024
Cuda compilation tools, release 12.6, V12.6.68
Build cuda_12.6.r12.6/compiler.34714021_0
error detail:
deepstream-app -c deepstream_app_config.txt WARNING: INT8 calibration file not specified/accessible. INT8 calibration can be done through setDynamicRange API in 'NvDsInferCreateNetwork' implementation Building the TensorRT Engine File does not exist: /home/jetson-orin/DeepStream-Yolo/calib.table ERROR: [TRT]: [checkSanity.cpp::checkLinks::218] Error Code 2: Internal Error (Assertion item.second != nullptr failed. region should have been removed from Graph::regions) Segmentation fault (core dumped)