Skip to content

INT8 Calibration (calib.table) Not Generated on Jetson Orin Nano #675

@shubham07-rapidise

Description

@shubham07-rapidise

I am trying to run DeepStream-YOLO with a YOLOv8 INT8 model on Jetson Orin Nano. I followed the official calibration steps as described in the Ultralytics DeepStream guide (https://docs.ultralytics.com/guides/deepstream-nvidia-jetson/), but the INT8 calibration table (calib.table) is not being generated. DeepStream crashes with a segmentation fault during engine build. I want to run multiple stream with smooth & lowest latency, so I thats why im trying to generate int8 engine model.

System Information:
deepstream-app --version-all
deepstream-app version 7.1.0
DeepStreamSDK 7.1.0
CUDA Driver Version: 12.6
CUDA Runtime Version: 12.6
TensorRT Version: 10.3
cuDNN Version: 9.0
libNVWarp360 Version: 2.0.1d3

nvcc --version
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2024 NVIDIA Corporation
Built on Wed_Aug_14_10:14:07_PDT_2024
Cuda compilation tools, release 12.6, V12.6.68
Build cuda_12.6.r12.6/compiler.34714021_0

error detail:
deepstream-app -c deepstream_app_config.txt WARNING: INT8 calibration file not specified/accessible. INT8 calibration can be done through setDynamicRange API in 'NvDsInferCreateNetwork' implementation Building the TensorRT Engine File does not exist: /home/jetson-orin/DeepStream-Yolo/calib.table ERROR: [TRT]: [checkSanity.cpp::checkLinks::218] Error Code 2: Internal Error (Assertion item.second != nullptr failed. region should have been removed from Graph::regions) Segmentation fault (core dumped)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions