Skip to content

2025.0.1

Choose a tag to compare

@nszczygl9 nszczygl9 released this 19 Feb 10:54
· 315 commits to master since this release
17af9c3

Intel® Deep Learning Streamer Pipeline Framework Release 2025.0.1

Intel® Deep Learning Streamer (Intel® DL Streamer) Pipeline Framework is a streaming media analytics framework, based on GStreamer* multimedia framework, for creating complex media analytics pipelines. It ensures pipeline interoperability and provides optimized media, and inference operations using Intel® Distribution of OpenVINO™ Toolkit Inference Engine backend, across Intel® architecture, CPU, discrete GPU, integrated GPU and NPU.

This release includes Intel® DL Streamer Pipeline Framework elements to enable video and audio analytics capabilities, (e.g., object detection, classification, audio event detection), and other elements to build end-to-end optimized pipeline in GStreamer* framework.

The complete solution leverages:

  • Open source GStreamer* framework for pipeline management
  • GStreamer* plugins for input and output such as media files and real-time streaming from camera or network
  • Video decode and encode plugins, either CPU optimized plugins or GPU-accelerated plugins based on VAAPI
  • Deep Learning models converted from training frameworks TensorFlow*, Caffe* etc. from Open Model Zoo (OMZ)
  • The following elements in the Pipeline Framework repository:
Element Description
gvadetect Performs object detection on a full-frame or region of interest (ROI) using object detection models such as YOLOv4-v11, MobileNet SSD, Faster-RCNN etc. Outputs the ROI for detected objects.
gvaclassify Performs object classification. Accepts the ROI as an input and outputs classification results with the ROI metadata.
gvainference Runs deep learning inference on a full-frame or ROI using any model with an RGB or BGR input.
gvatrack Performs object tracking using zero-term, or imageless tracking algorithms. Assigns unique object IDs to the tracked objects.
gvaaudiodetect Performs audio event detection using AclNet model.
gvaattachroi Adds user-defined regions of interest to perform inference on, instead of full frame.
gvafpscounter Measures frames per second across multiple streams in a single process.
gvametaaggregate Aggregates inference results from multiple pipeline branches
gvametaconvert Converts the metadata structure to the JSON format.
gvametapublish Publishes the JSON metadata to MQTT or Kafka message brokers or files.
gvapython Provides a callback to execute user-defined Python functions on every frame. Can be used for metadata conversion, inference post-processing, and other tasks.
gvawatermark Overlays the metadata on the video frame to visualize the inference results.

For the details of supported platforms, please refer to System Requirements section.

For installing Pipeline Framework with the prebuilt binaries or Docker* or to build the binaries from the open source, please refer to Intel® DL Streamer Pipeline Framework installation guide

New in this Release

Title High-level description
LVM support Support for Large Vision Models
LVM support Sample demonstrating image embedding extraction with Visual Transformer (LVM)
OpenVINO 2025.0 support Update to the latest version of OpenVINO
GStreamer 1.24.12 support Update GStreamer to 1.24.12 version
Updated NPU driver Updated NPU driver to 1.13.0 version.
Documentation updates Documentation how to convert from DeepStream to Deep Learning Steamer

Known Issues

Issue Issue Description
VAAPI memory with decodebin If you are using decodebin in conjunction with vaapi-surface-sharing preprocessing backend you should set caps filter using "video/x-raw(memory:VASurface)" after decodebin to avoid issues with pipeline initialization
Artifacts on sycl_meta_overlay Running inference results visualization on GPU via sycl_meta_overlay may produce some partially drawn bounding boxes and labels
Preview Architecture 2.0 Samples Preview Arch 2.0 samples have known issues with inference results
Sporadic hang on vehicle_pedestrian_tracking_20_cpu sample Using Tiger Lake CPU to run this sample may lead to sporadic hang at 99.9% of video processing, rerun the sample as W/A or use GPU instead
Simplified installation process for option 2 via script In certain configurations, users may encounter visible errors
Error when using legacy YoloV5 models: Dynamic resize: Model width dimension shall be static To avoid the issue, modify samples/download_public_models.sh by inserting the following snippet at lines 273 and 280:

python3 - <<EOF "${MODEL_NAME}"
import sys, os
from openvino.runtime import Core
from openvino.runtime import save_model
model_name = sys.argv[1]
core = Core()
os.rename(f"{model_name}_openvino_model", f"{model_name}_openvino_modelD")
model = core.read_model(f"{model_name}_openvino_modelD/{model_name}.xml")
model.reshape([-1, 3, 640, 640])

System Requirements

Please refer to Intel® DL Streamer documentation.

Installation Notes

There are several installation options for Pipeline Framework:

  1. Install Pipeline Framework from pre-built Debian packages
  2. Build Docker image from docker file and run Docker image
  3. Build Pipeline Framework from source code

For more detailed instructions please refer to Intel® DL Streamer Pipeline Framework installation guide.

Samples

The samples folder in Intel® DL Streamer Pipeline Framework repository contains command line, C++ and Python examples.

Legal Information

Intel technologies’ features and benefits depend on system configuration and may require enabled hardware, software, or service activation. Learn more at intel.com, or from the OEM or retailer.

No computer system can be absolutely secure. Intel does not assume any liability for lost or stolen data or systems or any damages resulting from such losses.

You may not use or facilitate the use of this document in connection with any infringement or other legal analysis concerning Intel products described herein. You agree to grant Intel a non-exclusive, royalty-free license to any patent claim thereafter drafted which includes subject matter disclosed herein.

No license (express or implied, by estoppel or otherwise) to any intellectual property rights is granted by this document.

Intel disclaims all express and implied warranties, including without limitation, the implied warranties of merchantability, fitness for a particular purpose, and non-infringement, as well as any warranty arising from course of performance, course of dealing, or usage in trade.

This document contains information on products, services and/or processes in development. All information provided here is subject to change without notice. Contact your Intel representative to obtain the latest forecast, schedule, specifications and roadmaps.

The products and services described may contain defects or errors which may cause deviations from published specifications. Current characterized errata are available on request.

Intel, the Intel logo, and Xeon are trademarks of Intel Corporation in the U.S. and/or other countries.

FFmpeg is an open source project licensed under LGPL and GPL. See https://www.ffmpeg.org/legal.html. You are solely responsible for determining if your use of FFmpeg requires any additional licenses. Intel is not responsible for obtaining any such licenses, nor liable for any licensing fees due, in connection with your use of FFmpeg.

GStreamer is an open source framework licensed under LGPL. See https://gstreamer.freedesktop.org/documentation/frequently-asked-questions/licensing.html. You are solely responsible for determining if your use of GStreamer requires any additional licenses. Intel is not responsible for obtaining any such licenses, nor liable for any licensing fees due, in connection with your use of GStreamer.

*Other names and brands may be claimed as the property of others.

© 2025 Intel Corporation.