Sink for Sd card

[deepakkumarbinwal]

Checklist

• Checked the issue tracker for similar issues to ensure this is not a duplicate.
• Provided a clear description of your suggestion.
• Included any relevant context or examples.

Issue or Suggestion Description

Can we use following method to capture audio + video-

1. WebRTC streaming = sink 0
2. Pedestrian detection = sink 1
3. SD card recorder = sink 2

I want to record video+audio continuously inside SD card too with all other

[TempoTian]

Currently, the number of sinks is limited by a built-in configuration (limited to 2). For simplicity and typical usage, two sinks should be sufficient:
Sink 0: H.264 video + AAC audio + Muxer (used for streaming/WebRTC)
Sink 1: RGB565 video + Opus audio (used for analytics such as pedestrian detection)

Examples of combined use cases:
Acquire Sink 0 video + Sink 1 audio → for WebRTC transmission
Acquire Sink 1 video → for vision tasks like pedestrian detection

This configuration minimizes resource usage while providing enough flexibility for media streaming and simultaneous local processing.
However, it is important to properly release unused media when certain features are disabled to avoid block for unused.

flowchart TD
    A[Capture System] --> B[Video Source]
    A --> C[Audio Source]

    B --> D[Video Encoder H264]
    C --> E[Audio EncoderAAC]
    D --> F[Sink 0 Video]
    E --> G[Sink 0 Audio]
    F & G --> H[Muxer Output]

    B --> I[RGB565 Converter]
    C --> J[Audio Encoder - Opus]
    I --> K[Sink 1 Video]
    J --> L[Sink 1 Audio]

    K --> M[Pedestrian Detection]
    D & L --> N[WebRTC Stream]

Loading