[Config Support]: Recordings with Audio only, Live view is with video

[xNUTx]

Describe the problem you are having

As the title says. I believe it worked fine until my last update to the recent version, running in a docker container.

Recordings made have sound only. No video (the video 'track' is empty). But using the same stream for live viewing works fine, including video.

There is no error logged. I believe there is something misconfigured, but for the love of me, I can't figure out what!!

Version

0.16.2-4d58206

Frigate config file

tls:
  enabled: false

mqtt:
  enabled: true
  host: 192.168.XX.2
  port: 1883
  topic_prefix: frigate
  client_id: frigate
  user: XX
  password: XX

detectors:
  coral:
    type: edgetpu
    device: pci

ffmpeg:
  global_args: -hide_banner -loglevel warning -threads 2
  hwaccel_args: auto
  input_args: preset-rtsp-generic
  output_args:
    detect: -threads 2 -f rawvideo -pix_fmt yuv420p
    record: preset-record-generic-audio-aac
    
detect:
  enabled: true
  width: 1280
  height: 720
  fps: 5
  min_initialized: 2
  max_disappeared: 25
  stationary:
    interval: 50
    threshold: 50
    max_frames:
      default: 3000
      objects:
        person: 1000
  annotation_offset: 0

snapshots:
  enabled: true
  clean_copy: true
  timestamp: false
  bounding_box: true

record:
  enabled: true
  retain:
    days: 3
    mode: all
  alerts:
    retain:
      days: 21
  detections:
    retain:
      days: 7

go2rtc:
  streams:
    D01_Main:
      - "ffmpeg:rtsp://admin:[email protected]:554/stream1"
      - "ffmpeg:D01_Main#audio=copy"
    D01_Sub:
      - "ffmpeg:rtsp://admin:[email protected]:554/stream2"
    D02_Main:
      - "ffmpeg:rtsp://admin:[email protected]:554/stream1"
      - "ffmpeg:D02_Main#audio=copy"
    D02_Sub:
      - "ffmpeg:rtsp://admin:[email protected]:554/stream2"
  webrtc:
    candidates:
      - 192.168.XX.12:8555
      - stun:8555

cameras:
  D01:
    enabled: true
    ffmpeg:
      output_args:
        record: preset-record-generic-audio-aac
      inputs:
        - path: rtsp://127.0.0.1:8554/D01_Main
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/D01_Sub
          input_args: preset-rtsp-restream
          roles:
            - detect
    live:
      streams:
        D01_Main: D01_Main
    motion:
      mask:
        - 0,0,0.338,0,0.403,1,0,1
        - 0.68,0.003,0.999,0.004,1,0.335
        - 0.751,0.933,0.991,0.932,0.993,0.971,0.752,0.972
    zones:
      Fietspad_en_weg:
        coordinates: 0.677,0,1,0.354,1,0
        loitering_time: 0
      Parallelweg:
        coordinates: 0.574,0,0.676,0,0.998,0.331,1,0.608
        loitering_time: 0
        inertia: 3
      Parkeerplaatsen:
        coordinates: 0.517,0,0.571,0,1,0.61,0.999,0.997,0.963,0.996
        loitering_time: 0
        inertia: 3
      Stoep:
        coordinates: 0.421,0.003,0.517,0,0.96,1,0.564,1
        loitering_time: 0
      Voordeuren:
        coordinates: 0.421,0,0.339,0.001,0.404,0.997,0.564,0.997
        loitering_time: 0
    review:
      alerts:
        required_zones: Voordeuren
      detections:
        required_zones:
          - Stoep
          - Parkeerplaatsen
          - Parallelweg
          - Fietspad_en_weg
  D02:
    enabled: true
    ffmpeg:
      output_args:
        record: preset-record-generic-audio-aac
      inputs:
        - path: rtsp://127.0.0.1:8554/D02_Main
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/D02_Sub
          input_args: preset-rtsp-restream
          roles:
            - detect
    live:
      streams:
        D02_Main: D02_Main
    motion:
      mask:
        - 0.998,0.003,0.998,0.997,0.684,1,0.668,0.467,0.6,0
        - 0,0.286,0.224,0,0,0
    zones:
      Fietspad_en_weg:
        coordinates: 0.001,0.286,0.225,0.001,0.001,0
        loitering_time: 0
      Parallelweg:
        coordinates: 0.223,0,0.338,0,0,0.544,0.002,0.28
        loitering_time: 0
      Parkeerplaatsen:
        coordinates: 0.338,0,0.413,0,0.032,1,0,1,0,0.54
        loitering_time: 0
      Stoep:
        coordinates: 0.033,1,0.427,1,0.544,0,0.411,0
        loitering_time: 0
        inertia: 3
      Voordeuren:
        coordinates: 0.427,0.997,0.684,0.999,0.67,0.466,0.601,0,0.544,0.001
        loitering_time: 0
        inertia: 3
    review:
      alerts:
        required_zones: Voordeuren
      detections:
        required_zones:
          - Fietspad_en_weg
          - Parallelweg
          - Parkeerplaatsen
          - Stoep
camera_groups:
  Voordeuren:
    order: 1
    icon: LuWebcam
    cameras:
      - D01
      - D02
birdseye:
  enabled: true
  mode: continuous
  layout:
    max_cameras: 1
version: 0.16-0

Relevant Frigate log output

There is no error logged. I believe there is something misconfigured, but for the love of me, I can't figure out what!!

Relevant go2rtc log output

None

Frigate stats

No response

Operating system

Debian

Install method

Proxmox via Docker

docker-compose file or Docker CLI command

version: "3.9"
services:
  frigate:
    container_name: frigate
    privileged: true
    restart: unless-stopped
    image: ghcr.io/blakeblackshear/frigate:stable
    shm_size: "128mb"
    devices:
      - /dev/apex_0:/dev/apex_0
      - /dev/dri/renderD128
    volumes:
      - /etc/localtime:/etc/localtime:ro
      - /opt/frigate/:/config/
      - /opt/frigate/storage:/media/frigate
      - type: tmpfs
        target: /tmp/cache
        tmpfs:
          size: 1000000000
    ports:
      - "5000:5000"
      - "8971:8971"
      - "8554:8554"
      - "8555:8555/tcp"
      - "8555:8555/udp"
      - "1984:1984"
    environment:
      FRIGATE_RTSP_PASSWORD: "XX"

Object Detector

Coral

Screenshots of the Frigate UI's System metrics pages

No response

Any other information that may be helpful

No response

[NickM-27]

Does it keep happening after a reboot? We have only seen this when go2rtc only sends the audio due to a race condition

[xNUTx]

unfortunately, yes.

[inkeep-ai-assistant[bot]]

---

The issue appears to be with your go2rtc stream configuration. Your go2rtc streams are using ffmpeg: sources, which can cause problems when the same stream is referenced multiple times.(1)

Your current go2rtc configuration has:

go2rtc:
  streams:
    D01_Main:
      - "ffmpeg:rtsp://admin:[email protected]:554/stream1"
      - "ffmpeg:D01_Main#audio=copy"

(1)

This creates a circular reference where D01_Main references itself. For RTSP streams, you should configure go2rtc streams differently.(1)(2)

Try this corrected configuration:

go2rtc:
  streams:
    D01_Main:
      - rtsp://admin:[email protected]:554/stream1
      - "ffmpeg:D01_Main#audio=opus"
    D01_Sub:
      - rtsp://admin:[email protected]:554/stream2
    D02_Main:
      - rtsp://admin:[email protected]:554/stream1
      - "ffmpeg:D02_Main#audio=opus"
    D02_Sub:
      - rtsp://admin:[email protected]:554/stream2

(1)(3)

The key changes:

1. Use the direct RTSP URL as the first stream source (without ffmpeg: prefix for RTSP streams)(1)(2)
2. Add a second line that transcodes audio to opus for WebRTC compatibility(3)

For cameras with AAC audio, the recommended configuration includes both the original stream with AAC audio and a transcoded version with opus audio to support both MSE and WebRTC.(3)

If your cameras don't have audio and you're experiencing problems, you should configure go2rtc to send video only:

go2rtc:
  streams:
    D01_Main:
      - ffmpeg:rtsp://admin:[email protected]:554/stream1#video=copy

(3)

After making these changes, restart Frigate and check if recordings now include video.

📚 Sources:

1. Restream
2. Camera Specific Configurations
3. Live View

---

Have another question? Just tag @inkeep.

[xNUTx]

These pointers above by inkeep were previously tested and do not fix the issue, I have been trying to fix it for almost a week now, so I have tried many, MANY things...

[xNUTx]

Also, having the rtsp streams run without ffmpeg does not work at all, no sound and no video being processed that way.

[xNUTx]

The camera main stream config. Keep in mind, this worked fine with a version of frigate and an unmodified config a couple of versions ago... go figure 😕