[HW Accel Support]: Intel Arc380 gpu accel working with ov detector but not onnx #20358

supraway · 2025-10-05T09:20:33Z

supraway
Oct 5, 2025

Describe the problem you are having

I've been having trouble getting hardware acceleration working using the onnx detector with my Intel Arc380 GPU on a system running docker compose.

Previously, Frigate has been working well with verified hardware acceleration (both ffmpeg and detector) and sub- 10ms inference times using YOLO-NAS with openvino. I wanted to give RF-DETR a try (compiled without error on the same machine as Frigate and per wiki instructions) so I updated my config and switched detectors to onnx, and I'm no longer seeing a detector worker in intel_gpu_top, high cpu usage, and 60+ms inference times.

I've tried several combinations detector/model to test things:

yolonas w/ openvino detector - working with GPU acceleration (~10ms inference)
yolonas w/ onnx detector - working without GPU acceleration (~20ms inference)
rf-detr w/ openvino detector - errors out, then frigate restarts.
rf-detr w/ onnx - working without GPU acceleration (~60ms inference)

I also tried all these detector/model combos running frigate in privileged and unprivileged mode in docker compose, and tried preset-vaapi and preset-intel-qsv-h264 without change.

I included the logs for the openvino error (configuration #3 above) hoping maybe that will give some clues. There are no errors with the other configurations, and does confirm "ONNX: /config/model_cache/rfdetr-Nano.onnx loaded".

Version

0.16.1-e664cb2

Frigate config file

######################## MQTT SETTINGS ########################

mqtt:
  enabled: true
  host: xxxxx.local
  port: 1883
  user: xxxxx
  password: xxxxx
  topic_prefix: frigate
  client_id: frigate_client

####################### DETECTOR SETTINGS #########################

# openvino disabled for testing
#detectors:
#  ov:
#    type: openvino
#    device: GPU

detectors:
  onnx:
    type: onnx

############################ AI MODELS ################################

#model:
#  model_type: dfine
#  width: 640
#  height: 640
#  input_tensor: nchw
#  input_dtype: float
#  path: /config/model_cache/dfine_m_obj2coco.onnx
#  labelmap_path: /labelmap/coco-80.txt

model:
  model_type: rfdetr
  width: 320
  height: 320
  input_tensor: nchw
  input_dtype: float
  path: /config/model_cache/rfdetr-Nano.onnx

#model:
#  model_type: yolonas
#  width: 320
#  height: 320
#  input_tensor: nchw
#  input_pixel_format: bgr
#  path: /config/yolo_nas_s.onnx
#  labelmap_path: /labelmap/coco-80.txt

#model:
#  width: 300
#  height: 300
#  input_tensor: nhwc
#  input_pixel_format: bgr
#  path: /openvino-model/ssdlite_mobilenet_v2.xml
#  labelmap_path: /openvino-model/coco_91cl_bkgr.txt

##################### GLOBAL FFMPEG SETTINGS ####################

ffmpeg:
  #hwaccel_args: preset-vaapi
  hwaccel_args: preset-intel-qsv-h264 # Alternate hw accelerator to try if preset-vaapi isn't working
  input_args: preset-rtsp-restream
  output_args:
    record: preset-record-generic-audio-aac

####################### RTC STREAM SETTINGS #########################

go2rtc:
  streams:
    amcrest1:
      - rtsp://{FRIGATE_RTSP_USER}:{FRIGATE_RTSP_PASSWORD}@{FRIGATE_AMCREST1_IP}:554/cam/realmonitor?channel=1&subtype=0
      - ffmpeg:amcrest1#audio=opus
    amcrest1_sub:
      - rtsp://{FRIGATE_RTSP_USER}:{FRIGATE_RTSP_PASSWORD}@{FRIGATE_AMCREST1_IP}:554/cam/realmonitor?channel=1&subtype=1
      - ffmpeg:amcrest1_sub#audio=opus
    amcrest2:
      - rtsp://{FRIGATE_RTSP_USER}:{FRIGATE_RTSP_PASSWORD}@{FRIGATE_AMCREST2_IP}:554/cam/realmonitor?channel=1&subtype=0
      - ffmpeg:amcrest2#audio=opus
    amcrest2_sub:
      - rtsp://{FRIGATE_RTSP_USER}:{FRIGATE_RTSP_PASSWORD}@{FRIGATE_AMCREST2_IP}:554/cam/realmonitor?channel=1&subtype=1
      - ffmpeg:amcrest2_sub#audio=opus
    amcrest3:
      - rtsp://{FRIGATE_RTSP_USER}:{FRIGATE_RTSP_PASSWORD}@{FRIGATE_AMCREST3_IP}:554/cam/realmonitor?channel=1&subtype=0
      - ffmpeg:amcrest3#audio=opus
    amcrest3_sub:
      - rtsp://{FRIGATE_RTSP_USER}:{FRIGATE_RTSP_PASSWORD}@{FRIGATE_AMCREST3_IP}:554/cam/realmonitor?channel=1&subtype=1
      - ffmpeg:amcrest3_sub#audio=opus
    amcrest4:
      - rtsp://{FRIGATE_RTSP_USER}:{FRIGATE_RTSP_PASSWORD}@{FRIGATE_AMCREST4_IP}:554/cam/realmonitor?channel=1&subtype=0
      - ffmpeg:amcrest4#audio=opus
    amcrest4_sub:
      - rtsp://{FRIGATE_RTSP_USER}:{FRIGATE_RTSP_PASSWORD}@{FRIGATE_AMCREST4_IP}:554/cam/realmonitor?channel=1&subtype=1
      - ffmpeg:amcrest4_sub#audio=opus

 # webrtc:
 #   candidates:
 #   - xxxxx.local:8555
 #   - stun:8555

########################### DETECTION AND CAPTURE SETTINGS ###################

record:
  enabled: true
  retain:
    days: 7
    mode: motion
  alerts:
    retain:
      days: 14
    pre_capture: 2
    post_capture: 2
  detections:
    retain:
      days: 14
    pre_capture: 2
    post_capture: 2

snapshots:
  enabled: true
  clean_copy: true
  timestamp: false
  crop: true
  retain:
    default: 14
    objects:
      person: 20

####################### CAMERA - AMCREST 1 ########################

cameras:
  amcrest1:
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/amcrest1
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/amcrest1_sub
          roles:
            - detect
            - audio
    audio:
      enabled: true
      listen:
        - explosion
        - siren
        - scream
        - yell
        - boom
        - gunshot
        - speech
    objects:
      track:
        - person
        - dog
        - cat
    detect:
      enabled: true
      width: 640
      height: 480
      fps: 7
    motion:
      mask: 0.524,0.035,0.526,0.083,0.96,0.085,0.957,0.033
      threshold: 30
      contour_area: 10
      improve_contrast: true
    zones:
      Front_Door:
        coordinates: 0.759,0.478,0.668,1,0.402,1,0.165,0.81,0.354,0.32
        loitering_time: 0
        inertia: 3
        objects: person
      Driveway:
        coordinates: 
          0.362,0,0.222,0,0.107,0.228,0.51,0.378,0.491,0.174,0.39,0.136
        loitering_time: 0
        inertia: 3
      Front_Yard:
        coordinates: 0.091,1,0,1,0,0.44,0.103,0.226,0.35,0.324
        loitering_time: 0
        inertia: 3
      Side_Gate:
        coordinates: 0.397,1,0.094,1,0.164,0.813
        inertia: 3
        loitering_time: 0
        objects: person
    review:
      alerts:
        required_zones:
          - Front_Door
        labels:
          - person
          - explosion
          - scream
          - boom
          - gunshot
      detections:
        labels:
          - person
          - dog
          - cat
          - siren
          - yell
          - speech

####################### CAMERA - AMCREST 2 ########################

  amcrest2:
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/amcrest2
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/amcrest2_sub
          roles:
            - detect
            - audio
    audio:
      enabled: true
      listen:
        - explosion
        - siren
        - scream
        - yell
        - boom
        - gunshot
        - speech
    objects:
      track:
        - person
        - dog
        - cat
    detect:
      enabled: true
      width: 640
      height: 480
      fps: 7
    review:
      alerts:
        required_zones:
          - Front_Door
        labels:
          - person
          - explosion
          - scream
          - boom
          - gunshot
      detections:
        labels:
          - person
          - dog
          - cat
          - siren
          - yell
          - speech
    motion:
      mask: 0.527,0.033,0.528,0.086,0.963,0.087,0.959,0.033
    zones:
      Driveway:
        coordinates: 
          0.365,0.537,0.751,0.251,0.951,0.404,0.817,0.991,0.191,1,0.132,0.687
        loitering_time: 0
        inertia: 3
        objects: person
      Front_Door:
        coordinates: 0.111,0.325,0.096,0.137,0.238,0.227,0.248,0.401
        loitering_time: 0
        objects: person
        inertia: 3
      Front_Yard:
        coordinates: 0.266,0.2,0.506,0.138,0.48,0.277,0.383,0.318
        loitering_time: 0
        inertia: 3
        objects: person

####################### CAMERA - AMCREST 3 ########################
  amcrest3:
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/amcrest3
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/amcrest3_sub
          roles:
            - detect
            - audio
    audio:
      enabled: true
      listen:
        - explosion
        - siren
        - scream
        - yell
        - boom
        - gunshot
        - bark
    objects:
      track:
        - person
        - dog
        - cat
    detect:
      enabled: true
      width: 640
      height: 480
      fps: 7
    review:
      alerts:
        required_zones: Back_Gate
        labels:
          - person
          - explosion
          - scream
          - boom
          - gunshot
      detections:
        labels:
          - person
          - dog
          - cat
          - bark
          - siren
          - yell
        required_zones:
          - Back_Yard
          - Back_Door
          - Back_Gate
    motion:
      mask:
        - 0.53,0.034,0.53,0.083,0.96,0.085,0.96,0.034
        - 0.009,0.215,0.045,0.818,0.138,0.482,0.109,0.177,0.057,0.134
      threshold: 30
      contour_area: 20
      improve_contrast: true
    zones:
      Back_Yard:
        coordinates: 
          0.148,0.505,0.462,0.387,0.604,0.497,0.82,0.354,0.677,0.202,0.4,0.142,0.113,0.156
        loitering_time: 0
        inertia: 3
      Back_Door:
        coordinates: 
          0.605,0.498,0.782,0.651,0.798,0.975,0.897,0.643,0.958,0.425,0.819,0.351
        loitering_time: 0
        inertia: 3
      Hot_Tub:
        coordinates: 
          0.218,1,0.117,0.505,0.461,0.378,0.782,0.655,0.778,0.714,0.592,1
        loitering_time: 0
        objects: person
        inertia: 3
      Back_Gate:
        coordinates: 0.735,0.248,0.745,0.165,0.831,0.205,0.826,0.285
        loitering_time: 0
        objects: person
        inertia: 3


####################### CAMERA - AMCREST 2 ########################

  amcrest4:
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/amcrest4
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/amcrest4_sub
          roles:
            - detect
            - audio
    audio:
      enabled: true
      listen:
        - explosion
        - siren
        - scream
        - yell
        - boom
        - gunshot
        - bark
    objects:
      track:
        - person
        - dog
        - cat
    detect:
      enabled: true
      width: 640
      height: 480
      fps: 7
    review:
      alerts:
        required_zones:
          - Side_Gate
        labels:
          - person
          - explosion
          - scream
          - boom
          - gunshot
      detections:
        labels:
          - person
          - dog
          - cat
          - bark
          - siren
          - yell
    motion:
      mask: 0.527,0.033,0.527,0.083,0.948,0.083,0.948,0.031
    zones:
      Back_Gate:
        coordinates: 0.327,0,0.34,0.11,0.447,0.071,0.443,0
        loitering_time: 0
        objects: person
        inertia: 3
      Side_Yard:
        coordinates: 
          0.116,0.639,0.272,0.511,0.408,0.711,0.729,0.512,0.91,0.334,0.457,0.063,0.38,0.096,0.294,0.136
        loitering_time: 0
        inertia: 3
      Side_Gate:
        coordinates: 0.267,0.519,0.115,0.648,0.253,0.995,0.599,0.999
        loitering_time: 0
        objects: person
        inertia: 3
      Front_Yard:
        coordinates: 0.944,0.443,1,0.648,1,1,0.603,1,0.538,0.903,0.664,0.806
        inertia: 3
        loitering_time: 0

############### MISC GLOBAL SETTINGS #####################

semantic_search:
  enabled: true
  reindex: false
  model_size: large

detect:
  enabled: true

face_recognition:
  enabled: false
  model_size: small

lpr:  # license plate recognition
  enabled: false

classification:
  bird:
    enabled: false

telemetry: # really doesn't work
  stats:
    intel_gpu_device: "drm:/dev/dri/card0"

version: 0.16-0

docker-compose file or Docker CLI command

services:
  frigate:
    container_name: frigate
    privileged: false # test true if things not working
    cap_add:
      - CAP_PERFMON # maybe needed for gpu monitor but not working
    restart: unless-stopped
    image: ghcr.io/blakeblackshear/frigate:0.16.1
    shm_size: "128mb" # Need about 90 mb for 4 cameras @ 640x480
    group_add:
      - "105" # render
    #  - "44" # video - doesn't seem to do anything
    devices:
      - /dev/dri/renderD128:/dev/dri/renderD128
      - /dev/dri/card0:/dev/dri/card0
    volumes:
      - /etc/localtime:/etc/localtime:ro
      - ${APPDATA}/frigate/config:/config
      - ${CAMERAS}:/media/frigate  # SKIP_BACKUP
      - type: tmpfs # Optional: 1GB of memory, reduces SSD/SD Card wear
        target: /tmp/cache
        tmpfs:
          size: 1000000000
    ports:
      # - "1984:1984" # go2rtc interface. Disable unless needed.
      - "8971:8971"
      - "5000:5000" # Internal unauthenticated access. Disable once HA configured.
      - "8554:8554" # RTSP feeds
      # - "8555:8555/tcp" # WebRTC over tcp
      # - "8555:8555/udp" # WebRTC over udp
    environment:
      FRIGATE_RTSP_PASSWORD: "${CAMERA_PASS}"
      FRIGATE_RTSP_USER: "${CAMERA_USER}"
      FRIGATE_AMCREST1_IP: "${AMCREST1_IP}"
      FRIGATE_AMCREST2_IP: "${AMCREST2_IP}"
      FRIGATE_AMCREST3_IP: "${AMCREST3_IP}"
      FRIGATE_AMCREST4_IP: "${AMCREST4_IP}"
      FRIGATE_MQTT_USER: xxxxxx
      FRIGATE_MQTT_PASSWORD: xxxxxx

Relevant Frigate log output

s6-rc: info: service s6rc-fdholder: starting
s6-rc: info: service s6rc-oneshot-runner: starting
s6-rc: info: service s6rc-oneshot-runner successfully started
s6-rc: info: service fix-attrs: starting
s6-rc: info: service s6rc-fdholder successfully started
s6-rc: info: service fix-attrs successfully started
s6-rc: info: service legacy-cont-init: starting
s6-rc: info: service legacy-cont-init successfully started
s6-rc: info: service prepare: starting
s6-rc: info: service log-prepare: starting
s6-rc: info: service log-prepare successfully started
s6-rc: info: service nginx-log: starting
s6-rc: info: service go2rtc-log: starting
s6-rc: info: service frigate-log: starting
s6-rc: info: service certsync-log: starting
s6-rc: info: service nginx-log successfully started
s6-rc: info: service go2rtc-log successfully started
s6-rc: info: service frigate-log successfully started
s6-rc: info: service certsync-log successfully started
s6-rc: info: service prepare successfully started
s6-rc: info: service go2rtc: starting
s6-rc: info: service go2rtc successfully started
s6-rc: info: service go2rtc-healthcheck: starting
s6-rc: info: service frigate: starting
s6-rc: info: service go2rtc-healthcheck successfully started
s6-rc: info: service frigate successfully started
s6-rc: info: service nginx: starting
2025-10-05 03:13:09.394154194  [INFO] Starting NGINX...
2025-10-05 03:13:09.450370887  [INFO] Preparing Frigate...
2025-10-05 03:13:09.722949159  [INFO] Preparing new go2rtc config...
s6-rc: info: service nginx successfully started
s6-rc: info: service certsync: starting
s6-rc: info: service certsync successfully started
s6-rc: info: service legacy-services: starting
2025-10-05 03:13:09.744339349  [INFO] Starting certsync...
s6-rc: info: service legacy-services successfully started
2025-10-05 03:13:09.762504391  [INFO] Starting Frigate...
2025-10-05 03:13:10.010038336  [INFO] Starting go2rtc...
2025-10-05 03:13:10.066483868  03:13:10.066 INF go2rtc platform=linux/amd64 revision=fa580c5 version=1.9.9
2025-10-05 03:13:10.066488048  03:13:10.066 INF config path=/dev/shm/go2rtc.yaml
2025-10-05 03:13:10.066771729  03:13:10.066 INF [rtsp] listen addr=:8554
2025-10-05 03:13:10.066800168  03:13:10.066 INF [api] listen addr=:1984
2025-10-05 03:13:10.067042688  03:13:10.067 INF [webrtc] listen addr=:8555
2025-10-05 03:13:10.082928815  127.0.0.1 - - [05/Oct/2025:03:13:10 -0600] "" 400 0 "-" "-" "-"
2025-10-05 03:13:10.336171248  2025/10/05 03:13:10 [error] 219#219: *2 connect() failed (111: Connection refused) while connecting to upstream, client: 192.168.0.4, server: , request: "GET /ws HTTP/1.1", subrequest: "/auth", upstream: "http://127.0.0.1:5001/auth", host: "mycomputername:5000"
2025-10-05 03:13:10.336187833  2025/10/05 03:13:10 [error] 219#219: *2 auth request unexpected status: 502 while sending to client, client: 192.168.0.4, server: , request: "GET /ws HTTP/1.1", host: "mycomputername:5000"
2025-10-05 03:13:10.336213175  192.168.0.4 - - [05/Oct/2025:03:13:10 -0600] "GET /ws HTTP/1.1" 500 579 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/141.0.0.0 Safari/537.36" "-"
2025-10-05 03:13:11.688844324  [2025-10-05 03:13:11] frigate.util.config            INFO    : Checking if frigate config needs migration...
2025-10-05 03:13:11.720399002  [2025-10-05 03:13:11] frigate.util.config            INFO    : frigate config does not need migration...
2025-10-05 03:13:12.148961318  [2025-10-05 03:13:12] frigate.app                    INFO    : Starting Frigate (0.16.1-e664cb2)
2025-10-05 03:13:12.161062016  [2025-10-05 03:13:12] peewee_migrate.logs            INFO    : Starting migrations
2025-10-05 03:13:12.161373380  [2025-10-05 03:13:12] peewee_migrate.logs            INFO    : There is nothing to migrate
2025-10-05 03:13:12.177649944  [2025-10-05 03:13:12] frigate.app                    INFO    : Recording process started: 461
2025-10-05 03:13:12.184476982  [2025-10-05 03:13:12] frigate.app                    INFO    : Review process started: 474
2025-10-05 03:13:12.186534478  [2025-10-05 03:13:12] frigate.app                    INFO    : go2rtc process pid: 128
2025-10-05 03:13:12.202093331  [2025-10-05 03:13:12] detector.ov                    INFO    : Starting detection process: 486
2025-10-05 03:13:12.203311442  [2025-10-05 03:13:12] frigate.app                    INFO    : Embedding process started: 489
2025-10-05 03:13:12.217803103  [2025-10-05 03:13:12] frigate.app                    INFO    : Output process started: 510
2025-10-05 03:13:12.257109407  [2025-10-05 03:13:12] frigate.app                    INFO    : Camera processor started for amcrest1: 539
2025-10-05 03:13:12.277089139  [2025-10-05 03:13:12] frigate.app                    INFO    : Camera processor started for amcrest2: 568
2025-10-05 03:13:12.286423562  [2025-10-05 03:13:12] frigate.app                    INFO    : Camera processor started for amcrest3: 584
2025-10-05 03:13:12.286883261  [2025-10-05 03:13:12] frigate.app                    INFO    : Camera processor started for amcrest4: 595
2025-10-05 03:13:12.296192392  [2025-10-05 03:13:12] frigate.app                    INFO    : Capture process started for amcrest1: 610
2025-10-05 03:13:12.327978095  [2025-10-05 03:13:12] frigate.app                    INFO    : Capture process started for amcrest2: 642
2025-10-05 03:13:12.336909992  [2025-10-05 03:13:12] frigate.app                    INFO    : Capture process started for amcrest3: 654
2025-10-05 03:13:12.347369198  [2025-10-05 03:13:12] frigate.app                    INFO    : Capture process started for amcrest4: 671
2025-10-05 03:13:12.362651870  INFO: Created TensorFlow Lite XNNPACK delegate for CPU.
2025-10-05 03:13:12.427802147  [2025-10-05 03:13:12] frigate.audio_manager          INFO    : Audio processor started (pid: 688)
2025-10-05 03:13:12.610738269  [2025-10-05 03:13:12] frigate.api.fastapi_app        INFO    : Starting FastAPI app
2025-10-05 03:13:12.734522281  [2025-10-05 03:13:12] frigate.api.fastapi_app        INFO    : FastAPI started
2025-10-05 03:13:13.165003731  Process detector:ov:
2025-10-05 03:13:13.165006633  Traceback (most recent call last):
2025-10-05 03:13:13.165007787    File "/usr/lib/python3.11/multiprocessing/process.py", line 314, in _bootstrap
2025-10-05 03:13:13.165010955      self.run()
2025-10-05 03:13:13.165012355    File "/opt/frigate/frigate/util/process.py", line 41, in run_wrapper
2025-10-05 03:13:13.165013152      return run(*args, **kwargs)
2025-10-05 03:13:13.165025966             ^^^^^^^^^^^^^^^^^^^^
2025-10-05 03:13:13.165027561    File "/usr/lib/python3.11/multiprocessing/process.py", line 108, in run
2025-10-05 03:13:13.165029247      self._target(*self._args, **self._kwargs)
2025-10-05 03:13:13.165030912    File "/opt/frigate/frigate/object_detection/base.py", line 112, in run_detector
2025-10-05 03:13:13.165032466      object_detector = LocalObjectDetector(detector_config=detector_config)
2025-10-05 03:13:13.165033947                        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-10-05 03:13:13.165054518    File "/opt/frigate/frigate/object_detection/base.py", line 57, in __init__
2025-10-05 03:13:13.165055488      self.detect_api = create_detector(detector_config)
2025-10-05 03:13:13.165071654                        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-10-05 03:13:13.165072605    File "/opt/frigate/frigate/detectors/__init__.py", line 18, in create_detector
2025-10-05 03:13:13.165073310      return api(detector_config)
2025-10-05 03:13:13.165073923             ^^^^^^^^^^^^^^^^^^^^
2025-10-05 03:13:13.165074730    File "/opt/frigate/frigate/detectors/plugins/openvino.py", line 50, in __init__
2025-10-05 03:13:13.165075415      self.interpreter = self.ov_core.compile_model(
2025-10-05 03:13:13.165076069                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-10-05 03:13:13.165076978    File "/usr/local/lib/python3.11/dist-packages/openvino/runtime/ie_api.py", line 543, in compile_model
2025-10-05 03:13:13.165089087      super().compile_model(model, device_name, {} if config is None else config),
2025-10-05 03:13:13.165089987      ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-10-05 03:13:13.165090702  RuntimeError: Exception from src/inference/src/cpp/core.cpp:121:
2025-10-05 03:13:13.165091468  Exception from src/inference/src/dev/plugin.cpp:58:
2025-10-05 03:13:13.165092265  Check 'false' failed at src/plugins/intel_gpu/src/plugin/program_builder.cpp:185:
2025-10-05 03:13:13.165092868  [GPU] ProgramBuilder build failed!
2025-10-05 03:13:13.165093645  Exception from src/plugins/intel_gpu/src/graph/include/primitive_type_base.h:59:
2025-10-05 03:13:13.165110700  [GPU] Can't choose implementation for gemm:/transformer/decoder/layers.1/self_attn/Transpose_6 node (type=gemm)
2025-10-05 03:13:13.165111558  [GPU] Original name: /transformer/decoder/layers.1/self_attn/Transpose_6
2025-10-05 03:13:13.165112110  [GPU] Original type: Gemm
2025-10-05 03:13:13.165112887  [GPU] Reason: could not create a primitive descriptor for a matmul primitive
2025-10-05 03:13:13.165113428
2025-10-05 03:13:13.165113847
2025-10-05 03:13:13.165114225
2025-10-05 03:13:13.165114604
2025-10-05 03:13:19.393902529  [INFO] Starting go2rtc healthcheck service...
2025-10-05 03:13:32.595962049  [2025-10-05 03:13:32] frigate.watchdog               INFO    : Detection appears to have stopped. Exiting Frigate...
s6-rc: info: service legacy-services: stopping
s6-rc: info: service legacy-services successfully stopped
s6-rc: info: service go2rtc-healthcheck: stopping
s6-rc: info: service certsync: stopping
2025-10-05 03:13:32.605712101  [INFO] The go2rtc-healthcheck service exited with code 256 (by signal 15)
s6-rc: info: service go2rtc-healthcheck successfully stopped
2025-10-05 03:13:32.606621123  [INFO] Service CERTSYNC exited with code 256 (by signal 15)
s6-rc: info: service certsync successfully stopped
s6-rc: info: service nginx: stopping
s6-rc: info: service certsync-log: stopping
s6-rc: info: service certsync-log successfully stopped
2025-10-05 03:13:32.710890930  [INFO] Service NGINX exited with code 0 (by signal 0)
s6-rc: info: service nginx successfully stopped
s6-rc: info: service nginx-log: stopping
s6-rc: info: service frigate: stopping
s6-rc: info: service nginx-log successfully stopped
2025-10-05 03:13:32.882493326  [2025-10-05 03:13:32] frigate.app                    INFO    : Stopping...
2025-10-05 03:13:32.884598960  [2025-10-05 03:13:32] frigate.storage                INFO    : Exiting storage maintainer...
2025-10-05 03:13:32.886151451  [2025-10-05 03:13:32] frigate.stats.emitter          INFO    : Exiting stats emitter...
2025-10-05 03:13:32.886580158  [2025-10-05 03:13:32] frigate.ptz.autotrack          INFO    : Exiting autotracker...
2025-10-05 03:13:32.887023650  [2025-10-05 03:13:32] frigate.record.cleanup         INFO    : Exiting recording cleanup...
2025-10-05 03:13:32.887380731  [2025-10-05 03:13:32] frigate.events.cleanup         INFO    : Exiting event cleanup...
2025-10-05 03:13:32.887531435  [2025-10-05 03:13:32] frigate.watchdog               INFO    : Exiting watchdog...
2025-10-05 03:13:33.270983565  [2025-10-05 03:13:33] frigate.track.object_processing INFO    : Exiting object processor...
2025-10-05 03:13:33.616409812  [2025-10-05 03:13:33] frigate.events.maintainer      INFO    : Exiting event processor...
2025-10-05 03:13:33.634898963  [2025-10-05 03:13:33] audio.amcrest1                 INFO    : Terminating the existing ffmpeg process...
2025-10-05 03:13:33.635058674  [2025-10-05 03:13:33] audio.amcrest1                 INFO    : Waiting for ffmpeg to exit gracefully...
2025-10-05 03:13:33.772264442  [2025-10-05 03:13:33] audio.amcrest2                 INFO    : Terminating the existing ffmpeg process...
2025-10-05 03:13:33.772497611  [2025-10-05 03:13:33] audio.amcrest2                 INFO    : Waiting for ffmpeg to exit gracefully...
2025-10-05 03:13:33.800694126  [2025-10-05 03:13:33] audio.amcrest3                 INFO    : Terminating the existing ffmpeg process...
2025-10-05 03:13:33.800843236  [2025-10-05 03:13:33] audio.amcrest3                 INFO    : Waiting for ffmpeg to exit gracefully...
2025-10-05 03:13:33.829701982  [2025-10-05 03:13:33] audio.amcrest4                 INFO    : Terminating the existing ffmpeg process...
2025-10-05 03:13:33.829820156  [2025-10-05 03:13:33] audio.amcrest4                 INFO    : Waiting for ffmpeg to exit gracefully...
2025-10-05 03:13:33.884319895  [2025-10-05 03:13:33] frigate.audio_manager          INFO    : Waiting for thread amcrest1_audio_event_processor to exit
2025-10-05 03:13:34.214236063  [2025-10-05 03:13:34] frigate.audio_manager          INFO    : Exiting audio processor
2025-10-05 03:13:34.225976390  [2025-10-05 03:13:34] frigate.ptz.onvif              INFO    : Exiting ONVIF controller...
2025-10-05 03:13:34.226289660  [2025-10-05 03:13:34] frigate.app                    INFO    : Waiting for capture process for amcrest1 to stop
2025-10-05 03:13:34.373759290  [2025-10-05 03:13:34] watchdog.amcrest1              INFO    : Terminating the existing ffmpeg process...
2025-10-05 03:13:34.373890328  [2025-10-05 03:13:34] watchdog.amcrest1              INFO    : Waiting for ffmpeg to exit gracefully...
2025-10-05 03:13:34.543632879  [2025-10-05 03:13:34] watchdog.amcrest1              INFO    : Terminating the existing ffmpeg process...
2025-10-05 03:13:34.543791310  [2025-10-05 03:13:34] watchdog.amcrest1              INFO    : Waiting for ffmpeg to exit gracefully...
2025-10-05 03:13:34.666069188  [2025-10-05 03:13:34] frigate.app                    INFO    : Waiting for capture process for amcrest2 to stop
2025-10-05 03:13:34.743233417  [2025-10-05 03:13:34] watchdog.amcrest2              INFO    : Terminating the existing ffmpeg process...
2025-10-05 03:13:34.743360006  [2025-10-05 03:13:34] watchdog.amcrest2              INFO    : Waiting for ffmpeg to exit gracefully...
2025-10-05 03:13:35.303984698  [2025-10-05 03:13:35] watchdog.amcrest2              INFO    : Terminating the existing ffmpeg process...
2025-10-05 03:13:35.304116750  [2025-10-05 03:13:35] watchdog.amcrest2              INFO    : Waiting for ffmpeg to exit gracefully...
2025-10-05 03:13:35.527948493  [2025-10-05 03:13:35] frigate.app                    INFO    : Waiting for capture process for amcrest3 to stop
2025-10-05 03:13:35.572292337  [2025-10-05 03:13:35] watchdog.amcrest3              INFO    : Terminating the existing ffmpeg process...
2025-10-05 03:13:35.572407026  [2025-10-05 03:13:35] watchdog.amcrest3              INFO    : Waiting for ffmpeg to exit gracefully...
2025-10-05 03:13:35.733812246  [2025-10-05 03:13:35] watchdog.amcrest3              INFO    : Terminating the existing ffmpeg process...
2025-10-05 03:13:35.733934682  [2025-10-05 03:13:35] watchdog.amcrest3              INFO    : Waiting for ffmpeg to exit gracefully...
2025-10-05 03:13:35.907005383  [2025-10-05 03:13:35] frigate.app                    INFO    : Waiting for capture process for amcrest4 to stop
2025-10-05 03:13:35.983100969  [2025-10-05 03:13:35] watchdog.amcrest4              INFO    : Terminating the existing ffmpeg process...
2025-10-05 03:13:35.983239852  [2025-10-05 03:13:35] watchdog.amcrest4              INFO    : Waiting for ffmpeg to exit gracefully...
2025-10-05 03:13:36.299421029  [2025-10-05 03:13:36] watchdog.amcrest4              INFO    : Terminating the existing ffmpeg process...
2025-10-05 03:13:36.299624748  [2025-10-05 03:13:36] watchdog.amcrest4              INFO    : Waiting for ffmpeg to exit gracefully...
2025-10-05 03:13:36.572798263  [2025-10-05 03:13:36] frigate.app                    INFO    : Waiting for process for amcrest1 to stop
2025-10-05 03:13:36.958811515  [2025-10-05 03:13:36] frigate.video                  INFO    : amcrest1: emptying frame queue
2025-10-05 03:13:36.959079636  [2025-10-05 03:13:36] frigate.video                  INFO    : amcrest1: exiting subprocess
2025-10-05 03:13:36.966822180  [2025-10-05 03:13:36] frigate.app                    INFO    : Closing frame queue for amcrest1
2025-10-05 03:13:37.467165658  [2025-10-05 03:13:37] frigate.app                    INFO    : Waiting for process for amcrest2 to stop

Relevant go2rtc log output

N/A

FFprobe output from your camera

N/A

Install method

Docker Compose

Object Detector

Other

Network connection

Wired

Camera make and model

amcrest

Screenshots of the Frigate UI's System metrics pages

Any other information that may be helpful

intel_gpu_top output:

Kernel info:
Linux xxxxxx 6.12.43+deb12-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.12.43-1~bpo12+1 (2025-09-06) x86_64 GNU/Linux

NickM-27 · 2025-10-05T13:31:48Z

NickM-27
Oct 5, 2025
Collaborator Sponsor

This is generally known issue as there is some bug with the onnx runtime. Recommendation for detector is to use openvino, that's what the enrichments do behind the scenes

10 replies

NickM-27 Oct 10, 2025
Collaborator Sponsor

Not sure what you mean, they are the exact same issue

2025-10-05 03:13:13.165112887 [GPU] Reason: could not create a primitive descriptor for a matmul primitive

You should just use yolov9 for now

iambenmitchell Oct 10, 2025

You should just use yolov9 for now

Sorry it's 3AM and I am half asleep trying to debug this as I have 6 cameras arriving tomorrow haha, will use yolov9 thanks.

Should I be using the whole /dev/dri:/dev/dri directory as a mount, or should I be specifying either card1 or renderD128?

thanks again!

NickM-27 Oct 10, 2025
Collaborator Sponsor

easiest just to pass the whole dir

iambenmitchell Oct 10, 2025

Yep that seems to have fixed the issue thanks, maybe the GPU didn't have enough VRAM to load the model or something (A310)

NickM-27 Oct 10, 2025
Collaborator Sponsor

No, it's a model architecture issue

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Uh oh!

[HW Accel Support]: Intel Arc380 gpu accel working with ov detector but not onnx #20358

Uh oh!

{{title}}

Uh oh!

Replies: 1 comment 10 replies

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Select a reply

Uh oh!

Uh oh!

[HW Accel Support]: Intel Arc380 gpu accel working with ov detector but not onnx #20358

Uh oh!

supraway Oct 5, 2025

Describe the problem you are having

Version

Frigate config file

docker-compose file or Docker CLI command

Relevant Frigate log output

Relevant go2rtc log output

FFprobe output from your camera

Install method

Object Detector

Network connection

Camera make and model

Screenshots of the Frigate UI's System metrics pages

Any other information that may be helpful

Replies: 1 comment · 10 replies

Uh oh!

NickM-27 Oct 5, 2025 Collaborator Sponsor

Uh oh!

NickM-27 Oct 10, 2025 Collaborator Sponsor

Uh oh!

iambenmitchell Oct 10, 2025

Uh oh!

NickM-27 Oct 10, 2025 Collaborator Sponsor

Uh oh!

iambenmitchell Oct 10, 2025

Uh oh!

NickM-27 Oct 10, 2025 Collaborator Sponsor

supraway
Oct 5, 2025

Replies: 1 comment 10 replies

NickM-27
Oct 5, 2025
Collaborator Sponsor

NickM-27 Oct 10, 2025
Collaborator Sponsor

NickM-27 Oct 10, 2025
Collaborator Sponsor

NickM-27 Oct 10, 2025
Collaborator Sponsor