Skip to content

[ML]Unsupported ops error while using RKNN. #17098

@yoni13

Description

@yoni13

I have searched the existing issues, both open and closed, to make sure this is not a duplicate report.

  • Yes

The bug

While trying to use XLM-Roberta-Base-ViT-B-32__laion5b_s13b_b90k on RK3566

E RKNN: [00:39:42.701] Unsupport CPU op: CumSum in this librknnrt.so, please try to register custom op by calling rknn_register_custom_ops or If using rknn, update to the latest toolkit2 and runtime from: https://console.zbox.filez.com/l/I00fc3 (PWD: rknn). If using rknn-llm, update from: https://github.com/airockchip/rknn-llm

We can either dont ship these models and throw error while exporting or add a custom op

Custom OP Example

The OS that Immich Server is running on

Debian GNU/Linux 12 (bookworm) aarch64

Version of Immich Server

related to ML

Version of Immich Mobile App

related to ML

Platform with the issue

  • Server
  • Web
  • Mobile

Your docker-compose.yml content

<default with rknn enabled>

Your .env content

<default with TZ>

Reproduction steps

1.Use RKNN for ML
2.Change Model to XLM-Roberta-Base-ViT-B-32__laion5b_s13b_b90k
3. Rerun smart search
4. Search something in search bar
...

Relevant log output

E RKNN: [00:39:42.701] Unsupport CPU op: CumSum in this librknnrt.so, please try to register custom op by calling rknn_register_custom_ops or If using rknn, update to the latest toolkit2 and runtime from: https://console.zbox.filez.com/l/I00fc3 (PWD: rknn). If using rknn-llm, update from: https://github.com/airockchip/rknn-llm

Additional information

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    Status

    To triage

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions