Skip to content

not support qwen2.5-omni #1448

@legend-7-7

Description

@legend-7-7

(.venv) PS C:\Users\aiouya\PycharmProjects\PythonProject3> optimum-cli export openvino `

--model "./Qwen2.5-Omni-7B" --task text-generation
--weight-format int8 --trust-remote-code
"./qwen2_5_text_ir"
C:\Users\aiouya\PycharmProjects\PythonProject3.venv\Lib\site-packages\torch\onnx_internal\registration.py:162: OnnxExporterWarning: Symbolic function 'aten::scaled_dot_product_attention' already registered for opset 14. Replacing the existing function with new function. This is unexpected. Please report it on https://github.com/pytorch/pytorch/issues.
warnings.warn(
Unrecognized keys in rope_scaling for 'rope_type'='default': {'mrope_section'}
Traceback (most recent call last):
File "", line 198, in run_module_as_main
File "", line 88, in run_code
File "C:\Users\aiouya\PycharmProjects\PythonProject3.venv\Scripts\optimum-cli.exe_main
.py", line 6, in
File "C:\Users\aiouya\PycharmProjects\PythonProject3.venv\Lib\site-packages\optimum\commands\optimum_cli.py", line 208, in main
service.run()
File "C:\Users\aiouya\PycharmProjects\PythonProject3.venv\Lib\site-packages\optimum\commands\export\openvino.py", line 577, in run
main_export(
File "C:\Users\aiouya\PycharmProjects\PythonProject3.venv\Lib\site-packages\optimum\exporters\openvino_main
.py", line 267, in main_export
raise ValueError(
ValueError: Trying to export a qwen2_5_omni model, that is a custom or unsupported architecture, but no
custom export configuration was passed as custom_export_configs. Please refer to https://huggingface
.co/docs/optimum/main/en/exporters/onnx/usage_guides/export_a_model#custom-export-of-transformers-model
s for an example on how to export custom models. Please open an issue at https://github.com/huggingface
/optimum-intel/issues if you would like the model type qwen2_5_omni to be supported natively in the OpenVINO export.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions