-
Notifications
You must be signed in to change notification settings - Fork 145
Description
(.venv) PS C:\Users\aiouya\PycharmProjects\PythonProject3> optimum-cli export openvino `
--model "./Qwen2.5-Omni-7B"
--task text-generation
--weight-format int8--trust-remote-code
"./qwen2_5_text_ir"
C:\Users\aiouya\PycharmProjects\PythonProject3.venv\Lib\site-packages\torch\onnx_internal\registration.py:162: OnnxExporterWarning: Symbolic function 'aten::scaled_dot_product_attention' already registered for opset 14. Replacing the existing function with new function. This is unexpected. Please report it on https://github.com/pytorch/pytorch/issues.
warnings.warn(
Unrecognized keys inrope_scaling
for 'rope_type'='default': {'mrope_section'}
Traceback (most recent call last):
File "", line 198, in run_module_as_main
File "", line 88, in run_code
File "C:\Users\aiouya\PycharmProjects\PythonProject3.venv\Scripts\optimum-cli.exe_main.py", line 6, in
File "C:\Users\aiouya\PycharmProjects\PythonProject3.venv\Lib\site-packages\optimum\commands\optimum_cli.py", line 208, in main
service.run()
File "C:\Users\aiouya\PycharmProjects\PythonProject3.venv\Lib\site-packages\optimum\commands\export\openvino.py", line 577, in run
main_export(
File "C:\Users\aiouya\PycharmProjects\PythonProject3.venv\Lib\site-packages\optimum\exporters\openvino_main.py", line 267, in main_export
raise ValueError(
ValueError: Trying to export a qwen2_5_omni model, that is a custom or unsupported architecture, but no
custom export configuration was passed ascustom_export_configs
. Please refer to https://huggingface
.co/docs/optimum/main/en/exporters/onnx/usage_guides/export_a_model#custom-export-of-transformers-model
s for an example on how to export custom models. Please open an issue at https://github.com/huggingface
/optimum-intel/issues if you would like the model type qwen2_5_omni to be supported natively in the OpenVINO export.