MiniCPMO MAX_TRANSFORMERS_VERSION

[RyanMetcalfeInt8]

It's a well-known issue that openbmb/MiniCPM-o-2_6 only works with transformers versions up to 4.51.3, hence the MAX_TRANSFORMERS_VERSION defined here:

optimum-intel/optimum/exporters/openvino/model_configs.py

Line 2711 in a484bc6

MAX_TRANSFORMERS_VERSION = "4.51.3"

In our case we have a patched variant of openbmb/MiniCPM-o-2_6 which resolves the issues for transformers > 4.51.3, but are unable to attempt the export due to this check.

Is there a way that we can override or disable the version checks? If not, it would be nice to have such a mechanism.

[RyanMetcalfeInt8]

Can anyone help here?

[echarlaix]

Hi @RyanMetcalfeInt8, apologies for the delay! Have you tried providing a custom_export_configs when exporting your model with main_export

optimum-intel/optimum/exporters/openvino/__main__.py

Line 180 in 132f70d

custom_export_configs: Optional[Dict[str, "OnnxConfig"]] = None,

(for which you could set any MAX_TRANSFORMERS_VERSION). An other option could be to introduce a parameter to diable this check in

optimum-intel/optimum/exporters/openvino/convert.py

Line 190 in 132f70d