Skip to content

[OVEP][NPU]compile model will hang all the time and never return when running model florence-2-base-vision-encoder-fp16 with OpenVINO-NPU #26643

@qwu16

Description

@qwu16

Describe the issue

When running florence-2-base-vision-encoder-fp16 model with onnxruntime_perf_test tool OpenVINO-NPU, it will hang in core.compile_model in https://github.com/microsoft/onnxruntime/blob/main/onnxruntime/core/providers/openvino/ov_interface.cc#L165 and never return, which blocks the program to run

To reproduce

  1. Build onnxruntime code with "--use_openvino" flag
  2. Download florence-2-base-vision-encoder-fp16 from https://huggingface.co/onnx-community/Florence-2-base/blob/main/onnx/vision_encoder_fp16.onnx
  3. Run command "onnxruntime_perf_test.exe -I -r 50 -e openvino -i "device_type|NPU" -f batch_size:1 -f height:768 -f width:768 vision_encoder_fp16.onnx"

Urgency

No response

Platform

Windows

OS Version

Win11

ONNX Runtime Installation

Built from Source

ONNX Runtime Version or Commit ID

977efe4

ONNX Runtime API

C++

Architecture

X64

Execution Provider

OpenVINO

Execution Provider Library Version

OpenVINO 2025.3

Metadata

Metadata

Assignees

No one assigned

    Labels

    ep:OpenVINOissues related to OpenVINO execution provider

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions