Skip to content

[AUTO] Check if actual device cached blob exists before model compilation #29636

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 11 commits into
base: master
Choose a base branch
from
Open

[AUTO] Check if actual device cached blob exists before model compilation #29636

wants to merge 11 commits into from
+134 −88

Conversation

yangwang201911
Copy link
Contributor

@yangwang201911 yangwang201911 commented Mar 24, 2025 •
edited
Loading

Details:

  • Enable AUTO to check if cache blob existed at the beginning of compilation.
  • Disable startup fallback and runtime fallback if any cache blob existed for actual device
  • Add an new property for AUTO to indicate whether the core is querying the cache ability from virtual device.

Tickets:

@yangwang201911
1. enable AUTO to check if cache blob existed at the beginning of com…
1edcf0b 
…pilation.

2. Add an new property to indicate whether the core is quering the cache ability from virtual device.
@yangwang201911
update.
3e27f3a
@yangwang201911
update.
7290faa
@yangwang201911
update.
39ae1b7
@github-actions github-actions bot added category: inference OpenVINO Runtime library - Inference category: samples OpenVINO Runtime Samples category: AUTO OpenVINO AUTO device selection plugin category: CPP API OpenVINO CPP API bindings and removed category: samples OpenVINO Runtime Samples labels Mar 24, 2025
@wangleis wangleis self-requested a review March 31, 2025 04:20
@yangwang201911
1. Remove the added property that indicates whether the core is check…
64afe60 
…ing the cache ability from AUTO plugin.

2. update the test cases of caching model for AUTO when cache is enabled by user.
@yangwang201911
update.
3f323fa
@github-actions github-actions bot removed the category: CPP API OpenVINO CPP API bindings label Apr 14, 2025
@yangwang201911
Merge branch 'master' into yang/enable_checking_if_actual_device_cach…
6d6c441 
…ed_blob_exists_before_model_compilation_in_AUTO
@yangwang201911 yangwang201911 marked this pull request as ready for review April 14, 2025 08:29
@yangwang201911 yangwang201911 requested review from a team as code owners April 14, 2025 08:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@peterchen-intel peterchen-intel Awaiting requested review from peterchen-intel

@songbell songbell Awaiting requested review from songbell

@wangleis wangleis Awaiting requested review from wangleis

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
category: AUTO OpenVINO AUTO device selection plugin category: inference OpenVINO Runtime library - Inference do not merge do_not_merge do_not_review
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@yangwang201911