Skip to content

[core] Make IAsyncInferRequest more customizable #29809

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 3 commits into
base: master
Choose a base branch
from
Open

[core] Make IAsyncInferRequest more customizable #29809

wants to merge 3 commits into from
+596 −227

Conversation

praasz
Copy link
Contributor

@praasz praasz commented Mar 28, 2025

Details:

Tickets:

@praasz
Extract async infer request state machine
667a643 
- the state machine can be customized by plugin

Signed-off-by: Raasz, Pawel <[email protected]>
@praasz praasz added WIP work in progress do_not_review labels Mar 28, 2025
@praasz praasz requested review from a team as code owners March 28, 2025 11:33
@github-actions github-actions bot added category: inference OpenVINO Runtime library - Inference category: AUTO OpenVINO AUTO device selection plugin labels Mar 28, 2025
@praasz praasz added do_not_merge and removed category: inference OpenVINO Runtime library - Inference category: AUTO OpenVINO AUTO device selection plugin labels Mar 28, 2025
@praasz praasz requested a review from maxnick March 28, 2025 11:33
@github-actions github-actions bot added category: inference OpenVINO Runtime library - Inference category: AUTO OpenVINO AUTO device selection plugin labels Apr 1, 2025
@praasz praasz removed the WIP work in progress label Apr 2, 2025
@praasz praasz changed the title [WIP][core] Make IAsyncInferRequest more customizable [core] Make IAsyncInferRequest more customizable Apr 2, 2025
@ilya-lavrenov
Copy link
Contributor

is it just a refactoring?
I hope you have not changed any logic, because we spend a lot of time to make it robust back in 2020-2022

@praasz
Copy link
Contributor Author

praasz commented Apr 9, 2025

is it just a refactoring? I hope you have not changed any logic, because we spend a lot of time to make it robust back in 2020-2022

The refactoring is done to make some part more configurable (and no regression), but is still under testing so final version may be different if there will be any benefit.
I will have in mind to doble check the logic to avoid regression (or revert not required changes) but during tests I current test can detect logic issues.

@ilya-lavrenov
Copy link
Contributor

is it just a refactoring? I hope you have not changed any logic, because we spend a lot of time to make it robust back in 2020-2022

The refactoring is done to make some part more configurable (and no regression), but is still under testing so final version may be different if there will be any benefit. I will have in mind to doble check the logic to avoid regression (or revert not required changes) but during tests I current test can detect logic issues.

I would split code movement / refactoring and logic change if possible.

@praasz
Copy link
Contributor Author

praasz commented Apr 22, 2025

Can be closed after merge of PR #29777

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@maxnick maxnick Awaiting requested review from maxnick

At least 1 approving review is required to merge this pull request.

Assignees

@maxnick maxnick

Labels
category: AUTO OpenVINO AUTO device selection plugin category: inference OpenVINO Runtime library - Inference do_not_merge do_not_review
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@praasz @ilya-lavrenov @maxnick