[NPUW] Fix failsafe port mapping for imported NPUW-cached models#35635
Open
OrestChura wants to merge 3 commits intoopenvinotoolkit:masterfrom
Open
[NPUW] Fix failsafe port mapping for imported NPUW-cached models#35635OrestChura wants to merge 3 commits intoopenvinotoolkit:masterfrom
OrestChura wants to merge 3 commits intoopenvinotoolkit:masterfrom
Conversation
- map failsafe wrapper ports to inner compiled-model ports by (is_output, idx) - use the mapped inner ports in infer(), get_tensor(), and set_tensor() - add require_port() helper to ov::npuw::failsafe::InferRequest
The test: - Simulates a restored inner compiled model whose input and output names differ from the outer failsafe wrapper model. - Verifies that failsafe still accepts outer set_tensor calls, runs infer, and returns the expected tensors and values. - Ensures port mapping relies on input/output side and index, not reconstructed friendly names. - Guards against the cached model regression where a restored inner request fails with “Cannot find tensor for port ...”.
Contributor
So how can this be possible? They're all compiled from the same source IR? |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Details:
map failsafe wrapper ports to inner compiled-model ports by (is_output, idx)
(implemented in a new method
ov::npuw::failsafe::InferRequest::map_to_inner_port_locked())ov::npuw::accuracy_checked::InferRequestuse the mapped inner ports in
infer(),get_tensor(), andset_tensor()add
require_port()helper forov::npuw::failsafe::InferRequestAdd regression test for failsafe imported-port remapping which
Tickets:
AI Assistance: