Skip to content

[Task]: OpenVINO Matcher Model on Intel GPUS #838

@rajeshgangireddy

Description

@rajeshgangireddy

Description

Currently, there are some issues with exported OpenVINO Matcher model on Intel GPU. Possibles causes are the decoder (where there is a loop for categories) or the BidirectionalPromptGenerator

Component

Library (instantlearn Framework)

Acceptance Criteria

  • Matcher openvino works with FP32, FP16 and INT8
  • Works either as a Monolithic or two part model on intel GPUs

Implementation Notes

No response

Parent Epic

#756

No response

Dependencies

No response

Metadata

Metadata

Labels

librarygetiprompt library related work

Type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions