Commit 603d66f
Change input shape for 3D position_ids of Qwen 2.5 VL with M-RoPE (openvinotoolkit#3400)
The analysis has shown that the correct shape for the 3D position_ids
tensor of Qwen 2.5 VL in the ContinuousBatching mode is not flattening,
but [3, total_token_num]. It allows to preserve the correct 3D semantics
for M-RoPE of the model. Instead of Reshaping on the transformation
side, it is correct and logical to provide proper tensor from the GenAI
side.
- Ticket:
[CVS-167316](https://jira.devtools.intel.com/browse/CVS-167316)
Signed-off-by: Andrii Staikov <andrii.staikov@intel.com>
---------
Co-authored-by: Yaroslav Tarkan <yaroslav.tarkan@intel.com>1 parent 0e5f39c commit 603d66f
File tree
2 files changed
+7
-7
lines changed- src/cpp/src
- continuous_batching
- visual_language
2 files changed
+7
-7
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
514 | 514 | | |
515 | 515 | | |
516 | 516 | | |
517 | | - | |
518 | | - | |
519 | | - | |
| 517 | + | |
| 518 | + | |
| 519 | + | |
| 520 | + | |
| 521 | + | |
520 | 522 | | |
521 | 523 | | |
522 | 524 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
637 | 637 | | |
638 | 638 | | |
639 | 639 | | |
640 | | - | |
| 640 | + | |
641 | 641 | | |
642 | 642 | | |
643 | | - | |
644 | | - | |
645 | | - | |
| 643 | + | |
646 | 644 | | |
647 | 645 | | |
648 | 646 | | |
| |||
0 commit comments