Skip to content

Adding multi_specializations_frames#909

Open
mohiso22 wants to merge 10 commits intoquic:mainfrom
mohiso22:qwen_multi
Open

Adding multi_specializations_frames#909
mohiso22 wants to merge 10 commits intoquic:mainfrom
mohiso22:qwen_multi

Conversation

@mohiso22
Copy link
Copy Markdown
Contributor

@mohiso22 mohiso22 commented Apr 7, 2026

Adds multi-specialization support for Qwen2.5-VL and Qwen3-VL, enabling the vision encoder to be compiled with multiple resolution configurations (height/width/num_frames as lists) in one shot.
Introduces a dedicated _generate_multi_frame_specialization inference path that selects the right specialization at runtime, along with example scripts for both model families.

@mohiso22 mohiso22 requested review from quic-rishinr and vbaddi April 7, 2026 04:20
@vbaddi
Copy link
Copy Markdown
Contributor

vbaddi commented Apr 7, 2026

@mohiso22 can you fix the quickcheck pls?

Mohit Soni added 2 commits April 7, 2026 09:29
Signed-off-by: Mohit Soni <mohisoni@qti.qualcomm.com>
Signed-off-by: Mohit Soni <mohisoni@qti.qualcomm.com>
Mohit Soni added 2 commits April 8, 2026 11:16
Signed-off-by: Mohit Soni <mohisoni@qti.qualcomm.com>
Signed-off-by: Mohit Soni <mohisoni@qti.qualcomm.com>

def _generate_multi_frame_specialization(
self,
inputs: List[str] = None,
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: update the type annotation for inputs as inputs: Dict[str, torch.Tensor]

Mohit Soni added 5 commits April 9, 2026 09:28
Signed-off-by: Mohit Soni <mohisoni@qti.qualcomm.com>
Signed-off-by: Mohit Soni <mohisoni@qti.qualcomm.com>
Signed-off-by: Mohit Soni <mohisoni@qti.qualcomm.com>
Signed-off-by: Mohit Soni <mohisoni@qti.qualcomm.com>
Signed-off-by: Mohit Soni <mohisoni@qti.qualcomm.com>
@mohiso22 mohiso22 marked this pull request as ready for review April 9, 2026 14:27
Signed-off-by: Mohit Soni <mohisoni@qti.qualcomm.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants