Skip to content

[TEST] QWen3 MOE exploration #30269

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
wants to merge 32 commits into
base: master
Choose a base branch
from
Draft

[TEST] QWen3 MOE exploration #30269

wants to merge 32 commits into from
+6,467 −82

Conversation

luo-cheng2021
Copy link
Contributor

Details:

  • item1
  • ...

Tickets:

  • ticket-id

luo-cheng2021 and others added 30 commits April 8, 2025 09:29
@luo-cheng2021
add perf
aa10cbe
@luo-cheng2021
perf for sdpa/pa
3a80081
@luo-cheng2021
add git ignore
d209f03
@luo-cheng2021
insert if for moe expert
45bf16e
@luo-cheng2021
add moeexpert support
795e323
@luo-cheng2021
fix moexpert precision is always f32
d7f2602
@luo-cheng2021
add moeexpert support for gpu
7f4b901
@luo-cheng2021
opt: 1, simplify subgraph inside moeexpert; 2, only compute skip flag…
76a7d5b 
… when expert_no == 0 for gpu
@luo-cheng2021
opt: remove nonzero->split from subgraph into moeexpert for gpu
6079269
@riverlijunjie @luo-cheng2021
Support Qwen3 rms kernel for input with dynamic padding
c385c8f
@riverlijunjie @luo-cheng2021
Add test case
ada754a
@luo-cheng2021
WA: moe_expert wait all inputs ready
38ded44
@luo-cheng2021
fix incorrect output shape computation
f84303e
@luo-cheng2021
add fast path for expert mask computation if no padding
df0ca20
@riverlijunjie @usstq
qwen3 moe compile model opt, from 150s to 70s in LNL (#66)
00e7d9a 
* Build Subgraph in parallel to improve compile_model performance

* SharedOpOptimization optimizes attribute visit

---------

Co-authored-by: Tingqian Li <[email protected]>
@ceciliapeng2011
Move FuseMoeExpert2 ahead of CommonOptimizations to decrease compilin…
019262b 
…g time.
@luo-cheng2021
not use subgraph for moeexpert
994c094
@luo-cheng2021
fix scale/zp layout; first expert should not be inplace
22c93ee
@luo-cheng2021
merge all experts into one op
7c872a0
@riverlijunjie
Optimize gather and index_add performance
75b9683
@luo-cheng2021
fix out_of_resource error on lunarlake
2d8eb4e
@riverlijunjie
Move weigts from usm_host to usm_device memory
06e436c
@riverlijunjie
Add ITT for MoE
02f2331
@riverlijunjie
Optimize BMG first token due to index_add kernel
b6b5f1d
@luo-cheng2021
opt: merge all experts into one for batch1
9383141
@luo-cheng2021
opt: cl code for mlp_*
c7ef4ea
@luo-cheng2021
change weight back to ba
76e6ed7
@luo-cheng2021
small tune for lunarlake
8471f6b
@luo-cheng2021
fuse onehot into moe
818ba1b
@luo-cheng2021
not wait gpu for batch1
eed40eb
@github-actions github-actions bot added category: GPU OpenVINO GPU plugin category: CPU OpenVINO CPU plugin category: build OpenVINO cmake script / infra category: transformations OpenVINO Runtime library - Transformations no-match-files labels Apr 22, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
category: build OpenVINO cmake script / infra category: CPU OpenVINO CPU plugin category: GPU OpenVINO GPU plugin category: transformations OpenVINO Runtime library - Transformations do_not_merge do_not_review no-match-files
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@luo-cheng2021 @riverlijunjie @ceciliapeng2011 @usstq