qwen3 + tp=32

[michaelbenayoun]

System Info

QKVGQA replication is not working to adapt the state dict.

Who can help?

@michaelbenayoun

Information

• The official example scripts
• My own modified scripts

Tasks

• An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
• My own task or dataset (give details below)

Reproduction (minimal, reproducible, runnable)

/

Expected behavior

/