Skip to content

Fix ckpt convert for qwen35 moe model#1233

Merged
lxd-cumt merged 2 commits into
flagos-ai:mainfrom
wenqingqian:selective_grad_accumulation
Jul 14, 2026
Merged

Fix ckpt convert for qwen35 moe model#1233
lxd-cumt merged 2 commits into
flagos-ai:mainfrom
wenqingqian:selective_grad_accumulation

Conversation

@wenqingqian

Copy link
Copy Markdown
Contributor

fix ckpt convert for qwen35 moe model and support uneven pipeline parallel

@lxd-cumt lxd-cumt left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@lxd-cumt lxd-cumt merged commit 6421926 into flagos-ai:main Jul 14, 2026
28 of 31 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants