Skip to content

enhance auto device map for moe model #976

New issue
New issue
Open
Open
enhance auto device map for moe model#976
Assignees
xin3he
Milestone
0.9.1
@wenhuach21

Description

@wenhuach21
wenhuach21
opened on Oct 31, 2025

The memory usage is not evenly distributed for Qwen3MOE

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions