Skip to content

[Task][Megatron] 3.4: Performance benchmark suite #261

Description

@lvyufeng

Parent Issue

Part of #206 — Megatron Roadmap, Phase 3 (Megatron Core Execution MVP): Task 3.4

Description

Benchmark step time, communication overlap, and scalability on NPU.

Requirements

  • Per-step time breakdown (compute, communication, overlap)
  • Scaling efficiency across NPU counts (2, 4, 8)
  • Communication-computation overlap measurement
  • Memory usage per rank
  • Comparison against torch_npu + Megatron baseline
  • Reproducible benchmark scripts

Blocked By

Blocks

  • Performance optimization roadmap

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions