Skip to content

关于DDP训练中梯度与bucket strides不匹配的警告 #70

@pingpingwuqiQAQ

Description

@pingpingwuqiQAQ

你好!
在使用分布式数据并行 (DDP) 训练时,我遇到了如下警告:
Image
虽然这并不会导致训练失败,但我担心可能会影响训练性能。
该如何解决呢?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions