Skip to content

fix: AccumulateGrad stream mismatch warning when using DDP with Fabric & Trainer #12706

fix: AccumulateGrad stream mismatch warning when using DDP with Fabric & Trainer

fix: AccumulateGrad stream mismatch warning when using DDP with Fabric & Trainer #12706

Triggered via pull request June 1, 2026 12:04
Status Cancelled
Total duration 1m 59s
Artifacts

ci-tests-fabric.yml

on: pull_request
Matrix: fabric-cpu
fabric-cpu-guardian
1m 15s
fabric-cpu-guardian
Fit to window
Zoom out
Zoom in

Annotations

72 errors
fabric-cpu (macOS-14, lightning, 3.10, 2.1)
Canceling since a higher priority waiting request for Test Fabric-refs/pull/21746/merge-fix/ddp-accumulate-grad-stream-mismatch-warning exists
fabric-cpu (macOS-14, lightning, 3.11, 2.2.2)
Canceling since a higher priority waiting request for Test Fabric-refs/pull/21746/merge-fix/ddp-accumulate-grad-stream-mismatch-warning exists
fabric-cpu (macOS-14, fabric, 3.12, 2.8)
Canceling since a higher priority waiting request for Test Fabric-refs/pull/21746/merge-fix/ddp-accumulate-grad-stream-mismatch-warning exists
fabric-cpu (macOS-14, fabric, 3.12.7, 2.6)
Canceling since a higher priority waiting request for Test Fabric-refs/pull/21746/merge-fix/ddp-accumulate-grad-stream-mismatch-warning exists
fabric-cpu (macOS-14, lightning, 3.11, 2.3)
Canceling since a higher priority waiting request for Test Fabric-refs/pull/21746/merge-fix/ddp-accumulate-grad-stream-mismatch-warning exists
fabric-cpu (macOS-14, fabric, 3.13, 2.8)
Canceling since a higher priority waiting request for Test Fabric-refs/pull/21746/merge-fix/ddp-accumulate-grad-stream-mismatch-warning exists
fabric-cpu (macOS-14, fabric, 3.12, 2.7)
Canceling since a higher priority waiting request for Test Fabric-refs/pull/21746/merge-fix/ddp-accumulate-grad-stream-mismatch-warning exists
fabric-cpu (macOS-14, lightning, 3.12.7, 2.4.1)
Canceling since a higher priority waiting request for Test Fabric-refs/pull/21746/merge-fix/ddp-accumulate-grad-stream-mismatch-warning exists
fabric-cpu (macOS-14, fabric, 3.13, 2.10)
Canceling since a higher priority waiting request for Test Fabric-refs/pull/21746/merge-fix/ddp-accumulate-grad-stream-mismatch-warning exists
fabric-cpu (macOS-14, fabric, 3.13, 2.9)
Canceling since a higher priority waiting request for Test Fabric-refs/pull/21746/merge-fix/ddp-accumulate-grad-stream-mismatch-warning exists
fabric-cpu (macOS-14, lightning, 3.12.7, 2.5.1)
Canceling since a higher priority waiting request for Test Fabric-refs/pull/21746/merge-fix/ddp-accumulate-grad-stream-mismatch-warning exists
fabric-cpu (macOS-14, fabric, 3.12, 2.10)
Canceling since a higher priority waiting request for Test Fabric-refs/pull/21746/merge-fix/ddp-accumulate-grad-stream-mismatch-warning exists
fabric-cpu (macOS-14, fabric, 3.12, 2.9)
Canceling since a higher priority waiting request for Test Fabric-refs/pull/21746/merge-fix/ddp-accumulate-grad-stream-mismatch-warning exists
fabric-cpu (macOS-14, fabric, 2.1, oldest)
Canceling since a higher priority waiting request for Test Fabric-refs/pull/21746/merge-fix/ddp-accumulate-grad-stream-mismatch-warning exists
fabric-cpu (ubuntu-22.04, fabric, 3.12.7, 2.6)
Canceling since a higher priority waiting request for Test Fabric-refs/pull/21746/merge-fix/ddp-accumulate-grad-stream-mismatch-warning exists
fabric-cpu (ubuntu-22.04, fabric, 3.12.7, 2.6)
The operation was canceled.
fabric-cpu (ubuntu-22.04, fabric, 3.13, 2.9)
Canceling since a higher priority waiting request for Test Fabric-refs/pull/21746/merge-fix/ddp-accumulate-grad-stream-mismatch-warning exists
fabric-cpu (ubuntu-22.04, fabric, 3.13, 2.9)
The operation was canceled.
fabric-cpu (ubuntu-22.04, fabric, 3.13, 2.8)
Canceling since a higher priority waiting request for Test Fabric-refs/pull/21746/merge-fix/ddp-accumulate-grad-stream-mismatch-warning exists
fabric-cpu (ubuntu-22.04, fabric, 3.13, 2.8)
The operation was canceled.
fabric-cpu (ubuntu-22.04, lightning, 3.12.7, 2.4.1)
Canceling since a higher priority waiting request for Test Fabric-refs/pull/21746/merge-fix/ddp-accumulate-grad-stream-mismatch-warning exists
fabric-cpu (windows-2022, lightning, 3.10, 2.1)
Canceling since a higher priority waiting request for Test Fabric-refs/pull/21746/merge-fix/ddp-accumulate-grad-stream-mismatch-warning exists
fabric-cpu (ubuntu-22.04, lightning, 3.12.7, 2.4.1)
The operation was canceled.
fabric-cpu (windows-2022, lightning, 3.10, 2.1)
The operation was canceled.
fabric-cpu (windows-2022, lightning, 3.12.7, 2.5.1)
Canceling since a higher priority waiting request for Test Fabric-refs/pull/21746/merge-fix/ddp-accumulate-grad-stream-mismatch-warning exists
fabric-cpu (windows-2022, lightning, 3.12.7, 2.5.1)
The operation was canceled.
fabric-cpu (ubuntu-22.04, fabric, 3.12, 2.10)
Canceling since a higher priority waiting request for Test Fabric-refs/pull/21746/merge-fix/ddp-accumulate-grad-stream-mismatch-warning exists
fabric-cpu (ubuntu-22.04, fabric, 3.12, 2.10)
The operation was canceled.
fabric-cpu (windows-2022, fabric, 3.12.7, 2.6)
Canceling since a higher priority waiting request for Test Fabric-refs/pull/21746/merge-fix/ddp-accumulate-grad-stream-mismatch-warning exists
fabric-cpu (windows-2022, fabric, 3.12.7, 2.6)
The operation was canceled.
fabric-cpu (ubuntu-22.04, fabric, 3.13, 2.10)
Canceling since a higher priority waiting request for Test Fabric-refs/pull/21746/merge-fix/ddp-accumulate-grad-stream-mismatch-warning exists
fabric-cpu (ubuntu-22.04, fabric, 3.13, 2.10)
The operation was canceled.
fabric-cpu (ubuntu-22.04, fabric, 3.12, 2.9)
Canceling since a higher priority waiting request for Test Fabric-refs/pull/21746/merge-fix/ddp-accumulate-grad-stream-mismatch-warning exists
fabric-cpu (ubuntu-22.04, fabric, 3.12, 2.9)
The operation was canceled.
fabric-cpu (ubuntu-22.04, lightning, 3.12.7, 2.5.1)
Canceling since a higher priority waiting request for Test Fabric-refs/pull/21746/merge-fix/ddp-accumulate-grad-stream-mismatch-warning exists
fabric-cpu (ubuntu-22.04, lightning, 3.12.7, 2.5.1)
The operation was canceled.
fabric-cpu (windows-2022, fabric, 2.1, oldest)
Canceling since a higher priority waiting request for Test Fabric-refs/pull/21746/merge-fix/ddp-accumulate-grad-stream-mismatch-warning exists
fabric-cpu (windows-2022, fabric, 2.1, oldest)
The operation was canceled.
fabric-cpu (ubuntu-22.04, fabric, 3.12, 2.7)
Canceling since a higher priority waiting request for Test Fabric-refs/pull/21746/merge-fix/ddp-accumulate-grad-stream-mismatch-warning exists
fabric-cpu (ubuntu-22.04, fabric, 3.12, 2.7)
The operation was canceled.
fabric-cpu (windows-2022, fabric, 3.13, 2.10)
Canceling since a higher priority waiting request for Test Fabric-refs/pull/21746/merge-fix/ddp-accumulate-grad-stream-mismatch-warning exists
fabric-cpu (windows-2022, fabric, 3.13, 2.10)
The operation was canceled.
fabric-cpu (windows-2022, fabric, 3.12, 2.9)
Canceling since a higher priority waiting request for Test Fabric-refs/pull/21746/merge-fix/ddp-accumulate-grad-stream-mismatch-warning exists
fabric-cpu (windows-2022, fabric, 3.12, 2.9)
The operation was canceled.
fabric-cpu (windows-2022, fabric, 3.12, 2.10)
Canceling since a higher priority waiting request for Test Fabric-refs/pull/21746/merge-fix/ddp-accumulate-grad-stream-mismatch-warning exists
fabric-cpu (windows-2022, fabric, 3.12, 2.10)
The operation was canceled.
fabric-cpu (windows-2022, lightning, 3.11, 2.2.2)
Canceling since a higher priority waiting request for Test Fabric-refs/pull/21746/merge-fix/ddp-accumulate-grad-stream-mismatch-warning exists
fabric-cpu (windows-2022, lightning, 3.11, 2.2.2)
The operation was canceled.
fabric-cpu (windows-2022, lightning, 3.11, 2.3)
Canceling since a higher priority waiting request for Test Fabric-refs/pull/21746/merge-fix/ddp-accumulate-grad-stream-mismatch-warning exists
fabric-cpu (windows-2022, lightning, 3.11, 2.3)
The operation was canceled.
fabric-cpu (windows-2022, fabric, 3.13, 2.8)
Canceling since a higher priority waiting request for Test Fabric-refs/pull/21746/merge-fix/ddp-accumulate-grad-stream-mismatch-warning exists
fabric-cpu (windows-2022, fabric, 3.13, 2.8)
The operation was canceled.
fabric-cpu (windows-2022, fabric, 3.12, 2.8)
Canceling since a higher priority waiting request for Test Fabric-refs/pull/21746/merge-fix/ddp-accumulate-grad-stream-mismatch-warning exists
fabric-cpu (windows-2022, fabric, 3.12, 2.8)
The operation was canceled.
fabric-cpu (windows-2022, lightning, 3.12.7, 2.4.1)
Canceling since a higher priority waiting request for Test Fabric-refs/pull/21746/merge-fix/ddp-accumulate-grad-stream-mismatch-warning exists
fabric-cpu (windows-2022, lightning, 3.12.7, 2.4.1)
The operation was canceled.
fabric-cpu (windows-2022, fabric, 3.13, 2.9)
Canceling since a higher priority waiting request for Test Fabric-refs/pull/21746/merge-fix/ddp-accumulate-grad-stream-mismatch-warning exists
fabric-cpu (windows-2022, fabric, 3.13, 2.9)
The operation was canceled.
fabric-cpu (windows-2022, fabric, 3.12, 2.7)
Canceling since a higher priority waiting request for Test Fabric-refs/pull/21746/merge-fix/ddp-accumulate-grad-stream-mismatch-warning exists
fabric-cpu (windows-2022, fabric, 3.12, 2.7)
The operation was canceled.
fabric-cpu (ubuntu-22.04, fabric, 3.12, 2.8)
Canceling since a higher priority waiting request for Test Fabric-refs/pull/21746/merge-fix/ddp-accumulate-grad-stream-mismatch-warning exists
fabric-cpu (ubuntu-22.04, fabric, 3.12, 2.8)
The operation was canceled.
fabric-cpu (ubuntu-22.04, lightning, 3.11, 2.3)
Canceling since a higher priority waiting request for Test Fabric-refs/pull/21746/merge-fix/ddp-accumulate-grad-stream-mismatch-warning exists
fabric-cpu (ubuntu-22.04, lightning, 3.11, 2.3)
The operation was canceled.
fabric-cpu (ubuntu-22.04, fabric, 2.1, oldest)
Canceling since a higher priority waiting request for Test Fabric-refs/pull/21746/merge-fix/ddp-accumulate-grad-stream-mismatch-warning exists
fabric-cpu (ubuntu-22.04, fabric, 2.1, oldest)
The operation was canceled.
fabric-cpu (ubuntu-22.04, lightning, 3.10, 2.1)
Canceling since a higher priority waiting request for Test Fabric-refs/pull/21746/merge-fix/ddp-accumulate-grad-stream-mismatch-warning exists
fabric-cpu (ubuntu-22.04, lightning, 3.10, 2.1)
The operation was canceled.
fabric-cpu (ubuntu-22.04, lightning, 3.11, 2.2.2)
Canceling since a higher priority waiting request for Test Fabric-refs/pull/21746/merge-fix/ddp-accumulate-grad-stream-mismatch-warning exists
fabric-cpu (ubuntu-22.04, lightning, 3.11, 2.2.2)
The operation was canceled.
fabric-cpu-guardian
The action 'cancelled or skipped...' has timed out after 1 minutes.
Test Fabric
Canceling since a higher priority waiting request for Test Fabric-refs/pull/21746/merge-fix/ddp-accumulate-grad-stream-mismatch-warning exists