Skip to content
Issue and PR Labeler

Fix apparent race condition between message processing and Cluster.scheduler_info #1129

Sign in to view logs

Fix apparent race condition between message processing and Cluster.scheduler_info

Fix apparent race condition between message processing and Cluster.scheduler_info #1129

GitHub Actions / Unit Test Results failed Apr 30, 2025 in 0s

10 errors, 30 skipped, 8 pass in 54s

 3 files  3 suites   54s ⏱️
48 tests 8 ✅ 30 💤 0 ❌ 10 🔥
88 runs  8 ✅ 60 💤 0 ❌ 20 🔥

Results for commit 5d81cd7.

Annotations

Check failure on line 0 in /

See this annotation in the file changed.

@github-actions github-actions / Unit Test Results

2 out of 3 runs with error: distributed.protocol.tests.test_highlevelgraph 

artifacts/macos-latest-3.12-default-ci1/pytest.xml [took 0s]
artifacts/macos-latest-3.12-default-notci1/pytest.xml [took 0s]
Raw output 
collection failure
distributed/protocol/tests/test_highlevelgraph.py:7: in <module>
    dd = pytest.importorskip("dask.dataframe")
../../../miniconda3/envs/dask-distributed/lib/python3.12/site-packages/dask/dataframe/__init__.py:25: in <module>
    from dask.dataframe.dask_expr import (
../../../miniconda3/envs/dask-distributed/lib/python3.12/site-packages/dask/dataframe/dask_expr/__init__.py:3: in <module>
    from dask.dataframe.dask_expr import datasets
../../../miniconda3/envs/dask-distributed/lib/python3.12/site-packages/dask/dataframe/dask_expr/datasets.py:10: in <module>
    from dask.dataframe.dask_expr._collection import new_collection
../../../miniconda3/envs/dask-distributed/lib/python3.12/site-packages/dask/dataframe/dask_expr/_collection.py:15: in <module>
    from fsspec.utils import stringify_path
../../../miniconda3/envs/dask-distributed/lib/python3.12/site-packages/fsspec/__init__.py:13: in <module>
    class AbstractFileSystem(AbstractFileSystem, pa.filesystem.DaskFileSystem):
E   AttributeError: module 'pyarrow' has no attribute 'filesystem'

Check failure on line 0 in /

See this annotation in the file changed.

@github-actions github-actions / Unit Test Results

2 out of 3 runs with error: distributed.shuffle.tests.test_graph 

artifacts/macos-latest-3.12-default-ci1/pytest.xml [took 0s]
artifacts/macos-latest-3.12-default-notci1/pytest.xml [took 0s]
Raw output 
collection failure
distributed/shuffle/tests/test_graph.py:8: in <module>
    dd = pytest.importorskip("dask.dataframe")
E   pytest.PytestDeprecationWarning: 
E   Module 'dask.dataframe' was found, but when imported by pytest it raised:
E       ImportError("cannot import name 'stringify_path' from 'fsspec.utils' (/Users/runner/miniconda3/envs/dask-distributed/lib/python3.12/site-packages/fsspec/utils.py)")
E   In pytest 9.1 this warning will become an error by default.
E   You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly.
E   See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror

Check failure on line 0 in /

See this annotation in the file changed.

@github-actions github-actions / Unit Test Results

2 out of 3 runs with error: distributed.shuffle.tests.test_merge 

artifacts/macos-latest-3.12-default-ci1/pytest.xml [took 0s]
artifacts/macos-latest-3.12-default-notci1/pytest.xml [took 0s]
Raw output 
collection failure
ImportError while importing test module '/Users/runner/work/distributed/distributed/distributed/shuffle/tests/test_merge.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
../../../miniconda3/envs/dask-distributed/lib/python3.12/importlib/__init__.py:90: in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
distributed/shuffle/tests/test_merge.py:18: in <module>
    import dask.dataframe as dd
../../../miniconda3/envs/dask-distributed/lib/python3.12/site-packages/dask/dataframe/__init__.py:25: in <module>
    from dask.dataframe.dask_expr import (
../../../miniconda3/envs/dask-distributed/lib/python3.12/site-packages/dask/dataframe/dask_expr/__init__.py:3: in <module>
    from dask.dataframe.dask_expr import datasets
../../../miniconda3/envs/dask-distributed/lib/python3.12/site-packages/dask/dataframe/dask_expr/datasets.py:10: in <module>
    from dask.dataframe.dask_expr._collection import new_collection
../../../miniconda3/envs/dask-distributed/lib/python3.12/site-packages/dask/dataframe/dask_expr/_collection.py:15: in <module>
    from fsspec.utils import stringify_path
E   ImportError: cannot import name 'stringify_path' from 'fsspec.utils' (/Users/runner/miniconda3/envs/dask-distributed/lib/python3.12/site-packages/fsspec/utils.py)

Check failure on line 0 in /

See this annotation in the file changed.

@github-actions github-actions / Unit Test Results

2 out of 3 runs with error: distributed.shuffle.tests.test_merge_column_and_index 

artifacts/macos-latest-3.12-default-ci1/pytest.xml [took 0s]
artifacts/macos-latest-3.12-default-notci1/pytest.xml [took 0s]
Raw output 
collection failure
ImportError while importing test module '/Users/runner/work/distributed/distributed/distributed/shuffle/tests/test_merge_column_and_index.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
../../../miniconda3/envs/dask-distributed/lib/python3.12/importlib/__init__.py:90: in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
distributed/shuffle/tests/test_merge_column_and_index.py:20: in <module>
    import dask.dataframe as dd
../../../miniconda3/envs/dask-distributed/lib/python3.12/site-packages/dask/dataframe/__init__.py:25: in <module>
    from dask.dataframe.dask_expr import (
../../../miniconda3/envs/dask-distributed/lib/python3.12/site-packages/dask/dataframe/dask_expr/__init__.py:3: in <module>
    from dask.dataframe.dask_expr import datasets
../../../miniconda3/envs/dask-distributed/lib/python3.12/site-packages/dask/dataframe/dask_expr/datasets.py:10: in <module>
    from dask.dataframe.dask_expr._collection import new_collection
../../../miniconda3/envs/dask-distributed/lib/python3.12/site-packages/dask/dataframe/dask_expr/_collection.py:15: in <module>
    from fsspec.utils import stringify_path
E   ImportError: cannot import name 'stringify_path' from 'fsspec.utils' (/Users/runner/miniconda3/envs/dask-distributed/lib/python3.12/site-packages/fsspec/utils.py)

Check failure on line 0 in /

See this annotation in the file changed.

@github-actions github-actions / Unit Test Results

2 out of 3 runs with error: distributed.shuffle.tests.test_shuffle 

artifacts/macos-latest-3.12-default-ci1/pytest.xml [took 0s]
artifacts/macos-latest-3.12-default-notci1/pytest.xml [took 0s]
Raw output 
collection failure
ImportError while importing test module '/Users/runner/work/distributed/distributed/distributed/shuffle/tests/test_shuffle.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
../../../miniconda3/envs/dask-distributed/lib/python3.12/importlib/__init__.py:90: in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
distributed/shuffle/tests/test_shuffle.py:32: in <module>
    import dask.dataframe as dd
../../../miniconda3/envs/dask-distributed/lib/python3.12/site-packages/dask/dataframe/__init__.py:25: in <module>
    from dask.dataframe.dask_expr import (
../../../miniconda3/envs/dask-distributed/lib/python3.12/site-packages/dask/dataframe/dask_expr/__init__.py:3: in <module>
    from dask.dataframe.dask_expr import datasets
../../../miniconda3/envs/dask-distributed/lib/python3.12/site-packages/dask/dataframe/dask_expr/datasets.py:10: in <module>
    from dask.dataframe.dask_expr._collection import new_collection
../../../miniconda3/envs/dask-distributed/lib/python3.12/site-packages/dask/dataframe/dask_expr/_collection.py:15: in <module>
    from fsspec.utils import stringify_path
E   ImportError: cannot import name 'stringify_path' from 'fsspec.utils' (/Users/runner/miniconda3/envs/dask-distributed/lib/python3.12/site-packages/fsspec/utils.py)

Check failure on line 0 in /

See this annotation in the file changed.

@github-actions github-actions / Unit Test Results

2 out of 3 runs with error: distributed.shuffle.tests.test_shuffle_plugins 

artifacts/macos-latest-3.12-default-ci1/pytest.xml [took 0s]
artifacts/macos-latest-3.12-default-notci1/pytest.xml [took 0s]
Raw output 
collection failure
distributed/shuffle/tests/test_shuffle_plugins.py:12: in <module>
    dd = pytest.importorskip("dask.dataframe")
E   pytest.PytestDeprecationWarning: 
E   Module 'dask.dataframe' was found, but when imported by pytest it raised:
E       ImportError("cannot import name 'stringify_path' from 'fsspec.utils' (/Users/runner/miniconda3/envs/dask-distributed/lib/python3.12/site-packages/fsspec/utils.py)")
E   In pytest 9.1 this warning will become an error by default.
E   You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly.
E   See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror

Check failure on line 0 in /

See this annotation in the file changed.

@github-actions github-actions / Unit Test Results

All 2 runs with error: distributed.tests.test_client 

artifacts/macos-latest-3.12-default-ci1/pytest.xml [took 0s]
artifacts/macos-latest-3.12-default-notci1/pytest.xml [took 0s]
Raw output 
collection failure
distributed/tests/test_client.py:44: in <module>
    import dask.bag as db
../../../miniconda3/envs/dask-distributed/lib/python3.12/site-packages/dask/bag/__init__.py:22: in <module>
    from dask.bag.avro import read_avro
../../../miniconda3/envs/dask-distributed/lib/python3.12/site-packages/dask/bag/avro.py:6: in <module>
    from fsspec.core import OpenFile, get_fs_token_paths, open_files
../../../miniconda3/envs/dask-distributed/lib/python3.12/site-packages/fsspec/__init__.py:13: in <module>
    class AbstractFileSystem(AbstractFileSystem, pa.filesystem.DaskFileSystem):
E   AttributeError: module 'pyarrow' has no attribute 'filesystem'

Check failure on line 0 in /

See this annotation in the file changed.

@github-actions github-actions / Unit Test Results

All 2 runs with error: distributed.tests.test_cluster_dump 

artifacts/macos-latest-3.12-default-ci1/pytest.xml [took 0s]
artifacts/macos-latest-3.12-default-notci1/pytest.xml [took 0s]
Raw output 
collection failure
distributed/tests/test_cluster_dump.py:6: in <module>
    import fsspec
../../../miniconda3/envs/dask-distributed/lib/python3.12/site-packages/fsspec/__init__.py:13: in <module>
    class AbstractFileSystem(AbstractFileSystem, pa.filesystem.DaskFileSystem):
E   AttributeError: module 'pyarrow' has no attribute 'filesystem'

Check failure on line 0 in /

See this annotation in the file changed.

@github-actions github-actions / Unit Test Results

2 out of 3 runs with error: distributed.tests.test_dask_collections 

artifacts/macos-latest-3.12-default-ci1/pytest.xml [took 0s]
artifacts/macos-latest-3.12-default-notci1/pytest.xml [took 0s]
Raw output 
collection failure
distributed/tests/test_dask_collections.py:14: in <module>
    import dask.bag as db
../../../miniconda3/envs/dask-distributed/lib/python3.12/site-packages/dask/bag/__init__.py:22: in <module>
    from dask.bag.avro import read_avro
../../../miniconda3/envs/dask-distributed/lib/python3.12/site-packages/dask/bag/avro.py:6: in <module>
    from fsspec.core import OpenFile, get_fs_token_paths, open_files
../../../miniconda3/envs/dask-distributed/lib/python3.12/site-packages/fsspec/__init__.py:13: in <module>
    class AbstractFileSystem(AbstractFileSystem, pa.filesystem.DaskFileSystem):
E   AttributeError: module 'pyarrow' has no attribute 'filesystem'

Check failure on line 0 in /

See this annotation in the file changed.

@github-actions github-actions / Unit Test Results

All 2 runs with error: distributed.tests.test_scheduler 

artifacts/macos-latest-3.12-default-ci1/pytest.xml [took 0s]
artifacts/macos-latest-3.12-default-notci1/pytest.xml [took 0s]
Raw output 
collection failure
distributed/tests/test_scheduler.py:26: in <module>
    from dask import bag, delayed
../../../miniconda3/envs/dask-distributed/lib/python3.12/site-packages/dask/bag/__init__.py:22: in <module>
    from dask.bag.avro import read_avro
../../../miniconda3/envs/dask-distributed/lib/python3.12/site-packages/dask/bag/avro.py:6: in <module>
    from fsspec.core import OpenFile, get_fs_token_paths, open_files
../../../miniconda3/envs/dask-distributed/lib/python3.12/site-packages/fsspec/__init__.py:13: in <module>
    class AbstractFileSystem(AbstractFileSystem, pa.filesystem.DaskFileSystem):
E   AttributeError: module 'pyarrow' has no attribute 'filesystem'

Check notice on line 0 in .github

See this annotation in the file changed.

@github-actions github-actions / Unit Test Results

30 skipped tests found 

There are 30 skipped tests, see "Raw output" for the full list of skipped tests.
Raw output 
distributed.cli.tests.test_dask_scheduler
distributed.cli.tests.test_dask_ssh
distributed.comm.tests.test_ucx
distributed.comm.tests.test_ucx_config
distributed.dashboard.tests.test_components
distributed.dashboard.tests.test_scheduler_bokeh
distributed.dashboard.tests.test_worker_bokeh
distributed.deploy.tests.test_old_ssh
distributed.deploy.tests.test_ssh
distributed.diagnostics.tests.test_cudf_diagnostics
distributed.diagnostics.tests.test_memray
distributed.diagnostics.tests.test_nvml
distributed.diagnostics.tests.test_progress_stream
distributed.diagnostics.tests.test_progress_widgets
distributed.diagnostics.tests.test_rmm_diagnostics
distributed.protocol.tests.test_arrow
distributed.protocol.tests.test_collection
distributed.protocol.tests.test_cupy
distributed.protocol.tests.test_h5py
distributed.protocol.tests.test_keras
distributed.protocol.tests.test_netcdf4
distributed.protocol.tests.test_numba
distributed.protocol.tests.test_numpy
distributed.protocol.tests.test_pandas
distributed.protocol.tests.test_rmm
distributed.protocol.tests.test_scipy
distributed.protocol.tests.test_sparse
distributed.protocol.tests.test_torch
distributed.shuffle.tests.test_rechunk
distributed.tests.test_jupyter

Check notice on line 0 in .github

See this annotation in the file changed.

@github-actions github-actions / Unit Test Results

48 tests found 

There are 48 tests, see "Raw output" for the full list of tests.
Raw output 
distributed.cli.tests.test_dask_scheduler
distributed.cli.tests.test_dask_ssh
distributed.comm.tests.test_ucx
distributed.comm.tests.test_ucx_config
distributed.dashboard.tests.test_components
distributed.dashboard.tests.test_scheduler_bokeh
distributed.dashboard.tests.test_worker_bokeh
distributed.deploy.tests.test_old_ssh
distributed.deploy.tests.test_ssh
distributed.diagnostics.tests.test_cudf_diagnostics
distributed.diagnostics.tests.test_memray
distributed.diagnostics.tests.test_memray ‑ test_basic_integration_scheduler
distributed.diagnostics.tests.test_memray ‑ test_basic_integration_scheduler_report_args[False]
distributed.diagnostics.tests.test_memray ‑ test_basic_integration_scheduler_report_args[report_args0]
distributed.diagnostics.tests.test_memray ‑ test_basic_integration_workers[1]
distributed.diagnostics.tests.test_memray ‑ test_basic_integration_workers[False]
distributed.diagnostics.tests.test_memray ‑ test_basic_integration_workers[True]
distributed.diagnostics.tests.test_memray ‑ test_basic_integration_workers_report_args[False]
distributed.diagnostics.tests.test_memray ‑ test_basic_integration_workers_report_args[report_args0]
distributed.diagnostics.tests.test_nvml
distributed.diagnostics.tests.test_progress_stream
distributed.diagnostics.tests.test_progress_widgets
distributed.diagnostics.tests.test_rmm_diagnostics
distributed.protocol.tests.test_arrow
distributed.protocol.tests.test_collection
distributed.protocol.tests.test_cupy
distributed.protocol.tests.test_h5py
distributed.protocol.tests.test_highlevelgraph
distributed.protocol.tests.test_keras
distributed.protocol.tests.test_netcdf4
distributed.protocol.tests.test_numba
distributed.protocol.tests.test_numpy
distributed.protocol.tests.test_pandas
distributed.protocol.tests.test_rmm
distributed.protocol.tests.test_scipy
distributed.protocol.tests.test_sparse
distributed.protocol.tests.test_torch
distributed.shuffle.tests.test_graph
distributed.shuffle.tests.test_merge
distributed.shuffle.tests.test_merge_column_and_index
distributed.shuffle.tests.test_rechunk
distributed.shuffle.tests.test_shuffle
distributed.shuffle.tests.test_shuffle_plugins
distributed.tests.test_client
distributed.tests.test_cluster_dump
distributed.tests.test_dask_collections
distributed.tests.test_jupyter
distributed.tests.test_scheduler
View more details on GitHub Actions