Releases: dask/distributed
Releases · dask/distributed
2025.4.1
2025.4.0
Changes
- Improve error when submitting work from a closed client @jrbourbeau (#9049)
- Return a default value if address resolution fails @penguinpee (#9051)
- Avoid deepcopy when submitting graph @fjetter (#8633)
- Dynamically scale heartbeat and scheduler_info intervals @fjetter (#9046)
- Speed up process startup time by avoiding importing packages on version check @fjetter (#9048)
- Reduce size of scheduler_info @fjetter (#9045)
- Cache WorkerState host property @fjetter (#9044)
- clear ci env cache @fjetter (#9047)
- Remove deprecated PubSub @fjetter (#9039)
- Perform explicit culling step only if LLG is submitted @fjetter (#9040)
- Do not fully materialize global annotations by type @fjetter (#9035)
- Allow nested
worker_client
calls @gsakkis (#9038) - Bump CI cache number @fjetter (#9037)
- Scheduler type annotations @fjetter (#9030)
- Reduce dask.order overhead by removing stripped_dep computation @fjetter (#9031)
- Use Expr instead of HLG @fjetter (#9008)
See the Changelog for more information.
2025.3.0
Changes
- Fix badges in readme @fjetter (#9029)
- Properly forward cancellation reason @fjetter (#9028)
- Bokeh 3.7 compatibility @fjetter (#9026)
- Ensure FileInfo can be serialized @fjetter (#9025)
- Add ipykernel to skipped modules in code sampling @mrocklin (#9022)
- SpecCluster: add option to *not* shut down the scheduler when the cluster is closed @nocnokneo (#9021)
- Fix CI by using
client.persist(collection)
instead ofcollection.persist()
@hendrikmakait (#9020) - Add redirect from prefix root to status @icykip (#9015)
- Bump JamesIves/github-pages-deploy-action from 4.7.2 to 4.7.3 @dependabot[bot] (#9018)
- Fix CI: Remove bytes keys from tests @jacobtomlinson (#9017)
See the Changelog for more information.
2025.2.0
Changes
- Remove traceback from sizeof failure warning @jacobtomlinson (#9006)
- Hotfix: Ignore negative occupancy @hendrikmakait (#9012)
- Remove expensive tokenization for key uniqueness check @phofl (#9009)
- Fix CI for changes in from_map @phofl (#9011)
- Avoid handling stale long-running messages on scheduler @hendrikmakait (#8991)
- Bump
test_ucx::test_stress
timeout @TomAugspurger (#9002) - Poll in test_rmm_metrics test @TomAugspurger (#9004)
- Cache occupancy in
WorkStealing.balance()
@hendrikmakait (#9005) - Homogeneous balancing by accounting for in-flight requests @hendrikmakait (#9003)
- Consistent estimation of task duration between stealing, adaptive and occupancy calculation @hendrikmakait (#9000)
- Increase default work-stealing interval by 10x @hendrikmakait (#8997)
- Remove Occupancy plot from status dashboard @hendrikmakait (#8995)
- Bump conda-incubator/setup-miniconda from 3.1.0 to 3.1.1 @dependabot[bot] (#8990)
See the Changelog for more information.
2025.1.0
Changes
- Fix windows ci to avoid os.getuid @phofl (#8989)
- Use IO task marker in scheduling @jrbourbeau (#8950)
- Skip unwritable test if root @TomAugspurger (#8987)
- Enable
UploadDirectory
plugin to upload to scheduler @hendrikmakait (#8986) - Handle SSLError in TCP comm @jacobtomlinson (#8983)
- pynvml compatibility @TomAugspurger (#8981)
- Handle Client(..., security=False) @jacobtomlinson (#8980)
- Removed big-endian sparse tests @TomAugspurger (#8982)
- Set usedforsecurity=False for md5 call in utils.color_of @relativistic (#8979)
- Remove subgraph callable @fjetter (#8956)
- Remove dependency on dedicated
dask-expr
repo @hendrikmakait (#8978) - Skip big-endian floats in
test_serialize_scipy_sparse
if usingscipy>=1.15.0
@hendrikmakait (#8977) - Run dask with a matching interpreter @cjwatson (#8975)
- Remove unused "type: ignore" comment @cjwatson (#8976)
- Clean up tests after legacy DataFrame removal @phofl (#8972)
- Pin jupyter-events to avoid incompatibility with jupyter-server @phofl (#8971)
- Remove legacy DataFrame implementation @phofl (#8968)
See the Changelog for more information.
2024.12.1
Changes
- Bump conda-incubator/setup-miniconda from 3.0.3 to 3.1.0 @dependabot (#8922)
- Pick random dashboard port in tests @hendrikmakait (#8965)
- Fix formatting for
NoValidWorkerException
message @hendrikmakait (#8967) - Don't track TaskState instances unless validating @hendrikmakait (#8963)
- Support pynvml>=11.5 in WSL @rjzamora (#8962)
- Bump JamesIves/github-pages-deploy-action from 4.6.9 to 4.7.2 @dependabot (#8960)
See the Changelog for more information.
2024.12.0
Changes
- Fix
test_jupyter.py::test_shutsdown_cleanly
@hendrikmakait (#8954) - Install
tornado
fromconda-forge
in Python 3.13 CI @jrbourbeau (#8951) - Restore retire workers API @fjetter (#8939)
- Properly convert finalize dependencies to references @hendrikmakait (#8949)
- Add support for Python 3.13 @phofl (#8904)
- Block fusion for barrier tasks @phofl (#8944)
- Remove infra/mentions of GPU CI @charlesbluca (#8946)
- Temporarily disable gpuCI update CI job @jrbourbeau (#8945)
- Remove recursion in task spec @fjetter (#8920)
- Less verbose log messages for remove and register worker @fjetter (#8938)
- Do not log full worker info in retire_workers @fjetter (#8935)
See the Changelog for more information.
2024.11.2
2024.11.1
2024.11.0
Changes
- Remove redundant methods in P2PBarrierTask @fjetter (#8924)
- fix skipif condition for test_tell_workers_when_peers_have_left @fjetter (#8929)
- Ensure ConnectionPool closes even if network stack swallows cancellation @fjetter (#8928)
- Fix flaky test_server_comms_mark_active_handlers @fjetter (#8927)
- Make assumption in P2P's barrier mechanism explicit @hendrikmakait (#8926)
- Adjust timeouts in jupyter cli test @fjetter (#8925)
- Add
stimulus_id
toSchedulerPlugin.update_graph
hook @hendrikmakait (#8923) - Reduce P2P transfer task overhead @hendrikmakait (#8912)
- Disable profiler on python 3.11 @fjetter (#8916)
- Fix test_restarting_does_not_deadlock @fjetter (#8849)
- Adjust popen timeouts for testing @fjetter (#8848)
- Add retry to shuffle broadcast @fjetter (#8900)
- Fix test_shuffle_with_array_conversion @fjetter (#8909)
- Refactor some tests @fjetter (#8908)
- Reflect graduation of
dask-expr
fromdask-contrib
todask
@hendrikmakait (#8911) - Skip test_tell_workers_when_peers_have_left on py3.10 @fjetter (#8910)
- Internal cleanup of P2P code @hendrikmakait (#8907)
- Use Task class instead of tuple @fjetter (#8797)
- Increase connect timeout for test_tell_workers_when_peers_have_left @fjetter (#8906)
- Remove dispatching in TaskCollection @fjetter (#8903)
- Deduplicate scheduler requests in P2P @hendrikmakait (#8899)
- Add configurations for rootish taskgroup threshold @phofl (#8898)
See the Changelog for more information.