v5.4.0rc2

The requests package is no longer limited to <2.32.0 per #2041.
Contribution #2007 by @awmackowiak was confirmed to have solved the Redis reconnection bug.

What's Changed

• Bump mypy from 1.10.0 to 1.10.1 by @dependabot in #2039
• Fix typo in README.rst by @sylvain1811 in #2036
• Reverted limiting requests<2.32.0 in requirements/default.txt but kept in tox.ini due to docker-py issue 3256 by @Nusnus in #2041
• Redis transport - Redelivered messages should respect the original priority by @zemek in #2026
• Exclude Unit 3.9 from CI by @Nusnus in #2046
• Fixed CI error from excluding Python 3.9 unit tests by @Nusnus in #2047
• Fixed flaky integration test: test_publish_requeue_consume() by @Nusnus in #2048
• Bump pymongo from 4.7.3 to 4.8.0 by @dependabot in #2044
• fix: don't crash on properties.body_encoding: utf-8 by @pankgeorg in #1690
• chore: handle kafka transport with confluentkafka ✨ by @meysam81 in #1574
• Revert "Exclude Unit 3.9 from CI #2046" by @Nusnus in #2054
• fix azure service bus isinstance checks when None by @jasonwbarnett in #2053
• Added Changelog for v5.4.0rc2 by @Nusnus in #2056

New Contributors

• @sylvain1811 made their first contribution in #2036
• @zemek made their first contribution in #2026
• @pankgeorg made their first contribution in #1690

Full Changelog: v5.4.0rc1...v5.4.0rc2

v5.4.0rc1

We want to add a special thanks to contribution #2007 by @awmackowiak for fixing the Redis reconnection bug.
This release candidate aims to allow the community to test the changes and provide feedback.

Please let us know if Redis is stable again!

New: #1998, #2016, #2024, #1976
The rest of the changes are bug fixes and dependency updates.

Lastly, requests is limited to <2.32.0 per #2011.

What's Changed

• Update mypy to 1.10.0 by @pyup-bot in #1988
• Update pytest to 8.2.0 by @pyup-bot in #1990
• fix: Fanout exchange messages mixed across virtual databases in Redis sentinel by @huyenvu2101 in #1986
• Pin pymongo to latest version 4.7.2 by @pyup-bot in #1994
• enable/fix test_etcd.py (resolves #2001) by @FrankK-1234 in #2002
• Bump pytest from 8.2.0 to 8.2.1 by @dependabot in #2005
• Limit requests<2.32.0 due to docker-py issue 3256 by @Nusnus in #2011
• enhance: allow users to disable broker heartbeats by @smart-programmer in #1998
• enhance: allow uses to disable broker heartbeats by not providing a timeout (#1997,#1998) by @FrankK-1234 in #2016
• Pin typing_extensions to latest version 4.12.1 by @pyup-bot in #2017
• chore(typing): annotate utils/debug.py by @stegayet in #1714
• Bump pytest from 8.2.1 to 8.2.2 by @dependabot in #2021
• Bump pymongo from 4.7.2 to 4.7.3 by @dependabot in #2022
• ConnectionPool can't be used after .resize(..., reset=True) (resolves #2018) by @FrankK-1234 in #2024
• Fix Redis connections after reconnect - consumer starts consuming the tasks after crash. by @awmackowiak in #2007
• Update flake8 to 7.1.0 by @pyup-bot in #2028
• Add support for mongodb+srv scheme by @H4ad in #1976
• Added Changelog for v5.4.0rc1 by @Nusnus in #2033
• Fixed bumpversion bug with RC versions by @Nusnus in #2034

New Contributors

• @huyenvu2101 made their first contribution in #1986
• @FrankK-1234 made their first contribution in #2002
• @smart-programmer made their first contribution in #1998
• @awmackowiak made their first contribution in #2007
• @H4ad made their first contribution in #1976

Full Changelog: v5.3.7...v5.4.0rc1

v5.3.7

The release of v5.3.6 was missing the bumbversion commit so v5.3.7 is only released to sync it back.

What's Changed

• Fix: Bumpversion commit wasn’t pushed to main correctly for v5.3.6 by @Nusnus in #1983
• Added Changelog for v5.3.7 by @Nusnus in #1984
• Bump version: 5.3.6 → 5.3.7 by @Nusnus in #1985

Full Changelog: v5.3.6...v5.3.7

v5.3.6

What's Changed

• boto3>=1.26.143 by @Nusnus in #1890
• Always convert azureservicebus namespace to fully qualified by @ainscore in #1892
• Pin pytest-sugar to latest version 1.0.0 by @pyup-bot in #1912
• Upgrade to pytest v8 that removed nose compatibility by @cclauss in #1914
• fix warning for usage of utcfromtimestamp by @asottile-sentry in #1926
• Update pytest to 8.0.2 by @pyup-bot in #1942
• Hotfix: Fix CI failures (limit redis to <5.0.2 instead of <6.0.0) by @Nusnus in #1961
• Expose cancel callback from py-amqp channel.basic_consume by @jcosmao in #1953
• Update mypy to 1.9.0 by @pyup-bot in #1963
• Update pytest to 8.1.1 by @pyup-bot in #1965
• Pin hypothesis to hypothesis<7 by @pyup-bot in #1966
• redis>=4.5.2,<5.0.2,!=4.5.5 -> redis>=4.5.2,!=5.0.2,!=4.5.5 by @Nusnus in #1969
• add escape hatch for custom JSON serialization by @vlindhol in #1955
• Pin pytest-cov to latest version 5.0.0 by @pyup-bot in #1972
• Added Changelog for v5.3.6 by @Nusnus in #1974

New Contributors

• @ainscore made their first contribution in #1892
• @asottile-sentry made their first contribution in #1926
• @jcosmao made their first contribution in #1953
• @vlindhol made their first contribution in #1955

Full Changelog: v5.3.5...v5.3.6

v5.3.5

What's Changed

• Fix ReadTheDocs CI by @Nusnus in #1827
• fix(docs): add Redis to the list of transports where SSL is supported by @davidjrice in #1826
• Fixed Improper Method Call: Replaced mktemp by @fazledyn-or in #1828
• Bump actions/setup-python from 4 to 5 by @dependabot in #1829
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #1831
• Bump github/codeql-action from 2 to 3 by @dependabot in #1832
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #1834
• fix: freeze set during ticks iter in async hub by @claudinoac in #1830
• azure service bus: fix TypeError when using Managed Identities by @marnikow in #1825
• Fix unacknowledge typo in restore_visible() by @Maheshkumar-novice in #1839
• Changed pyup -> dependabot for updating dependencies by @Nusnus in #1842
• Bump pytest from 7.4.3 to 7.4.4 by @dependabot in #1843
• Bump flake8 from 6.0.0 to 7.0.0 by @dependabot in #1845
• Bump mypy from 1.3.0 to 1.8.0 by @dependabot in #1844
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #1846
• Fix crash when using global_keyprefix with a sentinel connection by @adam-homeboost in #1838
• Fixed version_dev in docs/conf.py by @Nusnus in #1875
• Added Changelog for v5.3.5 by @Nusnus in #1876

In addition, the documentation now generates latest, stable and v5.3.5 correctly:
https://docs.celeryq.dev/projects/kombu/en/stable/
https://docs.celeryq.dev/projects/kombu/en/latest/
https://docs.celeryq.dev/projects/kombu/en/v5.3.5/

New Contributors

• @davidjrice made their first contribution in #1826
• @fazledyn-or made their first contribution in #1828
• @claudinoac made their first contribution in #1830
• @Maheshkumar-novice made their first contribution in #1839
• @adam-homeboost made their first contribution in #1838

Full Changelog: v5.3.4...v5.3.5

v5.3.4

What's Changed

• Use the correct protocol for SQS requests by @rafidka in #1807

Full Changelog: v5.3.3...v5.3.4

v5.3.3

What's Changed

• Update redis.txt to align with celery main by @auvipy in #1776
• Handle Access Denied Exception in basic_ack Method by @flolas in #1777
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #1782
• test redis 5.0.0 by @auvipy in #1790
• Dependabot (Kombu) by @Nusnus in #1791
• Bump actions/checkout from 3 to 4 by @dependabot in #1792
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #1793
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #1797
• fix azure servicebus using managed identity support by @marnikow in #1801
• Added as_uri method to MongoDB transport - Fixes #1795 by @romanukes in #1796
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #1806
• Revert "[fix #1726] Use boto3 for SQS async requests" by @auvipy in #1799
• Create a lock on cached_property if not present by @tari in #1811
• added Python 3.12 in the CI by @auvipy in #1812
• using assert_called_once() in est__pop_ready_uses_lock by @auvipy in #1813
• fix: redis requeue concurrency bug #1800 by @jiangxianfu in #1805
• Update pytest version by @auvipy in #1817
• Bump kafka deps versions & fix integration test failures by @auvipy in #1818

New Contributors

• @flolas made their first contribution in #1777
• @dependabot made their first contribution in #1792
• @marnikow made their first contribution in #1801
• @romanukes made their first contribution in #1796
• @tari made their first contribution in #1811
• @jiangxianfu made their first contribution in #1805

Full Changelog: v5.3.2...v5.3.3

v5.3.2

What's Changed

• Reverted unwanted constraint introduced in #1629 with max_retries by @Nusnus in #1755
• Doc fix (hotfix for #1755) by @Nusnus in #1758
• Python3.12: fix imports in kombu/utils/objects.py by @Steap in #1756
• [fix #1726] Use boto3 for SQS async requests by @rafidka in #1759
• docs: Remove SimpleQueue import by @Kirade in #1764
• Fixed pre-commit issues by @Nusnus in #1773
• azure service bus: add managed identity support by @jasonwbarnett in #1641
• fix: Prevent redis task loss when closing connection while in poll by @mbierma in #1733
• Kombu & celery with SQS #222 by @shoaib-mohd in #1779
• syntax correction by @shoaib-mohd in #1780

New Contributors

• @Steap made their first contribution in #1756
• @rafidka made their first contribution in #1759
• @mbierma made their first contribution in #1733
• @shoaib-mohd made their first contribution in #1779

Full Changelog: v5.3.1...v5.3.2

v5.3.1

What's Changed

• Update pycurl version by @auvipy in #1745
• Update librabbitmq restrict py3.11 by @auvipy in #1746
• Update PyCurl version in SQS by @auvipy in #1747
• try python 3.11 on CI by @auvipy in #1425
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #1753
• fix: allow deserializing any version of UUID by @sk- in #1754

New Contributors

• @sk- made their first contribution in #1754

Full Changelog: v5.3.0...v5.3.1

v5.3.0

What's Changed

• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #1502
• Add fanout to filesystem by @karajan1001 in #1499
• Protect set of ready tasks by lock to avoid concurrent updates by @olii in #1489
• Documentation: Update serialization page to indicate pickle protocol version has been updated by @otherJL0 in #1507
• Use new entry_points interface by @ObiWanKeoni in #1509
• Add mypy to the pipeline by @Kludex in #1512
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #1520
• chore: Annotate semaphore.py by @sondrelg in #1513
• Added possibility to serialize and deserialize binary messages in json by @dobosevych in #1516
• Annotate utils/uuid.py and utils/text.py by @Kludex in #1514
• Update __exit__ function signatures by @sondrelg in #1524
• Annotate init files by @Kludex in #1527
• Use --py37-plus for pyupgrade and add __future__.annotations import by @Kludex in #1531
• json.py cleaning from outdated libs by @dobosevych in #1533
• try new py-amqp release by @auvipy in #1534
• add GitHub URL for PyPi by @andriyor in #1498
• Config file for pyup.io by @pyup-bot in #1453
• pytest~=7.1.1 by @auvipy in #1535
• Support pymongo 4.x by @Jakski in #1536
• Annotate exceptions.py and clocks.py by @Kludex in #1526
• Kafka support by @CountRedClaw in #1506
• v3 action-checkout by @auvipy in #1538
• Upgrade Azure Storage Queues transport to version 12 by @jonasmiederer in #1539
• move to consul2 by @auvipy in #1544
• azure-servicebus>=7.6.1 by @auvipy in #1543
• kazoo>=2.8.0 by @auvipy in #1545
• redis>=4.2.2 by @auvipy in #1546
• Added HLEN to the list of prefixed redis commands by @vinayinvicible in #1540
• update SQS dependencies by @auvipy in #1547
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #1550
• Annotate abstract.py by @Kludex in #1522
• Datetime serialization and deserialization fixed by @dobosevych in #1515
• Annotate matcher.py by @Kludex in #1532
• stop schedule by @auvipy in #1558
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #1554
• stop cron job by @auvipy in #1559
• fix typing flake8 by @auvipy in #1560
• Add ext.py files to setup.cfg by @Kludex in #1566
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #1571
• Add support to SQS DelaySeconds by @erikaloranger in #1567
• Add Redis WATCH to prefixed complex commands by @dcecile in #1572
• Avoid losing type of UUID when serializing/deserializing by @el-chogo in #1575
• chore: add confluentkafka to extras 📌 by @meysam81 in #1573
• Fix typo in README.rst by @Kirade in #1581
• Fix azurestoragequeues transport by @davidbossanyi in #1586
• hub: tick delay fix by @shahar-lev in #1587
• Fix incompatibility with redis in disconnect() by @shalabhc in #1589
• Solve Kombu filesystem transport not thread safe by @karajan1001 in #1593
• Revert "Solve Kombu filesystem transport not thread safe" by @karajan1001 in #1595
• Make JSONEncoder keep the same type for date/datetime. by @mvaled in #1598
• Solve Kombu filesystem transport not thread safe by @karajan1001 in #1596
• importlib_metadata remove deprecated entry point interfaces by @woutdenolf in #1601
• Add separate transport option for retry loop timeout by @intgr in #1599
• Fix errors from flake8 lint by @intgr in #1608
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #1578
• Allow azurestoragequeues transport to be used with Azurite emulator in docker-compose by @davidbossanyi in #1611
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #1613
• Use SPDX license expression in project metadata by @RazerM in #1616
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #1617
• Added .python-version and .vscode to gitignore by @Nusnus in #1627
• sqlalchemy==1.4.45 by @auvipy in #1626
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #1619
• Allowing Connection.ensure() to retry on specific exceptions given by policy by @Nusnus in #1629
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #1633
• redis==4.3.4 temporarilly in an attempt to avoid bc by @auvipy in #1634
• add managed identity support to azure storage queue by @jasonwbarnett in #1631
• add autoflake to .pre-commit-config.yaml to automatically remove unused imports by @jasonwbarnett in #1637
• Switch references to the master branch to main by @thedrow in #1638
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #1635
• add --keep-runtime-typing argument to pyupgrade by @jasonwbarnett in #1639
• add type annotations to kombu/transport/azurestoragequeues by @jasonwbarnett in #1632
• azure service bus: add type annotations and use cached property by @jasonwbarnett in #1640
• update by @auvipy in #1652
• support sqla v2.0 by @craigmulligan in #1651
• sqlalchemy>=1.4.1,<2.1 by @auvipy in #1642
• Mark methods accepting Connection instances as such by @agateau-gg in #1645
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #1648
• lets check it's compat by @auvipy in #1655
• Remove unused _setupfuns from serialization.py by @last-partizan in #1658
• refactor: Refactor utils/json by @last-partizan in #1659
• docs: Add notes for kombu.utils.json.register_type by @last-partizan in #1660
• Correctly mock entry_points on Python 3.10 by @jaraco in #1664
• updated python versiions in CI by @auvipy in #1663
• Update codeql part to v2 by @auvipy in #1665
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #1667
• Update sqlalchemy.txt by @auvipy in #1669
• azure-storage-queue>=12.6.0 by @auvipy in #1671
• azure-servicebus>=7.8.3 by @auvipy in #1672
• Update azureservicebus.txt cpython only by @auvipy in #1674
• use pytest-freezer by @auvipy in #1683
• test azureservicebus pure python beta by @auvipy in #1682
• Update sqs.txt by @auvipy in #1684
• Update brotli.txt by @auvipy in #1685
• Update pkgutils.txt by @auvipy in #1686
• Deprecate pytz and use zoneinfo by @max-muoto in #1680
• fix: handle keyerror in azureservicebus transport when message is not found in qos and perform basic_ack by @IsmaelJS in #1691
• Update azureservicebus.txt by @auvipy in #1693
• Update pkgutils.txt by @auvipy in #1692
• Add Semgrep CI by @Nusnus in #1695
• drop codecov pypi version by @auvipy in #1696
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/celery/kombu/pull...