ARQ is officially dead

[ferdimsu]

After a lengthy and censored discussion on the future of ARQ: python-arq/arq#437

We now have the official confirmation (python-arq/arq#510): ARQ is in "maintenance-only mode", which is basically like saying the project is on life support.

So I guess we'll switch our projects to streaQ now... Thanks for this amazing, better maintained alternative!

Is there anything we need to be careful about when moving to streaQ, especially for larger projects with long-running tasks? For example is there a queue_read_limit like in ARQ?

[Graeme22]

Glad streaQ will fit your project's needs!

Instead of queue_read_limit the number of tasks read from the queue is prefetch + concurrency. If you set prefetch to 0 the worker will only fetch tasks it has the capacity to run right away. I can't think of anything major you need to worry about.

[ferdimsu]

Thanks for clarifying that! Setting prefetch to 0 sounds like exactly what we need. Appreciate the insight.

[Graeme22]

No problem!
Another thing, I'd recommend installing from git until v6 is released, it has a lot of improvements over v5 but hasn't been released because we're waiting on anyio support to be merged into coredis, the redis client

[ferdimsu]

Makes sense - thanks for the heads up