[Queue] Implement Dead Letter Queue for Permanently Failed Jobs

[Eniola3321]

Labels: bullmq reliability monitoring swagger
Priority: medium

Summary

Move permanently failed jobs into a dead letter queue for investigation and recovery.

Description

Jobs that fail after all retry attempts should remain available for manual investigation instead of being silently removed.

Tasks
Configure removeOnFail: false.
Create dead-letter queue.
Move permanently failed jobs into the queue.
Store failure information.
Add admin inspection functionality.
Add retry/replay functionality where appropriate.
Swagger / API Integration
Document GET /admin/queues/dead-letter.
Add admin authentication.
Document job filtering.
Document job response schema.
Document retry/replay endpoint if implemented.
Acceptance Criteria
Permanently failed jobs are retained.
Administrators can inspect failed jobs.
Unauthorized users cannot access dead-letter data.

[Ranjeet2063]

Hey team,

I would love to take this on. My planned approach:

• Trace the regression in ANYTECHS/clips-backend causing [Queue] Implement Dead Letter Queue for Permanently Failed Jobs and implement a targeted, minimal patch.
• Add a reproduction test case to ensure this regression never reoccurs.

Let me know if this approach looks good and please assign!

[guptakumarranjeet150]

Hello @maintainers,

I would like to resolve this issue. Here is my proposed execution plan:

• Implementation: Trace the regression in ANYTECHS/clips-backend causing [Queue] Implement Dead Letter Queue for Permanently Failed Jobs and implement a targeted, minimal fix.
• Testing & Verification: Add a reproduction test case to prevent any future regression.
• Delivery: Ready to ship a thoroughly tested PR within 12–24 hours with passing CI.

Looking forward to contributing—please feel free to assign!

[shobhamerabacha-star]

Hello! I'd like to work on this issue.

I can tackle [Queue] Implement Dead Letter Queue for Permanently Failed Jobs. Proposed implementation roadmap:

• Analysis: Inspect current behavior and edge cases in ANYTECHS/clips-backend
• Implementation: Trace the regression in ANYTECHS/clips-backend causing [Queue] Implement Dead Letter Queue for Permanently Failed Jobs and implement a targeted, minimal fix.
• Testing: Add a reproduction test case to prevent any future regression.
• PR: Atomic commit with clean git hygiene and passing CI

Ready to deliver a clean, tested PR within 12–24 hours. Please assign!