Skip to content

Priority queues #45

@psilabs-dev

Description

@psilabs-dev

By default, we should assign 3 tiers of priority to the following tasks:

  • Download artworks by artwork: highest priority (same for novel in future)
  • Download artworks by artist: medium priority
  • Download artworks by tag: low priority
  • Download artwork metadata: medium priority
  • Download artist metadata: medium priority
  • Download series/tag metadata: low priority

Priority reasoning:

  • How important/valuable is the perceived task to the user?
  • How quickly can the task be done? Will the task block other tasks?
  • How likely will data in the task be removed in the future?

Priority only applies to the worker's next task; it doesn't matter that the worker's current task is low-priority, the next task must be highest priority.

Requires confirming that rabbitmq prefetch count is 1 via configuration.

It is possible to update the API to provide a priority override setting.

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions