Skip to content

[Critical] Queue is skipping tasks. v0.2.0  #135

Open
@ievgennaida

Description

I have long running tasks that are extensivelly added as batches (every 30 seconds) to the basic queue example

Next queue function is used in the go func:

` err := w.QueueTask(job.TaskFunc(executableAsVariable))

After sime time pools metrics are clearly showing that queue is skipping jobs:

Example:
"BusyWorkers": 57,
"SuccessTasks": 3040,
"FailureTasks": 0,
"SubmittedTasks": 4132,

Configured workers WorkerCount": 2000,

Even if metrics are gooing to 0 busy workers, i still see a lot of pending tasks and query is not recovering them.
No error is returned when tasks are added to the queue.

1037 are lost and never will be executed Comparing to the submitted tasks metrics.
Simple test by adding tasks without actual load works fine.

Another observation that this is happening when system is running for some time.
Fresh starts are always fine.

Windows 
1.2.0

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions