Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Babysit task for pull from upstream jobs #2286

Open
1 of 2 tasks
majamassarini opened this issue Dec 18, 2023 · 2 comments
Open
1 of 2 tasks

Babysit task for pull from upstream jobs #2286

majamassarini opened this issue Dec 18, 2023 · 2 comments
Labels
area/general Related to whole service, not a specific part/integration. complexity/single-task Regular task, should be done within days. gain/low This doesn't bring that much value to users. impact/high This issue impacts multiple/lot of users. kind/feature New feature or a request for enhancement. kind/internal Doesn't affect users directly, may be e.g. infrastructure, DB related.

Comments

@majamassarini
Copy link
Member

Description

After this exception

This pull from upstream target job is still running and all others targets are queued.

Probably a babysit task could have helped here.

Benefit

No response

Importance

No response

What is the impacted category (job)?

Fedora release automation

Workaround

  • There is an existing workaround that can be used until this feature is implemented.

Participation

  • I am willing to submit a pull request for this issue. (Packit team is happy to help!)
@majamassarini majamassarini added the kind/feature New feature or a request for enhancement. label Dec 18, 2023
@nforro
Copy link
Member

nforro commented Dec 18, 2023

The reason of the stuck jobs is a task that timed out without being handled:

[2023-12-18 12:39:50,841: ERROR/MainProcess] Task handler raised error: TimeLimitExceeded(900)"
Traceback (most recent call last):"
  File ""/usr/local/lib/python3.9/site-packages/billiard/pool.py"", line 683, in on_hard_timeout"
    raise TimeLimitExceeded(job._timeout)"
billiard.einfo.ExceptionWithTraceback: "
"""""""
Traceback (most recent call last):"
  File ""/usr/local/lib/python3.9/site-packages/billiard/pool.py"", line 683, in on_hard_timeout"
    raise TimeLimitExceeded(job._timeout)"
billiard.exceptions.TimeLimitExceeded: TimeLimitExceeded(900,)"
"""""""
[2023-12-18 12:39:51,425: ERROR/MainProcess] Hard time limit (900s) exceeded for pull_from_upstream[03d88e63-29b5-499d-99c9-5d322a60b446]"

@sentry-io Sentry.io
Copy link

sentry-io bot commented Dec 18, 2023

Sentry issue: PCKT-002-PACKIT-SERVICE-68T

@lachmanfrantisek lachmanfrantisek added complexity/single-task Regular task, should be done within days. impact/high This issue impacts multiple/lot of users. area/general Related to whole service, not a specific part/integration. gain/low This doesn't bring that much value to users. kind/internal Doesn't affect users directly, may be e.g. infrastructure, DB related. labels Jan 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
area/general Related to whole service, not a specific part/integration. complexity/single-task Regular task, should be done within days. gain/low This doesn't bring that much value to users. impact/high This issue impacts multiple/lot of users. kind/feature New feature or a request for enhancement. kind/internal Doesn't affect users directly, may be e.g. infrastructure, DB related.
Projects
Packit Kanban Board
Status: backlog
Milestone
No milestone
Development

No branches or pull requests
3 participants
@majamassarini @nforro @lachmanfrantisek