Copr build success not reported in checks #2873
Description
What happened? What is the problem?
This may be related with #2799.
However, searching for the build id 9805644 around 11/17/25 4:46:29.440 PM I can see Build id 9805644 not in CoprBuildDB. after Copr event; build end: messages were received. Seems like that some build end handlers were processed before some build start handlers for the same issue.
I am wondering if when the copr build end handler does not find a build id in the db it should wait and retry.
"[2025-11-17 16:45:07,380: INFO/MainProcess] task.steve_jobs.process_message[f742d4d1-877d-4f45-b37d-fd4cfc6ad7a3] Copr event; build start: user:packit copr:containers-container-libs-475 pkg:containers-common build:9805644 ip:13.222.17.138 pid:301388"
"[2025-11-17 16:45:07,371: DEBUG/MainProcess] TaskPool: Apply <function fast_trace_task at 0x7f3b1c1b0c20> (args:('task.steve_jobs.process_message', 'f742d4d1-877d-4f45-b37d-fd4cfc6ad7a3', {'lang': 'py', 'task': 'task.steve_jobs.process_message', 'id': 'f742d4d1-877d-4f45-b37d-fd4cfc6ad7a3', 'shadow': None, 'eta': None, 'expires': None, 'group': None, 'group_index': None, 'retries': 0, 'timelimit': [None, None], 'root_id': 'f742d4d1-877d-4f45-b37d-fd4cfc6ad7a3', 'parent_id': None, 'argsrepr': '()', 'kwargsrepr': ""{'event': {'user': 'packit', 'copr': 'containers-container-libs-475', 'owner': 'packit', 'pkg': 'containers-common', 'build': 9805644, 'chroot': 'fedora-42-x86_64', 'version': '102:0.67.0~dev-1.20251117164446476222.pr475.127.g3826238a9f', 'status': 3, 'ip': '13.222.17.138', 'who': 'backend.worker-rpm_build_worker:9805644-fedora-42-x86_64', 'pid': 301388, 'what': 'build start: user:packit copr:containers-container-libs-475 pkg:containers-common build:9805644 ip:13.222.17.138 pid:301388', 'topic': 'org.fedoraproject.prod.copr.build.start', 'timestamp': 1763397907.361853}, 'source': 'fedora-messaging',... kwargs:{})"
"[2025-11-17 16:45:06,977: INFO/MainProcess] task.steve_jobs.process_message[e1630986-b4b8-400e-806e-6cb659fa806e] Copr event; build start: user:packit copr:containers-container-libs-475 pkg:containers-common build:9805644 ip:44.220.81.18 pid:301368"
"[2025-11-17 16:45:06,973: DEBUG/MainProcess] TaskPool: Apply <function fast_trace_task at 0x7f1e475f8c20> (args:('task.steve_jobs.process_message', 'e1630986-b4b8-400e-806e-6cb659fa806e', {'lang': 'py', 'task': 'task.steve_jobs.process_message', 'id': 'e1630986-b4b8-400e-806e-6cb659fa806e', 'shadow': None, 'eta': None, 'expires': None, 'group': None, 'group_index': None, 'retries': 0, 'timelimit': [None, None], 'root_id': 'e1630986-b4b8-400e-806e-6cb659fa806e', 'parent_id': None, 'argsrepr': '()', 'kwargsrepr': ""{'event': {'user': 'packit', 'copr': 'containers-container-libs-475', 'owner': 'packit', 'pkg': 'containers-common', 'build': 9805644, 'chroot': 'fedora-eln-x86_64', 'version': '102:0.67.0~dev-1.20251117164446476222.pr475.127.g3826238a9f', 'status': 3, 'ip': '44.220.81.18', 'who': 'backend.worker-rpm_build_worker:9805644-fedora-eln-x86_64', 'pid': 301368, 'what': 'build start: user:packit copr:containers-container-libs-475 pkg:containers-common build:9805644 ip:44.220.81.18 pid:301368', 'topic': 'org.fedoraproject.prod.copr.build.start', 'timestamp': 1763397906.96712}, 'source': 'fedora-messaging',... kwargs:{})"
"[2025-11-17 16:44:51,739 INFO packit_service_fedmsg.consumer] [Copr] build end: user:packit copr:containers-container-libs-475 build:9805644 pkg:None version:None ip:98.81.120.94 pid:291283 status:1"
"[2025-11-17 16:45:07,773 INFO packit_service_fedmsg.consumer] [Copr] build start: user:packit copr:containers-container-libs-475 pkg:containers-common build:9805644 ip:13.220.181.204 pid:301416"
"[2025-11-17 16:45:48,167: INFO/MainProcess] task.steve_jobs.process_message[5d533b51-6296-411e-81e1-21ea38d8f08a] Copr event; build end: user:packit copr:containers-container-libs-475 build:9805644 pkg:containers-common version:102:0.67.0~dev-1.20251117164446476222.pr475.127.g3826238a9f ip:75.101.173.205 pid:301372 status:1"
"[2025-11-17 16:45:48,164: DEBUG/MainProcess] TaskPool: Apply <function fast_trace_task at 0x7fe247104c20> (args:('task.steve_jobs.process_message', '5d533b51-6296-411e-81e1-21ea38d8f08a', {'lang': 'py', 'task': 'task.steve_jobs.process_message', 'id': '5d533b51-6296-411e-81e1-21ea38d8f08a', 'shadow': None, 'eta': None, 'expires': None, 'group': None, 'group_index': None, 'retries': 0, 'timelimit': [None, None], 'root_id': '5d533b51-6296-411e-81e1-21ea38d8f08a', 'parent_id': None, 'argsrepr': '()', 'kwargsrepr': ""{'event': {'user': 'packit', 'copr': 'containers-container-libs-475', 'owner': 'packit', 'pkg': 'containers-common', 'build': 9805644, 'chroot': 'centos-stream-10-x86_64', 'version': '102:0.67.0~dev-1.20251117164446476222.pr475.127.g3826238a9f', 'status': 1, 'ip': '75.101.173.205', 'who': 'backend.worker-rpm_build_worker:9805644-centos-stream-10-x86_64', 'pid': 301372, 'what': 'build end: user:packit copr:containers-container-libs-475 build:9805644 pkg:containers-common version:102:0.67.0~dev-1.20251117164446476222.pr475.127.g3826238a9f ip:75.101.173.205 pid:301372 status:1', 'topic':... kwargs:{})"
"[2025-11-17 16:45:07,679: INFO/MainProcess] task.steve_jobs.process_message[17368241-4ad8-4be6-a18e-248880a6cf11] Copr event; build start: user:packit copr:containers-container-libs-475 pkg:containers-common build:9805644 ip:18.232.188.214 pid:301401"
"[2025-11-17 16:45:07,677: DEBUG/MainProcess] TaskPool: Apply <function fast_trace_task at 0x7f53d688cc20> (args:('task.steve_jobs.process_message', '17368241-4ad8-4be6-a18e-248880a6cf11', {'lang': 'py', 'task': 'task.steve_jobs.process_message', 'id': '17368241-4ad8-4be6-a18e-248880a6cf11', 'shadow': None, 'eta': None, 'expires': None, 'group': None, 'group_index': None, 'retries': 0, 'timelimit': [None, None], 'root_id': '17368241-4ad8-4be6-a18e-248880a6cf11', 'parent_id': None, 'argsrepr': '()', 'kwargsrepr': ""{'event': {'user': 'packit', 'copr': 'containers-container-libs-475', 'owner': 'packit', 'pkg': 'containers-common', 'build': 9805644, 'chroot': 'fedora-41-x86_64', 'version': '102:0.67.0~dev-1.20251117164446476222.pr475.127.g3826238a9f', 'status': 3, 'ip': '18.232.188.214', 'who': 'backend.worker-rpm_build_worker:9805644-fedora-41-x86_64', 'pid': 301401, 'what': 'build start: user:packit copr:containers-container-libs-475 pkg:containers-common build:9805644 ip:18.232.188.214 pid:301401', 'topic': 'org.fedoraproject.prod.copr.build.start', 'timestamp': 1763397907.671764}, 'source': 'fedora-messaging',... kwargs:{})"
"[2025-11-17 16:45:07,664 INFO packit_service_fedmsg.consumer] [Copr] build start: user:packit copr:containers-container-libs-475 pkg:containers-common build:9805644 ip:18.232.188.214 pid:301401"
"[2025-11-17 16:45:07,361 INFO packit_service_fedmsg.consumer] [Copr] build start: user:packit copr:containers-container-libs-475 pkg:containers-common build:9805644 ip:13.222.17.138 pid:301388"
"[2025-11-17 16:45:07,282 INFO packit_service_fedmsg.consumer] [Copr] build start: user:packit copr:containers-container-libs-475 pkg:containers-common build:9805644 ip:75.101.173.205 pid:301372"
"[2025-11-17 16:45:47,503: INFO/MainProcess] task.steve_jobs.process_message[0c677dce-f75d-42fd-9003-519701c39a50] Copr event; build end: user:packit copr:containers-container-libs-475 build:9805644 pkg:containers-common version:102:0.67.0~dev-1.20251117164446476222.pr475.127.g3826238a9f ip:13.222.17.138 pid:301388 status:1"
"[2025-11-17 16:45:47,501: DEBUG/MainProcess] TaskPool: Apply <function fast_trace_task at 0x7f1e475f8c20> (args:('task.steve_jobs.process_message', '0c677dce-f75d-42fd-9003-519701c39a50', {'lang': 'py', 'task': 'task.steve_jobs.process_message', 'id': '0c677dce-f75d-42fd-9003-519701c39a50', 'shadow': None, 'eta': None, 'expires': None, 'group': None, 'group_index': None, 'retries': 0, 'timelimit': [None, None], 'root_id': '0c677dce-f75d-42fd-9003-519701c39a50', 'parent_id': None, 'argsrepr': '()', 'kwargsrepr': ""{'event': {'user': 'packit', 'copr': 'containers-container-libs-475', 'owner': 'packit', 'pkg': 'containers-common', 'build': 9805644, 'chroot': 'fedora-42-x86_64', 'version': '102:0.67.0~dev-1.20251117164446476222.pr475.127.g3826238a9f', 'status': 1, 'ip': '13.222.17.138', 'who': 'backend.worker-rpm_build_worker:9805644-fedora-42-x86_64', 'pid': 301388, 'what': 'build end: user:packit copr:containers-container-libs-475 build:9805644 pkg:containers-common version:102:0.67.0~dev-1.20251117164446476222.pr475.127.g3826238a9f ip:13.222.17.138 pid:301388 status:1', 'topic': 'org.fedoraproject.prod.copr.build.end',... kwargs:{})"
"[2025-11-17 16:45:41,958: INFO/MainProcess] task.steve_jobs.process_message[dee426b5-b64a-46e5-85e1-88c7704aa526] Copr event; build end: user:packit copr:containers-container-libs-475 build:9805644 pkg:containers-common version:102:0.67.0~dev-1.20251117164446476222.pr475.127.g3826238a9f ip:18.232.188.214 pid:301401 status:1"
"[2025-11-17 16:45:41,956: DEBUG/MainProcess] TaskPool: Apply <function fast_trace_task at 0x7f3b1c1b0c20> (args:('task.steve_jobs.process_message', 'dee426b5-b64a-46e5-85e1-88c7704aa526', {'lang': 'py', 'task': 'task.steve_jobs.process_message', 'id': 'dee426b5-b64a-46e5-85e1-88c7704aa526', 'shadow': None, 'eta': None, 'expires': None, 'group': None, 'group_index': None, 'retries': 0, 'timelimit': [None, None], 'root_id': 'dee426b5-b64a-46e5-85e1-88c7704aa526', 'parent_id': None, 'argsrepr': '()', 'kwargsrepr': ""{'event': {'user': 'packit', 'copr': 'containers-container-libs-475', 'owner': 'packit', 'pkg': 'containers-common', 'build': 9805644, 'chroot': 'fedora-41-x86_64', 'version': '102:0.67.0~dev-1.20251117164446476222.pr475.127.g3826238a9f', 'status': 1, 'ip': '18.232.188.214', 'who': 'backend.worker-rpm_build_worker:9805644-fedora-41-x86_64', 'pid': 301401, 'what': 'build end: user:packit copr:containers-container-libs-475 build:9805644 pkg:containers-common version:102:0.67.0~dev-1.20251117164446476222.pr475.127.g3826238a9f ip:18.232.188.214 pid:301401 status:1', 'topic':... kwargs:{})"
"[2025-11-17 16:45:41,951 INFO packit_service_fedmsg.consumer] [Copr] build end: user:packit copr:containers-container-libs-475 build:9805644 pkg:containers-common version:102:0.67.0~dev-1.20251117164446476222.pr475.127.g3826238a9f ip:18.232.188.214 pid:301401 status:1"
"[2025-11-17 16:45:07,291: INFO/MainProcess] task.steve_jobs.process_message[1e8d2d4b-8321-4607-917a-00b055c7637a] Copr event; build start: user:packit copr:containers-container-libs-475 pkg:containers-common build:9805644 ip:75.101.173.205 pid:301372"
"[2025-11-17 16:45:07,288: DEBUG/MainProcess] TaskPool: Apply <function fast_trace_task at 0x7f53d688cc20> (args:('task.steve_jobs.process_message', '1e8d2d4b-8321-4607-917a-00b055c7637a', {'lang': 'py', 'task': 'task.steve_jobs.process_message', 'id': '1e8d2d4b-8321-4607-917a-00b055c7637a', 'shadow': None, 'eta': None, 'expires': None, 'group': None, 'group_index': None, 'retries': 0, 'timelimit': [None, None], 'root_id': '1e8d2d4b-8321-4607-917a-00b055c7637a', 'parent_id': None, 'argsrepr': '()', 'kwargsrepr': ""{'event': {'user': 'packit', 'copr': 'containers-container-libs-475', 'owner': 'packit', 'pkg': 'containers-common', 'build': 9805644, 'chroot': 'centos-stream-10-x86_64', 'version': '102:0.67.0~dev-1.20251117164446476222.pr475.127.g3826238a9f', 'status': 3, 'ip': '75.101.173.205', 'who': 'backend.worker-rpm_build_worker:9805644-centos-stream-10-x86_64', 'pid': 301372, 'what': 'build start: user:packit copr:containers-container-libs-475 pkg:containers-common build:9805644 ip:75.101.173.205 pid:301372', 'topic': 'org.fedoraproject.prod.copr.build.start', 'timestamp': 1763397907.28232}, 'source':... kwargs:{})"
"[2025-11-17 16:45:06,864: INFO/MainProcess] task.steve_jobs.process_message[213c08b9-45fe-4028-aa4f-ccc704127fc0] Copr event; build start: user:packit copr:containers-container-libs-475 pkg:containers-common build:9805644 ip:98.81.120.94 pid:301310"
"[2025-11-17 16:45:06,862: DEBUG/MainProcess] TaskPool: Apply <function fast_trace_task at 0x7f53d688cc20> (args:('task.steve_jobs.process_message', '213c08b9-45fe-4028-aa4f-ccc704127fc0', {'lang': 'py', 'task': 'task.steve_jobs.process_message', 'id': '213c08b9-45fe-4028-aa4f-ccc704127fc0', 'shadow': None, 'eta': None, 'expires': None, 'group': None, 'group_index': None, 'retries': 0, 'timelimit': [None, None], 'root_id': '213c08b9-45fe-4028-aa4f-ccc704127fc0', 'parent_id': None, 'argsrepr': '()', 'kwargsrepr': ""{'event': {'user': 'packit', 'copr': 'containers-container-libs-475', 'owner': 'packit', 'pkg': 'containers-common', 'build': 9805644, 'chroot': 'fedora-rawhide-x86_64', 'version': '102:0.67.0~dev-1.20251117164446476222.pr475.127.g3826238a9f', 'status': 3, 'ip': '98.81.120.94', 'who': 'backend.worker-rpm_build_worker:9805644-fedora-rawhide-x86_64', 'pid': 301310, 'what': 'build start: user:packit copr:containers-container-libs-475 pkg:containers-common build:9805644 ip:98.81.120.94 pid:301310', 'topic': 'org.fedoraproject.prod.copr.build.start', 'timestamp': 1763397906.76344}, 'source': 'fedora-messaging',... kwargs:{})"
"[2025-11-17 16:45:06,966 INFO packit_service_fedmsg.consumer] [Copr] build start: user:packit copr:containers-container-libs-475 pkg:containers-common build:9805644 ip:44.220.81.18 pid:301368"
"[2025-11-17 16:45:06,763 INFO packit_service_fedmsg.consumer] [Copr] build start: user:packit copr:containers-container-libs-475 pkg:containers-common build:9805644 ip:98.81.120.94 pid:301310"
"[2025-11-17 16:45:06,733: INFO/MainProcess] task.steve_jobs.process_message[c515f867-b5fb-4f16-a2e7-0b0d78461cd9] Copr event; build start: user:packit copr:containers-container-libs-475 pkg:containers-common build:9805644 ip:18.232.86.84 pid:301315"
"[2025-11-17 16:45:06,725: DEBUG/MainProcess] TaskPool: Apply <function fast_trace_task at 0x7fe247104c20> (args:('task.steve_jobs.process_message', 'c515f867-b5fb-4f16-a2e7-0b0d78461cd9', {'lang': 'py', 'task': 'task.steve_jobs.process_message', 'id': 'c515f867-b5fb-4f16-a2e7-0b0d78461cd9', 'shadow': None, 'eta': None, 'expires': None, 'group': None, 'group_index': None, 'retries': 0, 'timelimit': [None, None], 'root_id': 'c515f867-b5fb-4f16-a2e7-0b0d78461cd9', 'parent_id': None, 'argsrepr': '()', 'kwargsrepr': ""{'event': {'user': 'packit', 'copr': 'containers-container-libs-475', 'owner': 'packit', 'pkg': 'containers-common', 'build': 9805644, 'chroot': 'fedora-43-x86_64', 'version': '102:0.67.0~dev-1.20251117164446476222.pr475.127.g3826238a9f', 'status': 3, 'ip': '18.232.86.84', 'who': 'backend.worker-rpm_build_worker:9805644-fedora-43-x86_64', 'pid': 301315, 'what': 'build start: user:packit copr:containers-container-libs-475 pkg:containers-common build:9805644 ip:18.232.86.84 pid:301315', 'topic': 'org.fedoraproject.prod.copr.build.start', 'timestamp': 1763397906.718661}, 'source': 'fedora-messaging',... kwargs:{})"
"[2025-11-17 16:45:47,495 INFO packit_service_fedmsg.consumer] [Copr] build end: user:packit copr:containers-container-libs-475 build:9805644 pkg:containers-common version:102:0.67.0~dev-1.20251117164446476222.pr475.127.g3826238a9f ip:13.222.17.138 pid:301388 status:1"
"[2025-11-17 16:45:08,577: INFO/MainProcess] task.steve_jobs.process_message[cc9687e3-52cd-46c0-8130-0c58433cec5e] Copr event; build start: user:packit copr:containers-container-libs-475 pkg:containers-common build:9805644 ip:13.220.181.204 pid:301416"
"[2025-11-17 16:45:08,574: DEBUG/MainProcess] TaskPool: Apply <function fast_trace_task at 0x7f1e475f8c20> (args:('task.steve_jobs.process_message', 'cc9687e3-52cd-46c0-8130-0c58433cec5e', {'lang': 'py', 'task': 'task.steve_jobs.process_message', 'id': 'cc9687e3-52cd-46c0-8130-0c58433cec5e', 'shadow': None, 'eta': None, 'expires': None, 'group': None, 'group_index': None, 'retries': 0, 'timelimit': [None, None], 'root_id': 'cc9687e3-52cd-46c0-8130-0c58433cec5e', 'parent_id': None, 'argsrepr': '()', 'kwargsrepr': ""{'event': {'user': 'packit', 'copr': 'containers-container-libs-475', 'owner': 'packit', 'pkg': 'containers-common', 'build': 9805644, 'chroot': 'centos-stream-9-x86_64', 'version': '102:0.67.0~dev-1.20251117164446476222.pr475.127.g3826238a9f', 'status': 3, 'ip': '13.220.181.204', 'who': 'backend.worker-rpm_build_worker:9805644-centos-stream-9-x86_64', 'pid': 301416, 'what': 'build start: user:packit copr:containers-container-libs-475 pkg:containers-common build:9805644 ip:13.220.181.204 pid:301416', 'topic': 'org.fedoraproject.prod.copr.build.start', 'timestamp': 1763397907.773832}, 'source':... kwargs:{})"
"[2025-11-17 16:45:06,718 INFO packit_service_fedmsg.consumer] [Copr] build start: user:packit copr:containers-container-libs-475 pkg:containers-common build:9805644 ip:18.232.86.84 pid:301315"
"[2025-11-17 16:44:02,694: INFO/MainProcess] task.steve_jobs.process_message[c60dcff9-28d0-4c09-8e7b-5a2cb414c031] Copr event; build start: user:packit copr:containers-container-libs-475 pkg:None build:9805644 ip:98.81.120.94 pid:291283"
"[2025-11-17 16:44:02,691: DEBUG/MainProcess] TaskPool: Apply <function fast_trace_task at 0x7f53d688cc20> (args:('task.steve_jobs.process_message', 'c60dcff9-28d0-4c09-8e7b-5a2cb414c031', {'lang': 'py', 'task': 'task.steve_jobs.process_message', 'id': 'c60dcff9-28d0-4c09-8e7b-5a2cb414c031', 'shadow': None, 'eta': None, 'expires': None, 'group': None, 'group_index': None, 'retries': 0, 'timelimit': [None, None], 'root_id': 'c60dcff9-28d0-4c09-8e7b-5a2cb414c031', 'parent_id': None, 'argsrepr': '()', 'kwargsrepr': ""{'event': {'user': 'packit', 'copr': 'containers-container-libs-475', 'owner': 'packit', 'pkg': None, 'build': 9805644, 'chroot': 'srpm-builds', 'version': None, 'status': 3, 'ip': '98.81.120.94', 'who': 'backend.worker-rpm_build_worker:9805644', 'pid': 291283, 'what': 'build start: user:packit copr:containers-container-libs-475 pkg:None build:9805644 ip:98.81.120.94 pid:291283', 'topic': 'org.fedoraproject.prod.copr.build.start', 'timestamp': 1763397842.684243}, 'source': 'fedora-messaging', 'event_type': 'copr.build.start'}"", 'origin': 'gen1@packit-service-fedmsg-79c67946ff-n54q6', 'ignore_result': False,... kwargs:{})"
"[2025-11-17 16:45:45,483 INFO packit_service_fedmsg.consumer] [Copr] build end: user:packit copr:containers-container-libs-475 build:9805644 pkg:containers-common version:102:0.67.0~dev-1.20251117164446476222.pr475.127.g3826238a9f ip:98.81.120.94 pid:301310 status:1"
"[2025-11-17 16:45:38,279 INFO packit_service_fedmsg.consumer] [Copr] build end: user:packit copr:containers-container-libs-475 build:9805644 pkg:containers-common version:102:0.67.0~dev-1.20251117164446476222.pr475.127.g3826238a9f ip:18.232.86.84 pid:301315 status:1"
"[2025-11-17 16:45:38,419: INFO/MainProcess] task.steve_jobs.process_message[b4f333cb-8651-4f45-9fd0-76d420907f6b] Copr event; build end: user:packit copr:containers-container-libs-475 build:9805644 pkg:containers-common version:102:0.67.0~dev-1.20251117164446476222.pr475.127.g3826238a9f ip:18.232.86.84 pid:301315 status:1"
"[2025-11-17 16:45:38,366: DEBUG/MainProcess] TaskPool: Apply <function fast_trace_task at 0x7fe247104c20> (args:('task.steve_jobs.process_message', 'b4f333cb-8651-4f45-9fd0-76d420907f6b', {'lang': 'py', 'task': 'task.steve_jobs.process_message', 'id': 'b4f333cb-8651-4f45-9fd0-76d420907f6b', 'shadow': None, 'eta': None, 'expires': None, 'group': None, 'group_index': None, 'retries': 0, 'timelimit': [None, None], 'root_id': 'b4f333cb-8651-4f45-9fd0-76d420907f6b', 'parent_id': None, 'argsrepr': '()', 'kwargsrepr': ""{'event': {'user': 'packit', 'copr': 'containers-container-libs-475', 'owner': 'packit', 'pkg': 'containers-common', 'build': 9805644, 'chroot': 'fedora-43-x86_64', 'version': '102:0.67.0~dev-1.20251117164446476222.pr475.127.g3826238a9f', 'status': 1, 'ip': '18.232.86.84', 'who': 'backend.worker-rpm_build_worker:9805644-fedora-43-x86_64', 'pid': 301315, 'what': 'build end: user:packit copr:containers-container-libs-475 build:9805644 pkg:containers-common version:102:0.67.0~dev-1.20251117164446476222.pr475.127.g3826238a9f ip:18.232.86.84 pid:301315 status:1', 'topic': 'org.fedoraproject.prod.copr.build.end',... kwargs:{})"
"[2025-11-17 16:46:29,434: INFO/MainProcess] task.steve_jobs.process_message[18808de4-5072-4216-817d-81d87ed2f968] Copr event; build end: user:packit copr:containers-container-libs-475 build:9805644 pkg:containers-common version:102:0.67.0~dev-1.20251117164446476222.pr475.127.g3826238a9f ip:13.220.181.204 pid:301416 status:1"
"[2025-11-17 16:46:29,409: DEBUG/MainProcess] TaskPool: Apply <function fast_trace_task at 0x7fe247104c20> (args:('task.steve_jobs.process_message', '18808de4-5072-4216-817d-81d87ed2f968', {'lang': 'py', 'task': 'task.steve_jobs.process_message', 'id': '18808de4-5072-4216-817d-81d87ed2f968', 'shadow': None, 'eta': None, 'expires': None, 'group': None, 'group_index': None, 'retries': 0, 'timelimit': [None, None], 'root_id': '18808de4-5072-4216-817d-81d87ed2f968', 'parent_id': None, 'argsrepr': '()', 'kwargsrepr': ""{'event': {'user': 'packit', 'copr': 'containers-container-libs-475', 'owner': 'packit', 'pkg': 'containers-common', 'build': 9805644, 'chroot': 'centos-stream-9-x86_64', 'version': '102:0.67.0~dev-1.20251117164446476222.pr475.127.g3826238a9f', 'status': 1, 'ip': '13.220.181.204', 'who': 'backend.worker-rpm_build_worker:9805644-centos-stream-9-x86_64', 'pid': 301416, 'what': 'build end: user:packit copr:containers-container-libs-475 build:9805644 pkg:containers-common version:102:0.67.0~dev-1.20251117164446476222.pr475.127.g3826238a9f ip:13.220.181.204 pid:301416 status:1', 'topic':... kwargs:{})"
"[2025-11-17 16:46:29,358 INFO packit_service_fedmsg.consumer] [Copr] build end: user:packit copr:containers-container-libs-475 build:9805644 pkg:containers-common version:102:0.67.0~dev-1.20251117164446476222.pr475.127.g3826238a9f ip:13.220.181.204 pid:301416 status:1"
"[2025-11-17 16:44:02,684 INFO packit_service_fedmsg.consumer] [Copr] build start: user:packit copr:containers-container-libs-475 pkg:None build:9805644 ip:98.81.120.94 pid:291283"
"[2025-11-17 16:45:45,499: INFO/MainProcess] task.steve_jobs.process_message[bb2b2e45-05e3-4e8d-a2e1-9f596269c051] Copr event; build end: user:packit copr:containers-container-libs-475 build:9805644 pkg:containers-common version:102:0.67.0~dev-1.20251117164446476222.pr475.127.g3826238a9f ip:98.81.120.94 pid:301310 status:1"
"[2025-11-17 16:45:45,492: DEBUG/MainProcess] TaskPool: Apply <function fast_trace_task at 0x7f1e475f8c20> (args:('task.steve_jobs.process_message', 'bb2b2e45-05e3-4e8d-a2e1-9f596269c051', {'lang': 'py', 'task': 'task.steve_jobs.process_message', 'id': 'bb2b2e45-05e3-4e8d-a2e1-9f596269c051', 'shadow': None, 'eta': None, 'expires': None, 'group': None, 'group_index': None, 'retries': 0, 'timelimit': [None, None], 'root_id': 'bb2b2e45-05e3-4e8d-a2e1-9f596269c051', 'parent_id': None, 'argsrepr': '()', 'kwargsrepr': ""{'event': {'user': 'packit', 'copr': 'containers-container-libs-475', 'owner': 'packit', 'pkg': 'containers-common', 'build': 9805644, 'chroot': 'fedora-rawhide-x86_64', 'version': '102:0.67.0~dev-1.20251117164446476222.pr475.127.g3826238a9f', 'status': 1, 'ip': '98.81.120.94', 'who': 'backend.worker-rpm_build_worker:9805644-fedora-rawhide-x86_64', 'pid': 301310, 'what': 'build end: user:packit copr:containers-container-libs-475 build:9805644 pkg:containers-common version:102:0.67.0~dev-1.20251117164446476222.pr475.127.g3826238a9f ip:98.81.120.94 pid:301310 status:1', 'topic':... kwargs:{})"
"[2025-11-17 16:45:48,075 INFO packit_service_fedmsg.consumer] [Copr] build end: user:packit copr:containers-container-libs-475 build:9805644 pkg:containers-common version:102:0.67.0~dev-1.20251117164446476222.pr475.127.g3826238a9f ip:75.101.173.205 pid:301372 status:1"
"[2025-11-17 16:45:39,773 INFO packit_service_fedmsg.consumer] [Copr] build end: user:packit copr:containers-container-libs-475 build:9805644 pkg:containers-common version:102:0.67.0~dev-1.20251117164446476222.pr475.127.g3826238a9f ip:44.220.81.18 pid:301368 status:1"
"[2025-11-17 16:45:39,874: INFO/MainProcess] task.steve_jobs.process_message[c17031ea-bce4-4a47-9226-3c469a3eb70a] Copr event; build end: user:packit copr:containers-container-libs-475 build:9805644 pkg:containers-common version:102:0.67.0~dev-1.20251117164446476222.pr475.127.g3826238a9f ip:44.220.81.18 pid:301368 status:1"
"[2025-11-17 16:45:39,871: DEBUG/MainProcess] TaskPool: Apply <function fast_trace_task at 0x7f53d688cc20> (args:('task.steve_jobs.process_message', 'c17031ea-bce4-4a47-9226-3c469a3eb70a', {'lang': 'py', 'task': 'task.steve_jobs.process_message', 'id': 'c17031ea-bce4-4a47-9226-3c469a3eb70a', 'shadow': None, 'eta': None, 'expires': None, 'group': None, 'group_index': None, 'retries': 0, 'timelimit': [None, None], 'root_id': 'c17031ea-bce4-4a47-9226-3c469a3eb70a', 'parent_id': None, 'argsrepr': '()', 'kwargsrepr': ""{'event': {'user': 'packit', 'copr': 'containers-container-libs-475', 'owner': 'packit', 'pkg': 'containers-common', 'build': 9805644, 'chroot': 'fedora-eln-x86_64', 'version': '102:0.67.0~dev-1.20251117164446476222.pr475.127.g3826238a9f', 'status': 1, 'ip': '44.220.81.18', 'who': 'backend.worker-rpm_build_worker:9805644-fedora-eln-x86_64', 'pid': 301368, 'what': 'build end: user:packit copr:containers-container-libs-475 build:9805644 pkg:containers-common version:102:0.67.0~dev-1.20251117164446476222.pr475.127.g3826238a9f ip:44.220.81.18 pid:301368 status:1', 'topic': 'org.fedoraproject.prod.copr.build.end',... kwargs:{})"
"[2025-11-17 16:44:51,749: INFO/MainProcess] task.steve_jobs.process_message[3b9d28f1-5edc-4c07-bf67-9de58927411f] Copr event; build end: user:packit copr:containers-container-libs-475 build:9805644 pkg:None version:None ip:98.81.120.94 pid:291283 status:1"
"[2025-11-17 16:44:51,745: DEBUG/MainProcess] TaskPool: Apply <function fast_trace_task at 0x7f53d688cc20> (args:('task.steve_jobs.process_message', '3b9d28f1-5edc-4c07-bf67-9de58927411f', {'lang': 'py', 'task': 'task.steve_jobs.process_message', 'id': '3b9d28f1-5edc-4c07-bf67-9de58927411f', 'shadow': None, 'eta': None, 'expires': None, 'group': None, 'group_index': None, 'retries': 0, 'timelimit': [None, None], 'root_id': '3b9d28f1-5edc-4c07-bf67-9de58927411f', 'parent_id': None, 'argsrepr': '()', 'kwargsrepr': ""{'event': {'user': 'packit', 'copr': 'containers-container-libs-475', 'owner': 'packit', 'pkg': None, 'build': 9805644, 'chroot': 'srpm-builds', 'version': None, 'status': 1, 'ip': '98.81.120.94', 'who': 'backend.worker-rpm_build_worker:9805644', 'pid': 291283, 'what': 'build end: user:packit copr:containers-container-libs-475 build:9805644 pkg:None version:None ip:98.81.120.94 pid:291283 status:1', 'topic': 'org.fedoraproject.prod.copr.build.end', 'timestamp': 1763397891.739289}, 'source': 'fedora-messaging', 'event_type': 'copr.build.end'}"", 'origin': 'gen1@packit-service-fedmsg-79c67946ff-n54q6',... kwargs:{})"
What did you expect to happen?
No response
Example URL(s)
No response
Steps to reproduce
1.
2.
3.What is the impacted category (job)?
Copr builds
Workaround
- There is an existing workaround that can be used until this issue is fixed.
Participation
- I am willing to submit a pull request for this issue. (Packit team is happy to help!)