-
Notifications
You must be signed in to change notification settings - Fork 713
Open
Description
Here are the logs that Pyroscope printed:
2025-12-02T11:14:56.287579491+08:00 2025/12/02 03:14:56 maxprocs: Honoring GOMAXPROCS="1" as set in environment
2025-12-02T11:14:56.309484349+08:00
2025-12-02T11:14:56.309494179+08:00 / _|
2025-12-02T11:14:56.309496069+08:00 __ _ _ __ __ _| |_ __ _ _ __ __ _ _ __ _ _ _ __ ___ ___ ___ ___ _ __ ___
2025-12-02T11:14:56.309498410+08:00 / _' | '__/ _' | _/ _' | '_ \ / _' | | '_ \| | | | '__/ _ \/ __|/ __/ _ \| '_ \ / _ \
2025-12-02T11:14:56.309499300+08:00 | (_| | | | (_| | || (_| | | | | (_| | | |_) | |_| | | | (_) \__ \ (_| (_) | |_) | __/
2025-12-02T11:14:56.309499970+08:00 \__, |_| \__,_|_| \__,_|_| |_|\__,_| | .__/ \__, |_| \___/|___/\___\___/| .__/ \___|
2025-12-02T11:14:56.309501100+08:00 __/ | | | __/ | | |
2025-12-02T11:14:56.309501900+08:00 |___/ |_| |___/ |_|
2025-12-02T11:14:56.309502540+08:00
2025-12-02T11:14:56.418942149+08:00 ts=2025-12-02T03:14:56.310111281Z caller=server.go:383 level=info msg="server listening on addresses" http=[::]:4040 grpc=[::]:9095
2025-12-02T11:14:56.418955419+08:00 ts=2025-12-02T03:14:56.313618102Z caller=modules.go:594 level=warn msg="no storage bucket configured, the admin component will not be loaded"
2025-12-02T11:14:56.418957049+08:00 ts=2025-12-02T03:14:56.314117099Z caller=settings.go:42 level=warn component=tenant-settings msg="using in-memory settings store, changes will be lost after shutdown"
2025-12-02T11:14:56.418958069+08:00 ts=2025-12-02T03:14:56.314301826Z caller=modules.go:159 level=warn msg="no storage bucket configured, ad hoc profiles will not be loaded"
2025-12-02T11:14:56.418959259+08:00 ts=2025-12-02T03:14:56.315989764Z caller=worker.go:113 level=info component=querier-worker msg="Starting querier worker connected to query-scheduler" scheduler=
2025-12-02T11:14:56.418959979+08:00 ts=2025-12-02T03:14:56.318138859Z caller=memberlist_client.go:484 level=info msg="Using memberlist cluster label and node name" cluster_label= node=sns-conan-t1-ltpz4-119a3863
2025-12-02T11:14:56.418961299+08:00 ts=2025-12-02T03:14:56.319948061Z caller=module_service.go:82 level=info msg=starting module=server
2025-12-02T11:14:56.418961959+08:00 ts=2025-12-02T03:14:56.321420222Z caller=module_service.go:82 level=info msg=starting module=tenant-settings
2025-12-02T11:14:56.418962649+08:00 ts=2025-12-02T03:14:56.321439113Z caller=module_service.go:82 level=info msg=starting module=memberlist-kv
2025-12-02T11:14:56.418963319+08:00 ts=2025-12-02T03:14:56.321457444Z caller=module_service.go:82 level=info msg=starting module=overrides-exporter
2025-12-02T11:14:56.418964029+08:00 ts=2025-12-02T03:14:56.321514726Z caller=ring.go:365 level=info component=overrides-exporter msg="ring doesn't exist in KV store yet"
2025-12-02T11:14:56.418964679+08:00 ts=2025-12-02T03:14:56.321534216Z caller=module_service.go:82 level=info msg=starting module=version
2025-12-02T11:14:56.418965289+08:00 ts=2025-12-02T03:14:56.321572208Z caller=module_service.go:82 level=info msg=starting module=ring
2025-12-02T11:14:56.418966569+08:00 ts=2025-12-02T03:14:56.32162815Z caller=ring.go:365 level=info component=ring msg="ring doesn't exist in KV store yet"
2025-12-02T11:14:56.418967169+08:00 ts=2025-12-02T03:14:56.32164831Z caller=module_service.go:82 level=info msg=starting module=usage-stats
2025-12-02T11:14:56.418968219+08:00 ts=2025-12-02T03:14:56.322048724Z caller=basic_lifecycler.go:321 level=info component=overrides-exporter msg="instance not found in the ring" instance=sns-conan-t1-ltpz4 ring=overrides-exporter
2025-12-02T11:14:56.418968839+08:00 ts=2025-12-02T03:14:56.322195029Z caller=module_service.go:82 level=info msg=starting module=querier
2025-12-02T11:14:56.418969440+08:00 ts=2025-12-02T03:14:56.322399566Z caller=ring.go:365 level=info component=querier-worker msg="ring doesn't exist in KV store yet"
2025-12-02T11:14:56.418981400+08:00 ts=2025-12-02T03:14:56.322490299Z caller=module_service.go:82 level=info msg=starting module=distributor
2025-12-02T11:14:56.418982350+08:00 ts=2025-12-02T03:14:56.32251599Z caller=module_service.go:82 level=info msg=starting module=ingester
2025-12-02T11:14:56.418982980+08:00 ts=2025-12-02T03:14:56.322579422Z caller=module_service.go:82 level=info msg=starting module=query-scheduler
2025-12-02T11:14:56.418984140+08:00 ts=2025-12-02T03:14:56.322605733Z caller=basic_lifecycler.go:321 level=info component=scheduler msg="instance not found in the ring" instance=sns-conan-t1-ltpz4 ring=query-scheduler
2025-12-02T11:14:56.418984820+08:00 ts=2025-12-02T03:14:56.322677866Z caller=ring.go:204 level=info component=overrides-exporter msg="waiting until overrides-exporter is ACTIVE in the ring"
2025-12-02T11:14:56.418985550+08:00 ts=2025-12-02T03:14:56.322684306Z caller=ring.go:208 level=info component=overrides-exporter msg="overrides-exporter is ACTIVE in the ring"
2025-12-02T11:14:56.418986280+08:00 ts=2025-12-02T03:14:56.322716037Z caller=worker.go:215 level=info component=querier-worker msg="adding connection" addr=10.51.190.253:4040 in-use=true
2025-12-02T11:14:56.418989140+08:00 ts=2025-12-02T03:14:56.32280223Z caller=basic_lifecycler.go:321 level=info component=distributor msg="instance not found in the ring" instance=sns-conan-t1-ltpz4 ring=distributor
2025-12-02T11:14:56.418989850+08:00 ts=2025-12-02T03:14:56.322886043Z caller=lifecycler.go:687 level=info msg="not loading tokens from file, tokens file path is empty"
2025-12-02T11:14:56.418990590+08:00 ts=2025-12-02T03:14:56.322897613Z caller=lifecycler.go:714 level=info msg="instance not found in ring, adding with no tokens" ring=ingester
2025-12-02T11:14:56.418991230+08:00 ts=2025-12-02T03:14:56.322923654Z caller=lifecycler.go:556 level=info msg="auto-joining cluster after timeout" ring=ingester
2025-12-02T11:14:56.418992000+08:00 ts=2025-12-02T03:14:56.322983876Z caller=module_service.go:82 level=info msg=starting module=query-frontend
2025-12-02T11:14:56.418994540+08:00 ts=2025-12-02T03:14:56.323058339Z caller=frontend_scheduler_worker.go:131 level=info component=frontend msg="adding connection to query-scheduler" addr=10.51.190.253:4040
2025-12-02T11:14:56.418995370+08:00 ts=2025-12-02T03:14:56.32338213Z caller=signals.go:62 level=info msg="=== received SIGINT/SIGTERM ===\n*** exiting"
2025-12-02T11:14:56.418996050+08:00 ts=2025-12-02T03:14:56.323935479Z caller=module_service.go:120 level=info msg="module stopped" module=tenant-settings
2025-12-02T11:14:56.418997310+08:00 ts=2025-12-02T03:14:56.323984671Z caller=frontend_scheduler_worker.go:281 level=error component=frontend msg="error contacting scheduler" err="rpc error: code = Canceled desc = context canceled while waiting for connections to become ready" addr=10.51.190.253:4040
2025-12-02T11:14:56.419000471+08:00 ts=2025-12-02T03:14:56.324008862Z caller=scheduler_processor.go:177 level=warn component=querier-worker msg="error contacting scheduler" err="rpc error: code = Canceled desc = context canceled while waiting for connections to become ready" addr=10.51.190.253:4040
2025-12-02T11:14:56.419001261+08:00 ts=2025-12-02T03:14:56.324108715Z caller=scheduler_processor.go:177 level=warn component=querier-worker msg="error contacting scheduler" err="rpc error: code = Canceled desc = context canceled while waiting for connections to become ready" addr=10.51.190.253:4040
2025-12-02T11:14:56.419001871+08:00 ts=2025-12-02T03:14:56.324121956Z caller=scheduler_processor.go:177 level=warn component=querier-worker msg="error contacting scheduler" err="rpc error: code = Canceled desc = context canceled while waiting for connections to become ready" addr=10.51.190.253:4040
2025-12-02T11:14:56.419002531+08:00 ts=2025-12-02T03:14:56.324141696Z caller=basic_lifecycler.go:262 level=info component=distributor msg="ring lifecycler is shutting down" ring=distributor
2025-12-02T11:14:56.419005131+08:00 ts=2025-12-02T03:14:56.32423081Z caller=scheduler_processor.go:177 level=warn component=querier-worker msg="error contacting scheduler" err="rpc error: code = Canceled desc = context canceled while waiting for connections to become ready" addr=10.51.190.253:4040
2025-12-02T11:14:56.419006021+08:00 ts=2025-12-02T03:14:56.32424698Z caller=basic_lifecycler.go:262 level=info component=scheduler msg="ring lifecycler is shutting down" ring=query-scheduler
2025-12-02T11:14:56.419006671+08:00 ts=2025-12-02T03:14:56.324275071Z caller=frontend_scheduler_worker.go:281 level=error component=frontend msg="error contacting scheduler" err="rpc error: code = Canceled desc = context canceled while waiting for connections to become ready" addr=10.51.190.253:4040
2025-12-02T11:14:56.419007341+08:00 ts=2025-12-02T03:14:56.324283561Z caller=frontend_scheduler_worker.go:281 level=error component=frontend msg="error contacting scheduler" err="rpc error: code = Canceled desc = context canceled while waiting for connections to become ready" addr=10.51.190.253:4040
2025-12-02T11:14:56.419008011+08:00 ts=2025-12-02T03:14:56.324290932Z caller=frontend_scheduler_worker.go:281 level=error component=frontend msg="error contacting scheduler" err="rpc error: code = Canceled desc = context canceled while waiting for connections to become ready" addr=10.51.190.253:4040
2025-12-02T11:14:56.419008611+08:00 ts=2025-12-02T03:14:56.324295702Z caller=frontend_scheduler_worker.go:281 level=error component=frontend msg="error contacting scheduler" err="rpc error: code = Canceled desc = context canceled while waiting for connections to become ready" addr=10.51.190.253:4040
2025-12-02T11:14:56.419009401+08:00 ts=2025-12-02T03:14:56.324400725Z caller=pyroscope.go:644 level=error msg="module failed" module=query-frontend error="starting module query-frontend: context canceled"
2025-12-02T11:14:56.419010111+08:00 ts=2025-12-02T03:14:56.324440477Z caller=basic_lifecycler.go:262 level=info component=overrides-exporter msg="ring lifecycler is shutting down" ring=overrides-exporter
2025-12-02T11:14:56.419010741+08:00 ts=2025-12-02T03:14:56.325151321Z caller=scheduler.go:483 level=info component=scheduler msg="received shutdown notification from querier" querier=sns-conan-t1-ltpz4
2025-12-02T11:14:56.419011471+08:00 ts=2025-12-02T03:14:56.325449122Z caller=pyroscope.go:644 level=error msg="module failed" module=querier error="starting module querier: context canceled"
2025-12-02T11:14:57.418732693+08:00 ts=2025-12-02T03:14:57.324028024Z caller=lifecycler.go:606 level=info msg="lifecycler loop() exited gracefully" ring=ingester
2025-12-02T11:14:57.418745233+08:00 ts=2025-12-02T03:14:57.324068095Z caller=lifecycler.go:990 level=info msg="changing instance state from" old_state=ACTIVE new_state=LEAVING ring=ingester
2025-12-02T11:14:57.418746503+08:00 ts=2025-12-02T03:14:57.325268517Z caller=basic_lifecycler.go:296 level=info component=overrides-exporter msg="keeping instance the ring" ring=overrides-exporter
2025-12-02T11:14:57.418747373+08:00 ts=2025-12-02T03:14:57.325313468Z caller=basic_lifecycler.go:432 level=info component=distributor msg="unregistering instance from ring" ring=distributor
2025-12-02T11:14:57.418748203+08:00 ts=2025-12-02T03:14:57.325331889Z caller=basic_lifecycler.go:302 level=info component=distributor msg="instance removed from the ring" ring=distributor
2025-12-02T11:14:57.418748913+08:00 ts=2025-12-02T03:14:57.32536442Z caller=basic_lifecycler.go:432 level=info component=scheduler msg="unregistering instance from ring" ring=query-scheduler
2025-12-02T11:14:57.418749573+08:00 ts=2025-12-02T03:14:57.325381361Z caller=basic_lifecycler.go:302 level=info component=scheduler msg="instance removed from the ring" ring=query-scheduler
2025-12-02T11:14:57.418750333+08:00 ts=2025-12-02T03:14:57.325398301Z caller=module_service.go:120 level=info msg="module stopped" module=overrides-exporter
2025-12-02T11:14:57.418758214+08:00 ts=2025-12-02T03:14:57.325418312Z caller=module_service.go:120 level=info msg="module stopped" module=distributor
2025-12-02T11:14:57.418759354+08:00 ts=2025-12-02T03:14:57.325433843Z caller=module_service.go:120 level=info msg="module stopped" module=query-scheduler
2025-12-02T11:14:57.418760864+08:00 ts=2025-12-02T03:14:57.325464804Z caller=module_service.go:120 level=info msg="module stopped" module=ring
2025-12-02T11:14:58.418327400+08:00 ts=2025-12-02T03:14:58.324892715Z caller=lifecycler.go:1076 level=info msg="transfers are disabled"
2025-12-02T11:14:58.418342461+08:00 ts=2025-12-02T03:14:58.324938757Z caller=lifecycler.go:1093 level=info msg="lifecycler entering final sleep before shutdown" final_sleep=0s
2025-12-02T11:14:58.418344231+08:00 ts=2025-12-02T03:14:58.324970098Z caller=lifecycler.go:658 level=info msg="instance removed from the KV store" ring=ingester
2025-12-02T11:14:58.418345581+08:00 ts=2025-12-02T03:14:58.32501973Z caller=pyroscope.go:644 level=error msg="module failed" module=ingester error="starting module ingester: context canceled"
2025-12-02T11:14:58.418346701+08:00 ts=2025-12-02T03:14:58.325057461Z caller=module_service.go:120 level=info msg="module stopped" module=version
The tag of docker image is weekly-f147-b3e95303c-amd64. I really appreciate it if someone could help me to solve this problem.
Metadata
Metadata
Assignees
Labels
No labels