Skip to content

[collect] can't send logs to SigNoz Cloud with version 0.15.0 of k8s-infra chart #815

Description

@LazarPluto

Hi,
With k8s-infra chart 0.15.0, the logs are not send to the SigNoz Cloud. The metrics and kubernetes events are sent.
With version 0.14.2 (and same values.yaml), the logs are sent.

I am not sure how to debug the issue, so I can compare logs from otel-agent.

0.14.2

kubectl logs -n monitoring signoz-k8s-infra-otel-agent-89nrc | grep -i receiver
{"level":"warn","ts":1769082470.9000118,"caller":"metadata/generated_metrics.go:3097","msg":"[WARNING] `container.cpu.utilization` should not be enabled: WARNING: This metric will be disabled in a future release. Use metric container.cpu.usage instead.","kind":"receiver","name":"kubeletstats","data_type":"metrics"}
{"level":"warn","ts":1769082470.9000494,"caller":"metadata/generated_metrics.go:3100","msg":"[WARNING] `k8s.node.cpu.utilization` should not be enabled: WARNING: This metric will be disabled in a future release. Use metric k8s.node.cpu.usage instead.","kind":"receiver","name":"kubeletstats","data_type":"metrics"}
{"level":"warn","ts":1769082470.900059,"caller":"metadata/generated_metrics.go:3103","msg":"[WARNING] `k8s.pod.cpu.utilization` should not be enabled: This metric will be disabled in a future release. Use metric k8s.pod.cpu.usage instead.","kind":"receiver","name":"kubeletstats","data_type":"metrics"}
{"level":"warn","ts":1769082470.9000976,"caller":"metadata/generated_metrics.go:3097","msg":"[WARNING] `container.cpu.utilization` should not be enabled: WARNING: This metric will be disabled in a future release. Use metric container.cpu.usage instead.","kind":"receiver","name":"kubeletstats","data_type":"metrics"}
{"level":"warn","ts":1769082470.9001064,"caller":"metadata/generated_metrics.go:3100","msg":"[WARNING] `k8s.node.cpu.utilization` should not be enabled: WARNING: This metric will be disabled in a future release. Use metric k8s.node.cpu.usage instead.","kind":"receiver","name":"kubeletstats","data_type":"metrics"}
{"level":"warn","ts":1769082470.90011,"caller":"metadata/generated_metrics.go:3103","msg":"[WARNING] `k8s.pod.cpu.utilization` should not be enabled: This metric will be disabled in a future release. Use metric k8s.pod.cpu.usage instead.","kind":"receiver","name":"kubeletstats","data_type":"metrics"}
{"level":"warn","ts":1769082470.9001298,"caller":"metadata/generated_metrics.go:3097","msg":"[WARNING] `container.cpu.utilization` should not be enabled: WARNING: This metric will be disabled in a future release. Use metric container.cpu.usage instead.","kind":"receiver","name":"kubeletstats","data_type":"metrics"}
{"level":"warn","ts":1769082470.900137,"caller":"metadata/generated_metrics.go:3100","msg":"[WARNING] `k8s.node.cpu.utilization` should not be enabled: WARNING: This metric will be disabled in a future release. Use metric k8s.node.cpu.usage instead.","kind":"receiver","name":"kubeletstats","data_type":"metrics"}
{"level":"warn","ts":1769082470.9001408,"caller":"metadata/generated_metrics.go:3103","msg":"[WARNING] `k8s.pod.cpu.utilization` should not be enabled: This metric will be disabled in a future release. Use metric k8s.pod.cpu.usage instead.","kind":"receiver","name":"kubeletstats","data_type":"metrics"}
{"level":"warn","ts":1769082470.9001513,"caller":"metadata/generated_metrics.go:3097","msg":"[WARNING] `container.cpu.utilization` should not be enabled: WARNING: This metric will be disabled in a future release. Use metric container.cpu.usage instead.","kind":"receiver","name":"kubeletstats","data_type":"metrics"}
{"level":"warn","ts":1769082470.9001582,"caller":"metadata/generated_metrics.go:3100","msg":"[WARNING] `k8s.node.cpu.utilization` should not be enabled: WARNING: This metric will be disabled in a future release. Use metric k8s.node.cpu.usage instead.","kind":"receiver","name":"kubeletstats","data_type":"metrics"}
{"level":"warn","ts":1769082470.9001615,"caller":"metadata/generated_metrics.go:3103","msg":"[WARNING] `k8s.pod.cpu.utilization` should not be enabled: This metric will be disabled in a future release. Use metric k8s.pod.cpu.usage instead.","kind":"receiver","name":"kubeletstats","data_type":"metrics"}
{"level":"info","ts":1769082470.9005911,"caller":"container/config.go:92","msg":"`time` log record attribute will be removed in a future release. Switch now using the feature gate.","kind":"receiver","name":"filelog/k8s","data_type":"logs","attribute":"time","feature gate":"filelog.container.removeOriginalTimeField"}
{"level":"info","ts":1769082470.93365,"caller":"adapter/receiver.go:47","msg":"Starting stanza receiver","kind":"receiver","name":"filelog/k8s","data_type":"logs"}
{"level":"info","ts":1769082470.9346013,"caller":"otlpreceiver@v0.109.0/otlp.go:103","msg":"Starting GRPC server","kind":"receiver","name":"otlp","data_type":"traces","endpoint":"0.0.0.0:4317"}
{"level":"info","ts":1769082470.9347107,"caller":"otlpreceiver@v0.109.0/otlp.go:153","msg":"Starting HTTP server","kind":"receiver","name":"otlp","data_type":"traces","endpoint":"0.0.0.0:4318"}
{"level":"info","ts":1769082471.1356547,"caller":"fileconsumer/file.go:256","msg":"Started watching file","kind":"receiver","name":"filelog/k8s","data_type":"logs","component":"fileconsumer","path":"/var/log/pods/REDACTED/0.log"}
{"level":"info","ts":1769082471.1357284,"caller":"fileconsumer/file.go:256","msg":"Started watching file","kind":"receiver","name":"filelog/k8s","data_type":"logs","component":"fileconsumer","path":"/var/log/pods/REDACTED/casino-api/0.log"}
{"level":"info","ts":1769082471.135752,"caller":"fileconsumer/file.go:256","msg":"Started watching file","kind":"receiver","name":"filelog/k8s","data_type":"logs","component":"fileconsumer","path":"/var/log/pods/REDACTED/0.log"}
{"level":"info","ts":1769082471.1358194,"caller":"fileconsumer/file.go:256","msg":"Started watching file","kind":"receiver","name":"filelog/k8s","data_type":"logs","component":"fileconsumer","path":"/var/log/pods/REDACTED/0.log"}
{"level":"info","ts":1769082471.135857,"caller":"fileconsumer/file.go:256","msg":"Started watching file","kind":"receiver","name":"filelog/k8s","data_type":"logs","component":"fileconsumer","path":"/var/log/pods/REDACTED/0.log"}
{"level":"info","ts":1769082471.1365182,"caller":"fileconsumer/file.go:256","msg":"Started watching file","kind":"receiver","name":"filelog/k8s","data_type":"logs","component":"fileconsumer","path":"/var/log/pods/default_prometheus-operator-579c549f7c-59h9z_1cd43f6a-6d7e-4b32-842b-6ad5ced6a77d/prometheus-operator/0.log"}
{"level":"info","ts":1769082471.1365564,"caller":"fileconsumer/file.go:256","msg":"Started watching file","kind":"receiver","name":"filelog/k8s","data_type":"logs","component":"fileconsumer","path":"/var/log/pods/monitoring_signoz-k8s-infra-otel-agent-89nrc_cf862bf9-31f6-40dc-ba7a-71af8129c1a6/signoz-k8s-infra-otel-agent/0.log"}
{"level":"info","ts":1769082471.136578,"caller":"fileconsumer/file.go:256","msg":"Started watching file","kind":"receiver","name":"filelog/k8s","data_type":"logs","component":"fileconsumer","path":"/var/log/pods/vpa_goldilocks-controller-55c758c6dd-9gndm_ec891ead-0f82-4455-b601-80b56fa2ae99/goldilocks/0.log"}
{"level":"info","ts":1769082471.1372185,"caller":"fileconsumer/file.go:256","msg":"Started watching file","kind":"receiver","name":"filelog/k8s","data_type":"logs","component":"fileconsumer","path":"/var/log/pods/vpa_goldilocks-dashboard-84f44f47f4-sxbfq_9d8278eb-28e7-4e1d-ab1c-0de98766d694/goldilocks/0.log"}
{"level":"info","ts":1769082471.1372685,"caller":"fileconsumer/file.go:256","msg":"Started watching file","kind":"receiver","name":"filelog/k8s","data_type":"logs","component":"fileconsumer","path":"/var/log/pods/vpa_vpa-recommender-7fbcd48896-bh5kv_7fb18132-ab22-4109-8ea9-e4017836b0bd/vpa/0.log"}
{"level":"info","ts":1769085085.1359441,"caller":"fileconsumer/file.go:256","msg":"Started watching file","kind":"receiver","name":"filelog/k8s","data_type":"logs","component":"fileconsumer","path":"/var/log/pods/REDACTED/0.log"}

0.15.0

% kubectl logs -n monitoring signoz-k8s-infra-otel-agent-5znfs --tail=1000 | grep -i "receiver"
{"level":"info","ts":"2026-01-22T08:55:29.511Z","caller":"otlpreceiver@v0.139.0/otlp.go:120","msg":"Starting GRPC server","resource":{"service.instance.id":"c5bdbb3c-de19-4857-83c4-9c6de5b0cfb5","service.name":"otelcol-contrib","service.version":"0.139.0"},"otelcol.component.id":"otlp","otelcol.component.kind":"receiver","endpoint":"[::]:4317"}
{"level":"info","ts":"2026-01-22T08:55:29.511Z","caller":"otlpreceiver@v0.139.0/otlp.go:178","msg":"Starting HTTP server","resource":{"service.instance.id":"c5bdbb3c-de19-4857-83c4-9c6de5b0cfb5","service.name":"otelcol-contrib","service.version":"0.139.0"},"otelcol.component.id":"otlp","otelcol.component.kind":"receiver","endpoint":"[::]:4318"}

The version of opentelemetry collector was upgraded to 0.139.0 in the latest chart.

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions