k8s cluster monitor #9550

92ppl · 2022-09-01T07:21:46Z

92ppl
Sep 1, 2022

I want monitor k8s-cluster,k8s-node,k8s-service. but I cant see it in UI.

I deploy skywalking in the k8s use helm and It collect java client ok.

helm install skywalking skywalking/skywalking -n skywalking \
  --set oap.image.tag=9.1.0 \
  --set oap.storageType=elasticsearch \
  --set ui.image.tag=9.1.0 \
  --set elasticsearch.imageTag=6.8.6 \
  --set elasticsearch.volumeClaimTemplate.storageClassName=nfs-v4 \
  --set elasticsearch.volumeClaimTemplate.resources.requests.storage=20Gi \
  --set elasticsearch.persistence.enabled=true \
  --set oap.envoy.als.enabled=true

kube-state-metrics info

➜  kubectl port-forward kube-state-metrics-6fc8f8fc74-9hmrw 8080:8080 -n kube-state-metrics
Forwarding from 127.0.0.1:8080 -> 8080
Forwarding from [::1]:8080 -> 8080

➜  ~ curl http://localhost:8080/metrics
# HELP kube_certificatesigningrequest_annotations Kubernetes annotations converted to Prometheus labels.
# TYPE kube_certificatesigningrequest_annotations gauge
# HELP kube_certificatesigningrequest_labels Kubernetes labels converted to Prometheus labels.
# TYPE kube_certificatesigningrequest_labels gauge
# HELP kube_certificatesigningrequest_created Unix creation timestamp
# TYPE kube_certificatesigningrequest_created gauge
# HELP kube_certificatesigningrequest_condition The number of each certificatesigningrequest condition
# TYPE kube_certificatesigningrequest_condition gauge
# HELP kube_certificatesigningrequest_cert_length Length of the issued cert
# TYPE kube_certificatesigningrequest_cert_length gauge
# HELP kube_configmap_annotations Kubernetes annotations converted to Prometheus labels.
# TYPE kube_configmap_annotations gauge
kube_configmap_annotations{namespace="test",configmap="redis-scripts"} 1
kube_configmap_annotations{namespace="xmt--test",configmap="redis-health"} 1
.....
kube_pod_status_ready{namespace="smc",pod="redis-cd5df7c9b-n5zsg",uid="a2227148-8488-43d1-bf6d-33e92a158f6d",condition="true"} 1
kube_pod_status_ready{namespace="smc",pod="redis-cd5df7c9b-n5zsg",uid="a2227148-8488-43d1-bf6d-33e92a158f6d",condition="false"} 0
kube_pod_status_ready{namespace="smc",pod="redis-cd5df7c9b-n5zsg",uid="a2227148-8488-43d1-bf6d-33e92a158f6d",condition="unknown"} 0
kube_pod_status_ready{namespace="smc",pod="img-handler-etcd-787cbb676c-j4bgx",uid="e8619f64-32b6-44c7-8bae-fb160862e259",condition="true"} 1
kube_pod_status_ready{namespace="smc",pod="img-handler-etcd-787cbb676c-j4bgx",uid="e8619f64-32b6-44c7-8bae-fb160862e259",condition="false"} 0
kube_pod_status_ready{namespace="smc",pod="img-handler-etcd-787cbb676c-j4bgx",uid="e8619f64-32b6-44c7-8bae-fb160862e259",condition="unknown"} 0

cadvisor info

➜  kubectl proxy
Starting to serve on 127.0.0.1:8001

➜  ~ curl http://localhost:8001/api/v1/nodes/k8s-node-vm0ole-s0xd23tzya/proxy/metrics/cadvisor
# HELP cadvisor_version_info A metric with a constant '1' value labeled by kernel version, OS version, docker version, cadvisor version & cadvisor revision.
# TYPE cadvisor_version_info gauge
cadvisor_version_info{cadvisorRevision="",cadvisorVersion="",dockerVersion="18.09.9",kernelVersion="4.19.126-1.jdcloud.x86_64",osVersion="CentOS Linux 7 (Core)"} 1
# HELP container_cpu_cfs_periods_total Number of elapsed enforcement period intervals.
# TYPE container_cpu_cfs_periods_total counter
container_cpu_cfs_periods_total{container="",id="/kubepods/burstable/pod2bdf7ad7-e94e-44ed-9a54-f583d2cf10d0",image="",name="",namespace="icms-jyt",pod="svc-comment-654f7d649b-zdhdk"} 661105 1661936204180
container_cpu_cfs_periods_total{container="",id="/kubepods/burstable/pod6d986ccd-3c41-4d96-86dc-80b0a64d56c9",image="",name="",namespace="elasticsearch",pod="elasticsearch-master-0"} 1.1849574e+07 1661936189877
container_cpu_cfs_periods_total{container="",id="/kubepods/burstable/pod846bf96f-f7d2-4c02-a08c-a11beb96cc9b",image="",name="",namespace="xmt-test",pod="svc-cms-ui-dc8d879d-djtsp"} 3.432542e+06 1661936197451
container_cpu_cfs_periods_total{container="",id="/kubepods/burstable/pod8dd25685-0020-4cad-b764-05244fc837a6",image="",name="",namespace="ai-library",pod="svc-minio-gateway-5f58787d94-gd4x4"} 422683 1661936203486
container_cpu_cfs_periods_total{container="",id="/kubepods/burstable/podc78402a0-5ff9-4a28-bca2-8956f048e17a",image="",name="",namespace="nlp3",pod="kibana-65f8b6dd58-xrsvt"} 3.3625205e+07 1661936196027
container_cpu_cfs_periods_total{container="",id="/kubepods/pod146053b2-7f6f-42bb-b7eb-3c25b730af9b",image="",name="",namespace="kube-system",pod="kube-proxy-kzr2x"} 5.5324818e+07 1661936206761
container_cpu_cfs_periods_total{container="",id="/kubepods/pod3906129a-6011-4a6d-ad02-9d4f83f9d056",image="",name="",namespace="xmt-vote-video-test",pod="ai-vote-video-job-84b6d7766-jwzxq"} 583133 1661936199438
container_cpu_cfs_periods_total{container="",id="/kubepods/pod6c0cc6f1-a1ef-49b8-b6c0-7c05eb4e5c4b",image="",name="",namespace="jke-system",pod="node-exporter-xkprb"} 3.770147e+06 1661936199336
container_cpu_cfs_periods_total{container="",id="/kubepods/podac581d3c-0c91-4fb8-9bfd-153a322a5f83",image="",name="",namespace="kube-system",pod="jdcloud-k8s-ipamd-bz89g"} 3.970091e+06 1661936192294

I deploy otel-collector in k8s according to the showcase , modify skywalking oap address config

service:
  pipelines:
    metrics:
      receivers: [ prometheus ]
      exporters: [ logging, otlp ]
exporters:
  otlp:
    endpoint: "skywalking-oap.skywalking:11800"
    tls:
      insecure: true
  logging:
    loglevel: debug
receivers:
  prometheus:
    config:
      scrape_configs:
      # @feature: kubernetes-monitor; configuration to scrape Kubernetes Nodes metrics
      - job_name: 'kubernetes-cadvisor'
        scheme: https
        tls_config:
          ca_file: /var/run/secrets/kubernetes.io/serviceaccount/ca.crt
        bearer_token_file: /var/run/secrets/kubernetes.io/serviceaccount/token
        kubernetes_sd_configs:
          - role: node
        relabel_configs:
          - action: labelmap
            regex: __meta_kubernetes_node_label_(.+)
          - source_labels: []
            target_label: cluster
            replacement: tikr-test
          - target_label: __address__
            replacement: kubernetes.default.svc:443
          - source_labels: [__meta_kubernetes_node_name]
            regex: (.+)
            target_label: __metrics_path__
            replacement: /api/v1/nodes/$${1}/proxy/metrics/cadvisor
          - source_labels: [instance]
            separator: ;
            regex: (.+)
            target_label: node
            replacement: $$1
            action: replace
      # @feature: kubernetes-monitor; configuration to scrape Kubernetes Endpoints metrics
      - job_name: kube-state-metrics
        metrics_path: /metrics
        kubernetes_sd_configs:
        - role: endpoints
        relabel_configs:
        - source_labels: [__meta_kubernetes_service_label_app_kubernetes_io_name]
          regex: kube-state-metrics
          replacement: $$1
          action: keep
        - action: labelmap
          regex: __meta_kubernetes_service_label_(.+)
        - source_labels: []
          target_label: cluster
          replacement: tikr-test


     -> kubernetes_io_hostname: STRING(k8s-node-vmgmmt-s0xd23tzya)
     -> kubernetes_io_os: STRING(linux)
     -> name: STRING(k8s_POD_material-clean-1659004020-szn98_ronghehao_50730662-80a1-4324-b645-d6f8dcc2134c_0)
     -> namespace: STRING(ronghehao)
     -> node: STRING(k8s-node-vmgmmt-s0xd23tzya)
     -> node_kubernetes_io_instance_type: STRING(g.n2.xlarge)
     -> pod: STRING(material-clean-1659004020-szn98)
     -> topology_kubernetes_io_jdcloud_fd: STRING(2)
     -> topology_kubernetes_io_jdcloud_ng: STRING(ng-s0xd23tzya)
     -> topology_kubernetes_io_region: STRING(cn-north-1)
     -> topology_kubernetes_io_zone: STRING(cn-north-1c)
     -> topology_zbs_csi_jdcloud_com_zone: STRING(cn-north-1c)
StartTimestamp: 2022-09-01 06:42:36.509 +0000 UTC
Timestamp: 2022-09-01 07:16:26.37 +0000 UTC
Value: 0.000000
NumberDataPoints #37
Data point attributes:
     -> beta_kubernetes_io_arch: STRING(amd64)
     -> beta_kubernetes_io_instance_type: STRING(g.n2.xlarge)
     -> beta_kubernetes_io_os: STRING(linux)
     -> cluster: STRING(tikr-test)
     -> cmsserver: STRING(dxserver)
     -> container: STRING(POD)
     -> failure_domain_beta_kubernetes_io_jke_fd: STRING(2)
     -> failure_domain_beta_kubernetes_io_jke_nodegroup: STRING(ng-s0xd23tzya)
     -> failure_domain_beta_kubernetes_io_region: STRING(cn-north-1)
     -> failure_domain_beta_kubernetes_io_zone: STRING(cn-north-1c)
     -> group: STRING(default)
     -> id: STRING(/kubepods/besteffort/pod6f190cb4-a14c-438e-97a7-ac2256d50099/f79e160f558a3fed78545ee221d4f2073989ef2e8b24b9633ecf3394c266c49e)
     -> image: STRING(jdcloud-cn-north-1.jcr.service.jdcloud.com/k8s/pause-amd64:3.1)
     -> interface: STRING(eth0)
     -> kubernetes_io_arch: STRING(amd64)
     -> kubernetes_io_hostname: STRING(k8s-node-vmgmmt-s0xd23tzya)
     -> kubernetes_io_os: STRING(linux)
     -> name: STRING(k8s_POD_svc-search-56f78fdbb-fhlt9_test-gxc_6f190cb4-a14c-438e-97a7-ac2256d50099_0)
     -> namespace: STRING(test-gxc)
     -> node: STRING(k8s-node-vmgmmt-s0xd23tzya)
     -> node_kubernetes_io_instance_type: STRING(g.n2.xlarge)
     -> pod: STRING(svc-search-56f78fdbb-fhlt9)
     -> topology_kubernetes_io_jdcloud_fd: STRING(2)
     -> topology_kubernetes_io_jdcloud_ng: STRING(ng-s0xd23tzya)
     -> topology_kubernetes_io_region: STRING(cn-north-1)
     -> topology_kubernetes_io_zone: STRING(cn-north-1c)
     -> topology_zbs_csi_jdcloud_com_zone: STRING(cn-north-1c)
StartTimestamp: 2022-09-01 06:42:32.46 +0000 UTC
Timestamp: 2022-09-01 07:16:31.619 +0000 UTC
Value: 0.000000
NumberDataPoints #38
Data point attributes:
     -> beta_kubernetes_io_arch: STRING(amd64)
     -> beta_kubernetes_io_instance_type: STRING(g.n2.xlarge)
     -> beta_kubernetes_io_os: STRING(linux)
     -> cluster: STRING(tikr-test)
     -> cms

modify skywalking oap config application.yml and restart

receiver-otel:
  selector: ${SW_OTEL_RECEIVER:default}
  default:
    enabledHandlers: ${SW_OTEL_RECEIVER_ENABLED_HANDLERS:"oc"}
    enabledOcRules: ${SW_OTEL_RECEIVER_ENABLED_OC_RULES:"k8s-cluster,k8s-node,k8s-service"}

Entrypoint] Apache SkyWalking Docker Image
+ exec java -Dmode=no-init -Xmx2g -Xms2g -classpath '/skywalking/ext-libs/*.jar:oap-libs/zstd-jni-1.4.3-1.jar:oap-libs/zookeeper-jute-3.5.7.jar:oap-libs/zookeeper-3.5.7.jar:oap-libs/zipkin-receiver-plugin-9.1.0.jar:oap-libs/zipkin-query-plugin-9.1.0.jar:oap-libs/zipkin-2.23.16.jar:oap-libs/vavr-match-0.10.3.jar:oap-libs/vavr-0.10.3.jar:oap-libs/tool-profile-snapshot-server-mock-9.1.0.jar:oap-libs/tool-profile-snapshot-bootstrap-9.1.0.jar:oap-libs/telemetry-prometheus-9.1.0.jar:oap-libs/telemetry-api-9.1.0.jar:oap-libs/swagger-annotations-1.6.3.jar:oap-libs/storage-tidb-plugin-9.1.0.jar:oap-libs/storage-jdbc-hikaricp-plugin-9.1.0.jar:oap-libs/storage-elasticsearch-plugin-9.1.0.jar:oap-libs/storage-banyandb-plugin-9.1.0.jar:oap-libs/snappy-java-1.1.7.3.jar:oap-libs/snakeyaml-1.28.jar:oap-libs/slf4j-api-1.7.30.jar:oap-libs/skywalking-zabbix-receiver-plugin-9.1.0.jar:oap-libs/skywalking-trace-receiver-plugin-9.1.0.jar:oap-libs/skywalking-sharing-server-plugin-9.1.0.jar:oap-libs/skywalking-profile-receiver-plugin-9.1.0.jar:oap-libs/skywalking-meter-receiver-plugin-9.1.0.jar:oap-libs/skywalking-mesh-receiver-plugin-9.1.0.jar:oap-libs/skywalking-management-receiver-plugin-9.1.0.jar:oap-libs/skywalking-log-recevier-plugin-9.1.0.jar:oap-libs/skywalking-jvm-receiver-plugin-9.1.0.jar:oap-libs/skywalking-event-receiver-plugin-9.1.0.jar:oap-libs/skywalking-ebpf-receiver-plugin-9.1.0.jar:oap-libs/skywalking-clr-receiver-plugin-9.1.0.jar:oap-libs/skywalking-browser-receiver-plugin-9.1.0.jar:oap-libs/simpleclient_httpserver-0.12.0.jar:oap-libs/simpleclient_hotspot-0.6.0.jar:oap-libs/simpleclient_common-0.6.0.jar:oap-libs/simpleclient-0.6.0.jar:oap-libs/server-starter-9.1.0.jar:oap-libs/server-health-checker-9.1.0.jar:oap-libs/server-core-9.1.0.jar:oap-libs/server-alarm-plugin-9.1.0.jar:oap-libs/retrofit-2.5.0.jar:oap-libs/receiver-proto-9.1.0.jar:oap-libs/reactive-streams-1.0.2.jar:oap-libs/query-graphql-plugin-9.1.0.jar:oap-libs/proto-google-common-protos-2.0.1.jar:oap-libs/protobuf-java-util-3.19.4.jar:oap-libs/protobuf-java-3
.19.4.jar:oap-libs/prometheus-fetcher-plugin-9.1.0.jar:oap-libs/postgresql-42.3.3.jar:oap-libs/perfmark-api-0.25.0.jar:oap-libs/otel-receiver-plugin-9.1.0.jar:oap-libs/okio-1.17.2.jar:oap-libs/okhttp-3.14.9.jar:oap-libs/oal-rt-9.1.0.jar:oap-libs/oal-grammar-9.1.0.jar:oap-libs/netty-transport-native-unix-common-4.1.77.Final-linux-x86_64.jar:oap-libs/netty-transport-native-unix-common-4.1.77.Final.jar:oap-libs/netty-transport-native-epoll-4.1.77.Final-linux-x86_64.jar:oap-libs/netty-transport-native-epoll-4.1.77.Final.jar:oap-libs/netty-transport-classes-epoll-4.1.77.Final.jar:oap-libs/netty-transport-4.1.77.Final.jar:oap-libs/netty-tcnative-classes-2.0.52.Final.jar:oap-libs/netty-tcnative-boringssl-static-2.0.52.Final-windows-x86_64.jar:oap-libs/netty-tcnative-boringssl-static-2.0.52.Final-osx-x86_64.jar:oap-libs/netty-tcnative-boringssl-static-2.0.52.Final-osx-aarch_64.jar:oap-libs/netty-tcnative-boringssl-static-2.0.52.Final-linux-x86_64.jar:oap-libs/netty-tcnative-boringssl-static-2.0.52.Final-linux-aarch_64.jar:oap-libs/netty-tcnative-boringssl-static-2.0.52.Final.jar:oap-libs/netty-resolver-dns-native-macos-4.1.77.Final-osx-x86_64.jar:oap-libs/netty-resolver-dns-native-macos-4.1.77.Final-osx-aarch_64.jar:oap-libs/netty-resolver-dns-classes-macos-4.1.77.Final.jar:oap-libs/netty-resolver-dns-4.1.77.Final.jar:oap-libs/netty-resolver-4.1.77.Final.jar:oap-libs/netty-handler-proxy-4.1.77.Final.jar:oap-libs/netty-handler-4.1.77.Final.jar:oap-libs/netty-common-4.1.77.Final.jar:oap-libs/netty-codec-socks-4.1.77.Final.jar:oap-libs/netty-codec-http-4.1.77.Final.jar:oap-libs/netty-codec-http2-4.1.77.Final.jar:oap-libs/netty-codec-haproxy-4.1.77.Final.jar:oap-libs/netty-codec-dns-4.1.77.Final.jar:oap-libs/netty-codec-4.1.77.Final.jar:oap-libs/netty-buffer-4.1.77.Final.jar:oap-libs/nacos-common-1.4.2.jar:oap-libs/nacos-client-1.4.2.jar:oap-libs/nacos-api-1.4.2.jar:oap-libs/mvel2-2.4.8.Final.jar:oap-libs/micrometer-core-1.8.2.jar:oap-libs/meter-analyzer-9.1.0.jar:oap-libs/lz4-java-1.6.0.jar:oap-libs/logging-interceptor-4.9.
1.jar:oap-libs/log-analyzer-9.1.0.jar:oap-libs/log4j-slf4j-impl-2.17.1.jar:oap-libs/log4j-over-slf4j-1.7.30.jar:oap-libs/log4j-core-2.17.1.jar:oap-libs/log4j-api-2.17.1.jar:oap-libs/listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar:oap-libs/library-util-9.1.0.jar:oap-libs/library-server-9.1.0.jar:oap-libs/library-module-9.1.0.jar:oap-libs/library-elasticsearch-client-9.1.0.jar:oap-libs/library-datacarrier-queue-9.1.0.jar:oap-libs/library-client-9.1.0.jar:oap-libs/LatencyUtils-2.0.3.jar:oap-libs/kotlinx-coroutines-reactive-1.5.0-native-mt.jar:oap-libs/kotlinx-coroutines-jdk8-1.5.0-native-mt.jar:oap-libs/kotlinx-coroutines-core-jvm-1.5.0-native-mt.jar:oap-libs/kotlinx-coroutines-core-1.5.0-native-mt.jar:oap-libs/kotlin-stdlib-jdk8-1.5.0.jar:oap-libs/kotlin-stdlib-jdk7-1.5.0.jar:oap-libs/kotlin-stdlib-common-1.5.0.jar:oap-libs/kotlin-stdlib-1.5.0.jar:oap-libs/kotlin-reflect-1.5.0.jar:oap-libs/kafka-fetcher-plugin-9.1.0.jar:oap-libs/kafka-clients-2.4.1.jar:oap-libs/jsr305-3.0.2.jar:oap-libs/jose4j-0.7.9.jar:oap-libs/joda-time-2.10.5.jar:oap-libs/jetcd-resolver-0.5.3.jar:oap-libs/jetcd-core-0.5.3.jar:oap-libs/jetcd-common-0.5.3.jar:oap-libs/jcl-over-slf4j-1.7.30.jar:oap-libs/javax.inject-1.jar:oap-libs/javassist-3.25.0-GA.jar:oap-libs/java-dataloader-3.1.0.jar:oap-libs/jackson-module-kotlin-2.13.1.jar:oap-libs/jackson-module-afterburner-2.12.2.jar:oap-libs/jackson-datatype-jdk8-2.9.10.jar:oap-libs/jackson-datatype-guava-2.9.10.jar:oap-libs/jackson-databind-2.13.2.2.jar:oap-libs/jackson-core-2.13.2.jar:oap-libs/jackson-annotations-2.13.2.jar:oap-libs/j2objc-annotations-1.3.jar:oap-libs/httpcore-nio-4.4.13.jar:oap-libs/httpcore-4.4.13.jar:oap-libs/httpclient-4.5.13.jar:oap-libs/httpasyncclient-4.1.3.jar:oap-libs/HikariCP-3.1.0.jar:oap-libs/HdrHistogram-2.1.12.jar:oap-libs/h2-2.1.212.jar:oap-libs/guice-4.1.0.jar:oap-libs/guava-31.1-jre.jar:oap-libs/gson-fire-1.8.5.jar:oap-libs/gson-2.9.0.jar:oap-libs/grpc-stub-1.46.0.jar:oap-libs/grpc-protobuf-lite-1.46.0.jar:oap-libs/grpc-protobuf-1.46.0.jar:oap-libs/grpc-n
etty-1.46.0.jar:oap-libs/grpc-grpclb-1.46.0.jar:oap-libs/grpc-core-1.46.0.jar:oap-libs/grpc-context-1.46.0.jar:oap-libs/grpc-configuration-sync-9.1.0.jar:oap-libs/grpc-api-1.46.0.jar:oap-libs/groovy-3.0.8.jar:oap-libs/graphql-java-tools-12.0.2.jar:oap-libs/graphql-java-extended-scalars-17.0.jar:oap-libs/graphql-java-17.3.jar:oap-libs/freemarker-2.3.31.jar:oap-libs/flatbuffers-java-1.12.0.jar:oap-libs/failureaccess-1.0.1.jar:oap-libs/failsafe-2.3.4.jar:oap-libs/exporter-9.1.0.jar:oap-libs/event-analyzer-9.1.0.jar:oap-libs/error_prone_annotations-2.11.0.jar:oap-libs/envoy-metrics-receiver-plugin-9.1.0.jar:oap-libs/data-generator-9.1.0.jar:oap-libs/curator-x-discovery-4.3.0.jar:oap-libs/curator-recipes-4.3.0.jar:oap-libs/curator-framework-4.3.0.jar:oap-libs/curator-client-4.3.0.jar:oap-libs/converter-jackson-2.5.0.jar:oap-libs/consul-client-1.4.2.jar:oap-libs/configuration-zookeeper-9.1.0.jar:oap-libs/configuration-nacos-9.1.0.jar:oap-libs/configuration-k8s-configmap-9.1.0.jar:oap-libs/configuration-etcd-9.1.0.jar:oap-libs/configuration-discovery-receiver-plugin-9.1.0.jar:oap-libs/configuration-consul-9.1.0.jar:oap-libs/configuration-apollo-9.1.0.jar:oap-libs/configuration-api-9.1.0.jar:oap-libs/commons-text-1.4.jar:oap-libs/commons-logging-1.2.jar:oap-libs/commons-lang3-3.12.0.jar:oap-libs/commons-io-2.7.jar:oap-libs/commons-compress-1.21.jar:oap-libs/commons-collections4-4.4.jar:oap-libs/commons-codec-1.11.jar:oap-libs/commons-beanutils-1.9.4.jar:oap-libs/cluster-zookeeper-plugin-9.1.0.jar:oap-libs/cluster-standalone-plugin-9.1.0.jar:oap-libs/cluster-nacos-plugin-9.1.0.jar:oap-libs/cluster-kubernetes-plugin-9.1.0.jar:oap-libs/cluster-etcd-plugin-9.1.0.jar:oap-libs/cluster-consul-plugin-9.1.0.jar:oap-libs/client-java-proto-14.0.0.jar:oap-libs/client-java-api-14.0.0.jar:oap-libs/client-java-14.0.0.jar:oap-libs/classmate-1.5.1.jar:oap-libs/checker-qual-3.12.0.jar:oap-libs/brotli4j-1.6.0.jar:oap-libs/bcutil-jdk15on-1.69.jar:oap-libs/bcprov-jdk15on-1.69.jar:oap-libs/bcprov-ext-jdk15on-1.69.jar:oap-libs/bcpkix-jdk15on-1
.69.jar:oap-libs/banyandb-java-client-0.1.0.jar:oap-libs/audience-annotations-0.5.0.jar:oap-libs/armeria-protobuf-1.14.1.jar:oap-libs/armeria-graphql-protocol-1.14.1.jar:oap-libs/armeria-graphql-1.14.1.jar:oap-libs/armeria-1.14.1.jar:oap-libs/apollo-core-1.8.0.jar:oap-libs/apollo-client-1.8.0.jar:oap-libs/apm-network-9.1.0.jar:oap-libs/aopalliance-1.0.jar:oap-libs/antlr4-runtime-4.9.2.jar:oap-libs/annotations-13.0.jar:oap-libs/animal-sniffer-annotations-1.19.jar:oap-libs/agent-analyzer-9.1.0.jar:config:' org.apache.skywalking.oap.server.starter.OAPServerStartUp
2022-09-01 06:50:07,210 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 178 [main] INFO  [] - Remove module receiver-zabbix without any provider
2022-09-01 06:50:07,213 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 178 [main] INFO  [] - Remove module prometheus-fetcher without any provider
2022-09-01 06:50:07,213 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 178 [main] INFO  [] - Remove module kafka-fetcher without any provider
2022-09-01 06:50:07,213 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 178 [main] INFO  [] - Remove module receiver-zipkin without any provider
2022-09-01 06:50:07,213 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 178 [main] INFO  [] - Remove module query-zipkin without any provider
2022-09-01 06:50:07,214 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 178 [main] INFO  [] - Remove module exporter without any provider
2022-09-01 06:50:07,214 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 178 [main] INFO  [] - Remove module health-checker without any provider
2022-09-01 06:50:07,214 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 65 [main] INFO  [] - Get a module define from application.yml, module name: cluster
2022-09-01 06:50:07,215 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 69 [main] INFO  [] - Get a provider define belong to cluster module, provider name: kubernetes
2022-09-01 06:50:07,217 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=kubernetes config=namespace has been set as skywalking
2022-09-01 06:50:07,217 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=kubernetes config=labelSelector has been set as app=skywalking,release=skywalking,component=oap
2022-09-01 06:50:07,217 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=kubernetes config=uidEnvName has been set as SKYWALKING_COLLECTOR_UID
2022-09-01 06:50:07,218 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 65 [main] INFO  [] - Get a module define from application.yml, module name: core
2022-09-01 06:50:07,218 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 69 [main] INFO  [] - Get a provider define belong to core module, provider name: default
2022-09-01 06:50:07,218 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=role has been set as Mixed
2022-09-01 06:50:07,219 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=restHost has been set as 0.0.0.0
2022-09-01 06:50:07,219 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=restPort has been set as 12800
2022-09-01 06:50:07,219 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=restContextPath has been set as /
2022-09-01 06:50:07,220 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=restMaxThreads has been set as 200
2022-09-01 06:50:07,220 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=restIdleTimeOut has been set as 30000
2022-09-01 06:50:07,220 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=restAcceptQueueSize has been set as 0
2022-09-01 06:50:07,221 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=httpMaxRequestHeaderSize has been set as 8192
2022-09-01 06:50:07,221 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=gRPCHost has been set as 0.0.0.0
2022-09-01 06:50:07,221 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=gRPCPort has been set as 11800
2022-09-01 06:50:07,222 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=maxConcurrentCallsPerConnection has been set as 0
2022-09-01 06:50:07,222 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=maxMessageSize has been set as 0
2022-09-01 06:50:07,222 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=gRPCThreadPoolQueueSize has been set as -1
2022-09-01 06:50:07,223 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=gRPCThreadPoolSize has been set as -1
2022-09-01 06:50:07,223 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=gRPCSslEnabled has been set as false
2022-09-01 06:50:07,223 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=gRPCSslKeyPath has been set as 
2022-09-01 06:50:07,223 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=gRPCSslCertChainPath has been set as 
2022-09-01 06:50:07,224 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=gRPCSslTrustedCAPath has been set as 
2022-09-01 06:50:07,225 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=downsampling has been set as [Hour, Day]
2022-09-01 06:50:07,225 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=enableDataKeeperExecutor has been set as true
2022-09-01 06:50:07,225 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=dataKeeperExecutePeriod has been set as 5
2022-09-01 06:50:07,226 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=recordDataTTL has been set as 3
2022-09-01 06:50:07,226 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=metricsDataTTL has been set as 7
2022-09-01 06:50:07,226 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=l1FlushPeriod has been set as 500
2022-09-01 06:50:07,226 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=storageSessionTimeout has been set as 70000
2022-09-01 06:50:07,227 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=persistentPeriod has been set as 25
2022-09-01 06:50:07,227 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=enableDatabaseSession has been set as true
2022-09-01 06:50:07,227 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=topNReportPeriod has been set as 10
2022-09-01 06:50:07,227 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=activeExtraModelColumns has been set as false
2022-09-01 06:50:07,228 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=serviceNameMaxLength has been set as 70
2022-09-01 06:50:07,228 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=instanceNameMaxLength has been set as 70
2022-09-01 06:50:07,228 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=endpointNameMaxLength has been set as 150
2022-09-01 06:50:07,228 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=searchableTracesTags has been set as http.method,http.status_code,rpc.status_code,db.type,db.instance,mq.queue,mq.topic,mq.broker
2022-09-01 06:50:07,228 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=searchableLogsTags has been set as level
2022-09-01 06:50:07,229 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=searchableAlarmTags has been set as level
2022-09-01 06:50:07,229 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=autocompleteTagKeysQueryMaxSize has been set as 100
2022-09-01 06:50:07,229 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=autocompleteTagValuesQueryMaxSize has been set as 100
2022-09-01 06:50:07,229 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=prepareThreads has been set as 2
2022-09-01 06:50:07,230 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=enableEndpointNameGroupingByOpenapi has been set as true
2022-09-01 06:50:07,230 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 65 [main] INFO  [] - Get a module define from application.yml, module name: storage
2022-09-01 06:50:07,230 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 69 [main] INFO  [] - Get a provider define belong to storage module, provider name: elasticsearch
2022-09-01 06:50:07,230 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=elasticsearch config=namespace has been set as 
2022-09-01 06:50:07,230 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=elasticsearch config=clusterNodes has been set as elasticsearch-master:9200
2022-09-01 06:50:07,230 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=elasticsearch config=protocol has been set as http
2022-09-01 06:50:07,231 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=elasticsearch config=connectTimeout has been set as 3000
2022-09-01 06:50:07,232 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=elasticsearch config=socketTimeout has been set as 30000
2022-09-01 06:50:07,232 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=elasticsearch config=responseTimeout has been set as 15000
2022-09-01 06:50:07,232 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=elasticsearch config=numHttpClientThread has been set as 0
2022-09-01 06:50:07,232 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=elasticsearch config=user has been set as 
2022-09-01 06:50:07,233 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=elasticsearch config=password has been set as 
2022-09-01 06:50:07,233 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=elasticsearch config=trustStorePath has been set as 
2022-09-01 06:50:07,233 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=elasticsearch config=trustStorePass has been set as 
2022-09-01 06:50:07,233 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=elasticsearch config=secretsManagementFile has been set as 
2022-09-01 06:50:07,233 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=elasticsearch config=dayStep has been set as 1
2022-09-01 06:50:07,234 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=elasticsearch config=indexShardsNumber has been set as 1
2022-09-01 06:50:07,234 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=elasticsearch config=indexReplicasNumber has been set as 1
2022-09-01 06:50:07,234 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=elasticsearch config=superDatasetDayStep has been set as -1
2022-09-01 06:50:07,234 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=elasticsearch config=superDatasetIndexShardsFactor has been set as 5
2022-09-01 06:50:07,235 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=elasticsearch config=superDatasetIndexReplicasNumber has been set as 0
2022-09-01 06:50:07,235 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=elasticsearch config=indexTemplateOrder has been set as 0
2022-09-01 06:50:07,235 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=elasticsearch config=bulkActions has been set as 5000
2022-09-01 06:50:07,235 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=elasticsearch config=flushInterval has been set as 15
2022-09-01 06:50:07,235 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=elasticsearch config=concurrentRequests has been set as 2
2022-09-01 06:50:07,236 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=elasticsearch config=resultWindowMaxSize has been set as 10000
2022-09-01 06:50:07,236 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=elasticsearch config=metadataQueryMaxSize has been set as 10000
2022-09-01 06:50:07,236 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=elasticsearch config=scrollingBatchSize has been set as 5000
2022-09-01 06:50:07,236 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=elasticsearch config=segmentQueryMaxSize has been set as 200
2022-09-01 06:50:07,236 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=elasticsearch config=profileTaskQueryMaxSize has been set as 200
2022-09-01 06:50:07,237 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=elasticsearch config=profileDataQueryBatchSize has been set as 100
2022-09-01 06:50:07,237 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=elasticsearch config=oapAnalyzer has been set as {"analyzer":{"oap_analyzer":{"type":"stop"}}}
2022-09-01 06:50:07,237 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=elasticsearch config=oapLogAnalyzer has been set as {"analyzer":{"oap_log_analyzer":{"type":"standard"}}}
2022-09-01 06:50:07,237 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=elasticsearch config=advanced has been set as 
2022-09-01 06:50:07,237 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 65 [main] INFO  [] - Get a module define from application.yml, module name: agent-analyzer
2022-09-01 06:50:07,238 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 69 [main] INFO  [] - Get a provider define belong to agent-analyzer module, provider name: default
2022-09-01 06:50:07,238 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=traceSamplingPolicySettingsFile has been set as trace-sampling-policy-settings.yml
2022-09-01 06:50:07,238 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=slowDBAccessThreshold has been set as default:200,mongodb:100
2022-09-01 06:50:07,238 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=forceSampleErrorSegment has been set as true
2022-09-01 06:50:07,239 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=segmentStatusAnalysisStrategy has been set as FROM_SPAN_STATUS
2022-09-01 06:50:07,240 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=noUpstreamRealAddressAgents has been set as 6000,9000
2022-09-01 06:50:07,240 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=meterAnalyzerActiveFiles has been set as datasource,threadpool,satellite
2022-09-01 06:50:07,240 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 65 [main] INFO  [] - Get a module define from application.yml, module name: log-analyzer
2022-09-01 06:50:07,240 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 69 [main] INFO  [] - Get a provider define belong to log-analyzer module, provider name: default
2022-09-01 06:50:07,240 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=lalFiles has been set as default
2022-09-01 06:50:07,240 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=malFiles has been set as 
2022-09-01 06:50:07,241 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 65 [main] INFO  [] - Get a module define from application.yml, module name: event-analyzer
2022-09-01 06:50:07,241 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 69 [main] INFO  [] - Get a provider define belong to event-analyzer module, provider name: default
2022-09-01 06:50:07,241 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 65 [main] INFO  [] - Get a module define from application.yml, module name: receiver-sharing-server
2022-09-01 06:50:07,241 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 69 [main] INFO  [] - Get a provider define belong to receiver-sharing-server module, provider name: default
2022-09-01 06:50:07,241 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=restHost has been set as 0.0.0.0
2022-09-01 06:50:07,241 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=restPort has been set as 0
2022-09-01 06:50:07,241 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=restContextPath has been set as /
2022-09-01 06:50:07,242 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=restMaxThreads has been set as 200
2022-09-01 06:50:07,242 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=restIdleTimeOut has been set as 30000
2022-09-01 06:50:07,242 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=restAcceptQueueSize has been set as 0
2022-09-01 06:50:07,242 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=httpMaxRequestHeaderSize has been set as 8192
2022-09-01 06:50:07,243 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=gRPCHost has been set as 0.0.0.0
2022-09-01 06:50:07,243 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=gRPCPort has been set as 0
2022-09-01 06:50:07,243 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=maxConcurrentCallsPerConnection has been set as 0
2022-09-01 06:50:07,243 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=maxMessageSize has been set as 0
2022-09-01 06:50:07,243 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=gRPCThreadPoolQueueSize has been set as 0
2022-09-01 06:50:07,244 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=gRPCThreadPoolSize has been set as 0
2022-09-01 06:50:07,244 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=gRPCSslEnabled has been set as false
2022-09-01 06:50:07,244 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=gRPCSslKeyPath has been set as 
2022-09-01 06:50:07,244 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=gRPCSslCertChainPath has been set as 
2022-09-01 06:50:07,244 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=gRPCSslTrustedCAsPath has been set as 
2022-09-01 06:50:07,245 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=authentication has been set as 
2022-09-01 06:50:07,245 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 65 [main] INFO  [] - Get a module define from application.yml, module name: receiver-register
2022-09-01 06:50:07,245 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 69 [main] INFO  [] - Get a provider define belong to receiver-register module, provider name: default
2022-09-01 06:50:07,245 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 65 [main] INFO  [] - Get a module define from application.yml, module name: receiver-trace
2022-09-01 06:50:07,245 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 69 [main] INFO  [] - Get a provider define belong to receiver-trace module, provider name: default
2022-09-01 06:50:07,245 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 65 [main] INFO  [] - Get a module define from application.yml, module name: receiver-jvm
2022-09-01 06:50:07,245 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 69 [main] INFO  [] - Get a provider define belong to receiver-jvm module, provider name: default
2022-09-01 06:50:07,245 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 65 [main] INFO  [] - Get a module define from application.yml, module name: receiver-clr
2022-09-01 06:50:07,245 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 69 [main] INFO  [] - Get a provider define belong to receiver-clr module, provider name: default
2022-09-01 06:50:07,246 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 65 [main] INFO  [] - Get a module define from application.yml, module name: receiver-profile
2022-09-01 06:50:07,246 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 69 [main] INFO  [] - Get a provider define belong to receiver-profile module, provider name: default
2022-09-01 06:50:07,246 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 65 [main] INFO  [] - Get a module define from application.yml, module name: service-mesh
2022-09-01 06:50:07,246 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 69 [main] INFO  [] - Get a provider define belong to service-mesh module, provider name: default
2022-09-01 06:50:07,246 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 65 [main] INFO  [] - Get a module define from application.yml, module name: envoy-metric
2022-09-01 06:50:07,246 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 69 [main] INFO  [] - Get a provider define belong to envoy-metric module, provider name: default
2022-09-01 06:50:07,246 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=acceptMetricsService has been set as true
2022-09-01 06:50:07,246 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=alsHTTPAnalysis has been set as 
2022-09-01 06:50:07,247 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=alsTCPAnalysis has been set as 
2022-09-01 06:50:07,247 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=k8sServiceNameRule has been set as ${pod.metadata.labels.(service.istio.io/canonical-name)}
2022-09-01 06:50:07,247 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 65 [main] INFO  [] - Get a module define from application.yml, module name: receiver-meter
2022-09-01 06:50:07,247 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 69 [main] INFO  [] - Get a provider define belong to receiver-meter module, provider name: default
2022-09-01 06:50:07,247 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 65 [main] INFO  [] - Get a module define from application.yml, module name: receiver-otel
2022-09-01 06:50:07,247 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 69 [main] INFO  [] - Get a provider define belong to receiver-otel module, provider name: default
2022-09-01 06:50:07,248 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=enabledHandlers has been set as oc
2022-09-01 06:50:07,248 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=enabledOcRules has been set as k8s-cluster,k8s-node,k8s-service
2022-09-01 06:50:07,248 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 65 [main] INFO  [] - Get a module define from application.yml, module name: receiver-browser
2022-09-01 06:50:07,248 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 69 [main] INFO  [] - Get a provider define belong to receiver-browser module, provider name: default
2022-09-01 06:50:07,248 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=sampleRate has been set as 10000
2022-09-01 06:50:07,248 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 65 [main] INFO  [] - Get a module define from application.yml, module name: receiver-log
2022-09-01 06:50:07,248 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 69 [main] INFO  [] - Get a provider define belong to receiver-log module, provider name: default
2022-09-01 06:50:07,248 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 65 [main] INFO  [] - Get a module define from application.yml, module name: query
2022-09-01 06:50:07,248 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 69 [main] INFO  [] - Get a provider define belong to query module, provider name: graphql
2022-09-01 06:50:07,249 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=graphql config=enableLogTestTool has been set as false
2022-09-01 06:50:07,249 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=graphql config=maxQueryComplexity has been set as 1000
2022-09-01 06:50:07,249 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=graphql config=enableUpdateUITemplate has been set as false
2022-09-01 06:50:07,249 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=graphql config=enableOnDemandPodLog has been set as false
2022-09-01 06:50:07,249 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 65 [main] INFO  [] - Get a module define from application.yml, module name: alarm
2022-09-01 06:50:07,249 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 69 [main] INFO  [] - Get a provider define belong to alarm module, provider name: default
2022-09-01 06:50:07,249 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 65 [main] INFO  [] - Get a module define from application.yml, module name: telemetry
2022-09-01 06:50:07,249 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 69 [main] INFO  [] - Get a provider define belong to telemetry module, provider name: none
2022-09-01 06:50:07,250 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 65 [main] INFO  [] - Get a module define from application.yml, module name: configuration
2022-09-01 06:50:07,250 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 69 [main] INFO  [] - Get a provider define belong to configuration module, provider name: none
2022-09-01 06:50:07,250 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 65 [main] INFO  [] - Get a module define from application.yml, module name: configuration-discovery
2022-09-01 06:50:07,250 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 69 [main] INFO  [] - Get a provider define belong to configuration-discovery module, provider name: default
2022-09-01 06:50:07,250 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 118 [main] INFO  [] - Provider=default config=disableMessageDigest has been set as false
2022-09-01 06:50:07,250 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 65 [main] INFO  [] - Get a module define from application.yml, module name: receiver-event
2022-09-01 06:50:07,250 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 69 [main] INFO  [] - Get a provider define belong to receiver-event module, provider name: default
2022-09-01 06:50:07,250 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 65 [main] INFO  [] - Get a module define from application.yml, module name: receiver-ebpf
2022-09-01 06:50:07,250 org.apache.skywalking.oap.server.starter.config.ApplicationConfigLoader 69 [main] INFO  [] - Get a provider define belong to receiver-ebpf module, provider name: default
2022-09-01 06:50:07,511 org.apache.skywalking.oap.server.library.module.ModuleDefine 89 [main] INFO  [] - Prepare the none provider in telemetry module.
2022-09-01 06:50:07,516 org.apache.skywalking.oap.server.library.module.ModuleDefine 89 [main] INFO  [] - Prepare the default provider in receiver-trace module.
2022-09-01 06:50:07,517 org.apache.skywalking.oap.server.library.module.ModuleDefine 89 [main] INFO  [] - Prepare the default provider in receiver-sharing-server module.
2022-09-01 06:50:07,562 org.apache.skywalking.oap.server.library.module.ModuleDefine 89 [main] INFO  [] - Prepare the default provider in receiver-profile module.
2022-09-01 06:50:07,563 org.apache.skywalking.oap.server.library.module.ModuleDefine 89 [main] INFO  [] - Prepare the default provider in receiver-meter module.
2022-09-01 06:50:07,563 org.apache.skywalking.oap.server.library.module.ModuleDefine 89 [main] INFO  [] - Prepare the default provider in service-mesh module.
2022-09-01 06:50:07,564 org.apache.skywalking.oap.server.library.module.ModuleDefine 89 [main] INFO  [] - Prepare the default provider in receiver-register module.
2022-09-01 06:50:07,564 org.apache.skywalking.oap.server.library.module.ModuleDefine 89 [main] INFO  [] - Prepare the default provider in receiver-log module.
2022-09-01 06:50:07,565 org.apache.skywalking.oap.server.library.module.ModuleDefine 89 [main] INFO  [] - Prepare the default provider in receiver-jvm module.
2022-09-01 06:50:07,565 org.apache.skywalking.oap.server.library.module.ModuleDefine 89 [main] INFO  [] - Prepare the default provider in receiver-event module.
2022-09-01 06:50:07,565 org.apache.skywalking.oap.server.library.module.ModuleDefine 89 [main] INFO  [] - Prepare the default provider in receiver-ebpf module.
2022-09-01 06:50:07,566 org.apache.skywalking.oap.server.library.module.ModuleDefine 89 [main] INFO  [] - Prepare the default provider in receiver-clr module.
2022-09-01 06:50:07,566 org.apache.skywalking.oap.server.library.module.ModuleDefine 89 [main] INFO  [] - Prepare the default provider in receiver-browser module.
2022-09-01 06:50:07,567 org.apache.skywalking.oap.server.library.module.ModuleDefine 89 [main] INFO  [] - Prepare the elasticsearch provider in storage module.
2022-09-01 06:50:07,617 org.apache.skywalking.oap.server.library.module.ModuleDefine 89 [main] INFO  [] - Prepare the kubernetes provider in cluster module.
2022-09-01 06:50:07,619 org.apache.skywalking.oap.server.library.module.ModuleDefine 89 [main] INFO  [] - Prepare the default provider in core module.
2022-09-01 06:50:08,808 org.apache.skywalking.oap.server.library.server.grpc.GRPCServer 108 [main] INFO  [] - Server started, host 0.0.0.0 listening on 11800
2022-09-01 06:50:08,875 com.linecorp.armeria.common.Flags 1464 [main] INFO  [] - com.linecorp.armeria.verboseExceptions: rate-limit=10 (default)
2022-09-01 06:50:08,881 com.linecorp.armeria.common.Flags 1464 [main] INFO  [] - com.linecorp.armeria.preferredIpV4Addresses:  (default)
2022-09-01 06:50:08,897 com.linecorp.armeria.common.Flags 1464 [main] INFO  [] - com.linecorp.armeria.verboseSocketExceptions: false (default)
2022-09-01 06:50:08,897 com.linecorp.armeria.common.Flags 1464 [main] INFO  [] - com.linecorp.armeria.verboseResponses: false (default)
2022-09-01 06:50:08,897 com.linecorp.armeria.common.Flags 1464 [main] INFO  [] - com.linecorp.armeria.warnNettyVersions: true (default)
2022-09-01 06:50:08,937 com.linecorp.armeria.common.Flags 1464 [main] INFO  [] - com.linecorp.armeria.useEpoll: true (default)
2022-09-01 06:50:08,938 com.linecorp.armeria.common.Flags 1464 [main] INFO  [] - com.linecorp.armeria.transportType: epoll (default)
2022-09-01 06:50:08,948 com.linecorp.armeria.common.Flags 1464 [main] INFO  [] - com.linecorp.armeria.maxNumConnections: 2147483647 (default)
2022-09-01 06:50:08,948 com.linecorp.armeria.common.Flags 1464 [main] INFO  [] - com.linecorp.armeria.numCommonWorkers: 2 (default)
2022-09-01 06:50:08,949 com.linecorp.armeria.common.Flags 1464 [main] INFO  [] - com.linecorp.armeria.numCommonBlockingTaskThreads: 200 (default)
2022-09-01 06:50:08,950 com.linecorp.armeria.common.Flags 1464 [main] INFO  [] - com.linecorp.armeria.defaultMaxRequestLength: 10485760 (default)
2022-09-01 06:50:08,950 com.linecorp.armeria.common.Flags 1464 [main] INFO  [] - com.linecorp.armeria.defaultMaxResponseLength: 10485760 (default)
2022-09-01 06:50:08,950 com.linecorp.armeria.common.Flags 1464 [main] INFO  [] - com.linecorp.armeria.defaultRequestTimeoutMillis: 10000 (default)
2022-09-01 06:50:08,951 com.linecorp.armeria.common.Flags 1464 [main] INFO  [] - com.linecorp.armeria.defaultResponseTimeoutMillis: 15000 (default)
2022-09-01 06:50:08,951 com.linecorp.armeria.common.Flags 1464 [main] INFO  [] - com.linecorp.armeria.defaultConnectTimeoutMillis: 3200 (default)
2022-09-01 06:50:08,951 com.linecorp.armeria.common.Flags 1464 [main] INFO  [] - com.linecorp.armeria.defaultWriteTimeoutMillis: 1000 (default)
2022-09-01 06:50:08,951 com.linecorp.armeria.common.Flags 1464 [main] INFO  [] - com.linecorp.armeria.defaultServerIdleTimeoutMillis: 15000 (default)
2022-09-01 06:50:08,952 com.linecorp.armeria.common.Flags 1464 [main] INFO  [] - com.linecorp.armeria.defaultClientIdleTimeoutMillis: 10000 (default)
2022-09-01 06:50:08,952 com.linecorp.armeria.common.Flags 1464 [main] INFO  [] - com.linecorp.armeria.defaultPingIntervalMillis: 0 (default)
2022-09-01 06:50:08,952 com.linecorp.armeria.common.Flags 1464 [main] INFO  [] - com.linecorp.armeria.defaultMaxServerNumRequestsPerConnection: 0 (default)
2022-09-01 06:50:08,953 com.linecorp.armeria.common.Flags 1464 [main] INFO  [] - com.linecorp.armeria.defaultMaxClientNumRequestsPerConnection: 0 (default)
2022-09-01 06:50:08,953 com.linecorp.armeria.common.Flags 1464 [main] INFO  [] - com.linecorp.armeria.defaultMaxServerConnectionAgeMillis: 0 (default)
2022-09-01 06:50:08,953 com.linecorp.armeria.common.Flags 1464 [main] INFO  [] - com.linecorp.armeria.defaultMaxClientConnectionAgeMillis: 0 (default)
2022-09-01 06:50:08,954 com.linecorp.armeria.common.Flags 1464 [main] INFO  [] - com.linecorp.armeria.defaultServerConnectionDrainDurationMicros: 1000000 (default)
2022-09-01 06:50:08,954 com.linecorp.armeria.common.Flags 1464 [main] INFO  [] - com.linecorp.armeria.defaultHttp2InitialConnectionWindowSize: 1048576 (default)
2022-09-01 06:50:08,954 com.linecorp.armeria.common.Flags 1464 [main] INFO  [] - com.linecorp.armeria.defaultHttp2InitialStreamWindowSize: 1048576 (default)
2022-09-01 06:50:08,955 com.linecorp.armeria.common.Flags 1464 [main] INFO  [] - com.linecorp.armeria.defaultHttp2MaxFrameSize: 16384 (default)
2022-09-01 06:50:08,955 com.linecorp.armeria.common.Flags 1464 [main] INFO  [] - com.linecorp.armeria.defaultHttp2MaxStreamsPerConnection: 2147483647 (default)
2022-09-01 06:50:08,955 com.linecorp.armeria.common.Flags 1464 [main] INFO  [] - com.linecorp.armeria.defaultHttp2MaxHeaderListSize: 8192 (default)
2022-09-01 06:50:08,956 com.linecorp.armeria.common.Flags 1464 [main] INFO  [] - com.linecorp.armeria.defaultHttp1MaxInitialLineLength: 4096 (default)
2022-09-01 06:50:08,956 com.linecorp.armeria.common.Flags 1464 [main] INFO  [] - com.linecorp.armeria.defaultHttp1MaxHeaderSize: 8192 (default)
2022-09-01 06:50:08,956 com.linecorp.armeria.common.Flags 1464 [main] INFO  [] - com.linecorp.armeria.defaultHttp1MaxChunkSize: 8192 (default)
2022-09-01 06:50:08,956 com.linecorp.armeria.common.Flags 1464 [main] INFO  [] - com.linecorp.armeria.defaultUseHttp2Preface: true (default)
2022-09-01 06:50:08,957 com.linecorp.armeria.common.Flags 1464 [main] INFO  [] - com.linecorp.armeria.defaultUseHttp1Pipelining: false (default)
2022-09-01 06:50:08,957 com.linecorp.armeria.common.Flags 1464 [main] INFO  [] - com.linecorp.armeria.defaultBackoffSpec: exponential=200:10000,jitter=0.2 (default)
2022-09-01 06:50:08,957 com.linecorp.armeria.common.Flags 1464 [main] INFO  [] - com.linecorp.armeria.defaultMaxTotalAttempts: 10 (default)
2022-09-01 06:50:08,958 com.linecorp.armeria.common.Flags 1447 [main] INFO  [] - com.linecorp.armeria.routeCache: maximumSize=4096 (default)
2022-09-01 06:50:08,958 com.linecorp.armeria.common.Flags 1447 [main] INFO  [] - com.linecorp.armeria.routeDecoratorCache: maximumSize=4096 (default)
2022-09-01 06:50:08,958 com.linecorp.armeria.common.Flags 1447 [main] INFO  [] - com.linecorp.armeria.parsedPathCache: maximumSize=4096 (default)
2022-09-01 06:50:08,958 com.linecorp.armeria.common.Flags 1447 [main] INFO  [] - com.linecorp.armeria.headerValueCache: maximumSize=4096 (default)
2022-09-01 06:50:08,959 com.linecorp.armeria.common.Flags 1464 [main] INFO  [] - com.linecorp.armeria.cachedHeaders: :authority,:scheme,:method,accept-encoding,content-type (default)
2022-09-01 06:50:08,959 com.linecorp.armeria.common.Flags 1447 [main] INFO  [] - com.linecorp.armeria.fileServiceCache: maximumSize=1024 (default)
2022-09-01 06:50:08,959 com.linecorp.armeria.common.Flags 1447 [main] INFO  [] - com.linecorp.armeria.dnsCacheSpec: maximumSize=4096 (default)
2022-09-01 06:50:08,960 com.linecorp.armeria.common.Flags 1464 [main] INFO  [] - com.linecorp.armeria.annotatedServiceExceptionVerbosity: unhandled (default)
2022-09-01 06:50:08,960 com.linecorp.armeria.common.Flags 1464 [main] INFO  [] - com.linecorp.armeria.useJdkDnsResolver: false (default)
2022-09-01 06:50:08,960 com.linecorp.armeria.common.Flags 1464 [main] INFO  [] - com.linecorp.armeria.reportBlockedEventLoop: true (default)
2022-09-01 06:50:08,960 com.linecorp.armeria.common.Flags 1464 [main] INFO  [] - com.linecorp.armeria.validateHeaders: true (default)
2022-09-01 06:50:08,960 com.linecorp.armeria.common.Flags 1464 [main] INFO  [] - com.linecorp.armeria.tlsAllowUnsafeCiphers: false (default)
2022-09-01 06:50:08,961 com.linecorp.armeria.common.Flags 1464 [main] INFO  [] - com.linecorp.armeria.transientServiceOptions:  (default)
2022-09-01 06:50:08,964 com.linecorp.armeria.common.Flags 1464 [main] INFO  [] - com.linecorp.armeria.useLegacyRouteDecoratorOrdering: false (default)
2022-09-01 06:50:08,964 com.linecorp.armeria.common.Flags 1464 [main] INFO  [] - com.linecorp.armeria.useDefaultSocketOptions: true (default)
2022-09-01 06:50:08,964 com.linecorp.armeria.common.Flags 1464 [main] INFO  [] - com.linecorp.armeria.allowDoubleDotsInQueryString: false (default)
2022-09-01 06:50:08,965 com.linecorp.armeria.common.Flags 469 [main] INFO  [] - Using /dev/epoll
2022-09-01 06:50:09,730 org.apache.skywalking.oap.server.library.server.http.HTTPServer 74 [main] INFO  [] - Server root context path: 
2022-09-01 06:50:09,770 org.apache.skywalking.oap.server.library.module.ModuleDefine 89 [main] INFO  [] - Prepare the graphql provider in query module.
2022-09-01 06:50:09,792 org.apache.skywalking.oap.server.library.module.ModuleDefine 89 [main] INFO  [] - Prepare the default provider in alarm module.
2022-09-01 06:50:09,816 org.apache.skywalking.oap.server.core.alarm.provider.AlarmRulesWatcher 102 [main] INFO  [] - Update alarm rules to Rules(rules=[AlarmRule(alarmRuleName=service_resp_time_rule, metricsName=service_resp_time, includeNames=[], includeNamesRegex=, excludeNames=[], excludeNamesRegex=, includeLabels=[], includeLabelsRegex=, excludeLabels=[], excludeLabelsRegex=, threshold=1000, op=>, period=10, count=3, silencePeriod=5, message=Response time of service {name} is more than 1000ms in 3 minutes of last 10 minutes., onlyAsCondition=false, tags={}), AlarmRule(alarmRuleName=service_sla_rule, metricsName=service_sla, includeNames=[], includeNamesRegex=, excludeNames=[], excludeNamesRegex=, includeLabels=[], includeLabelsRegex=, excludeLabels=[], excludeLabelsRegex=, threshold=8000, op=<, period=10, count=2, silencePeriod=3, message=Successful rate of service {name} is lower than 80% in 2 minutes of last 10 minutes, onlyAsCondition=false, tags={}), AlarmRule(alarmRuleName=service_resp_time_percentile_rule, metricsName=service_percentile, includeNames=[], includeNamesRegex=, excludeNames=[], excludeNamesRegex=, includeLabels=[], includeLabelsRegex=, excludeLabels=[], excludeLabelsRegex=, threshold=1000,1000,1000,1000,1000, op=>, period=10, count=3, silencePeriod=5, message=Percentile response time of service {name} alarm in 3 minutes of last 10 minutes, due to more than one condition of p50 > 1000, p75 > 1000, p90 > 1000, p95 > 1000, p99 > 1000, onlyAsCondition=false, tags={}), AlarmRule(alarmRuleName=service_instance_resp_time_rule, metricsName=service_instance_resp_time, includeNames=[], includeNamesRegex=, excludeNames=[], excludeNamesRegex=, includeLabels=[], includeLabelsRegex=, excludeLabels=[], excludeLabelsRegex=, threshold=1000, op=>, period=10, count=2, silencePeriod=5, message=Response time of service instance {name} is more than 1000ms in 2 minutes of last 10 minutes, onlyAsCondition=false, tags={}), AlarmRule(alarmRuleName=database_access_resp_time_rule, metricsName=database_access_resp_time
, includeNames=[], includeNamesRegex=, excludeNames=[], excludeNamesRegex=, includeLabels=[], includeLabelsRegex=, excludeLabels=[], excludeLabelsRegex=, threshold=1000, op=>, period=10, count=2, silencePeriod=10, message=Response time of database access {name} is more than 1000ms in 2 minutes of last 10 minutes, onlyAsCondition=false, tags={}), AlarmRule(alarmRuleName=endpoint_relation_resp_time_rule, metricsName=endpoint_relation_resp_time, includeNames=[], includeNamesRegex=, excludeNames=[], excludeNamesRegex=, includeLabels=[], includeLabelsRegex=, excludeLabels=[], excludeLabelsRegex=, threshold=1000, op=>, period=10, count=2, silencePeriod=10, message=Response time of endpoint relation {name} is more than 1000ms in 2 minutes of last 10 minutes, onlyAsCondition=false, tags={})], webhooks=[], grpchookSetting=null, slacks=null, wecchats=null, compositeRules=[], dingtalks=null, feishus=null, welinks=null)
2022-09-01 06:50:09,864 org.apache.skywalking.oap.server.library.module.ModuleDefine 89 [main] INFO  [] - Prepare the default provider in receiver-otel module.
2022-09-01 06:50:09,865 org.apache.skywalking.oap.server.library.module.ModuleDefine 89 [main] INFO  [] - Prepare the default provider in log-analyzer module.
2022-09-01 06:50:09,866 org.apache.skywalking.oap.server.library.module.ModuleDefine 89 [main] INFO  [] - Prepare the default provider in event-analyzer module.
2022-09-01 06:50:09,866 org.apache.skywalking.oap.server.library.module.ModuleDefine 89 [main] INFO  [] - Prepare the default provider in envoy-metric module.
2022-09-01 06:50:09,872 org.apache.skywalking.oap.server.library.module.ModuleDefine 89 [main] INFO  [] - Prepare the default provider in configuration-discovery module.
2022-09-01 06:50:09,877 org.apache.skywalking.oap.server.library.module.ModuleDefine 89 [main] INFO  [] - Prepare the none provider in configuration module.
2022-09-01 06:50:09,878 org.apache.skywalking.oap.server.library.module.ModuleDefine 89 [main] INFO  [] - Prepare the default provider in agent-analyzer module.
2022-09-01 06:50:09,881 org.apache.skywalking.oap.server.analyzer.provider.trace.UninstrumentedGatewaysConfig 56 [main] INFO  [] - Default configured gateways: null
2022-09-01 06:50:09,881 org.apache.skywalking.oap.server.analyzer.provider.trace.UninstrumentedGatewaysConfig 83 [main] INFO  [] - Updating uninstrumented gateways with: null
2022-09-01 06:50:09,883 org.apache.skywalking.oap.server.analyzer.provider.trace.TraceSamplingPolicyWatcher 133 [main] INFO  [] - [trace-sampling-policy] use trace-sample-policy in static file : SamplingPolicySettings(defaultPolicy=SamplingPolicy(rate=10000, duration=-1), services={})
2022-09-01 06:50:09,910 org.apache.skywalking.oap.server.library.module.BootstrapFlow 43 [main] INFO  [] - start the provider none in configuration module.
2022-09-01 06:50:09,911 org.apache.skywalking.oap.server.library.module.BootstrapFlow 43 [main] INFO  [] - start the provider graphql in query module.
2022-09-01 06:50:10,359 graphql.kickstart.tools.SchemaClassScanner 355 [main] WARN  [] - Cannot find definition for field 'scope: Scope' on input type 'Entity' -> org.apache.skywalking.oap.server.core.query.input.Entity. Try adding it manually to the dictionary
2022-09-01 06:50:11,010 org.apache.skywalking.oap.server.library.server.http.HTTPServer 83 [main] INFO  [] - Bind handler GraphQLQueryHandler into http server 0.0.0.0:12800
2022-09-01 06:50:11,011 org.apache.skywalking.oap.server.library.module.BootstrapFlow 43 [main] INFO  [] - start the provider none in telemetry module.
2022-09-01 06:50:11,011 org.apache.skywalking.oap.server.library.module.BootstrapFlow 43 [main] INFO  [] - start the provider default in core module.
2022-09-01 06:50:11,013 org.apache.skywalking.oap.server.library.server.grpc.GRPCServer 131 [main] INFO  [] - Bind handler RemoteServiceHandler into gRPC server 0.0.0.0:11800
2022-09-01 06:50:11,039 org.apache.skywalking.oap.server.library.server.grpc.GRPCServer 131 [main] INFO  [] - Bind handler HealthCheckServiceHandler into gRPC server 0.0.0.0:11800
2022-09-01 06:50:11,291 org.apache.skywalking.oap.server.core.analysis.DispatcherManager 117 [main] INFO  [] - Dispatcher org.apache.skywalking.oap.server.core.analysis.manual.database.DatabaseStatementDispatcher is added into DefaultScopeDefine 18.
2022-09-01 06:50:11,291 org.apache.skywalking.oap.server.core.analysis.DispatcherManager 117 [main] INFO  [] - Dispatcher org.apache.skywalking.oap.server.core.analysis.manual.endpoint.EndpointMetaDispatcher is added into DefaultScopeDefine 42.
2022-09-01 06:50:11,292 org.apache.skywalking.oap.server.core.analysis.DispatcherManager 117 [main] INFO  [] - Dispatcher org.apache.skywalking.oap.server.core.analysis.manual.endpoint.EndpointTrafficDispatcher is added into DefaultScopeDefine 3.
2022-09-01 06:50:11,292 org.apache.skywalking.oap.server.core.analysis.DispatcherManager 117 [main] INFO  [] - Dispatcher org.apache.skywalking.oap.server.core.analysis.manual.instance.InstanceTrafficDispatcher is added into DefaultScopeDefine 2.
2022-09-01 06:50:11,292 org.apache.skywalking.oap.server.core.analysis.DispatcherManager 117 [main] INFO  [] - Dispatcher org.apache.skywalking.oap.server.core.analysis.manual.instance.InstanceUpdateDispatcher is added into DefaultScopeDefine 30.
2022-09-01 06:50:11,292 org.apache.skywalking.oap.server.core.analysis.DispatcherManager 117 [main] INFO  [] - Dispatcher org.apache.skywalking.oap.server.core.analysis.manual.log.LogRecordDispatcher is added into DefaultScopeDefine 41.
2022-09-01 06:50:11,293 org.apache.skywalking.oap.server.core.analysis.DispatcherManager 117 [main] INFO  [] - Dispatcher org.apache.skywalking.oap.server.core.analysis.manual.networkalias.NetworkAddressAliasSetupDispatcher is added into DefaultScopeDefine 31.
2022-09-01 06:50:11,293 org.apache.skywalking.oap.server.core.analysis.DispatcherManager 117 [main] INFO  [] - Dispatcher org.apache.skywalking.oap.server.core.analysis.manual.process.ProcessDispatcher is added into DefaultScopeDefine 45.
2022-09-01 06:50:11,293 org.apache.skywalking.oap.server.core.analysis.DispatcherManager 117 [main] INFO  [] - Dispatcher org.apache.skywalking.oap.server.core.analysis.manual.process.ProcessLabelDispatcher is added into DefaultScopeDefine 49.
2022-09-01 06:50:11,293 org.apache.skywalking.oap.server.core.analysis.DispatcherManager 117 [main] INFO  [] - Dispatcher org.apache.skywalking.oap.server.core.analysis.manual.relation.endpoint.EndpointCallRelationDispatcher is added into DefaultScopeDefine 6.
2022-09-01 06:50:11,293 org.apache.skywalking.oap.server.core.analysis.DispatcherManager 117 [main] INFO  [] - Dispatcher org.apache.skywalking.oap.server.core.analysis.manual.relation.instance.ServiceInstanceCallRelationDispatcher is added into DefaultScopeDefine 5.
2022-09-01 06:50:11,294 org.apache.skywalking.oap.server.core.analysis.DispatcherManager 117 [main] INFO  [] - Dispatcher org.apache.skywalking.oap.server.core.analysis.manual.relation.service.ServiceCallRelationDispatcher is added into DefaultScopeDefine 4.
2022-09-01 06:50:11,294 org.apache.skywalking.oap.server.core.analysis.DispatcherManager 117 [main] INFO  [] - Dispatcher org.apache.skywalking.oap.server.core.analysis.manual.searchtag.TagAutocompleteDispatcher is added into DefaultScopeDefine 50.
2022-09-01 06:50:11,294 org.apache.skywalking.oap.server.core.analysis.DispatcherManager 117 [main] INFO  [] - Dispatcher org.apache.skywalking.oap.server.core.analysis.manual.segment.SegmentDispatcher is added into DefaultScopeDefine 12.
2022-09-01 06:50:11,294 org.apache.skywalking.oap.server.core.analysis.DispatcherManager 117 [main] INFO  [] - Dispatcher org.apache.skywalking.oap.server.core.analysis.manual.service.ServiceMetaDispatcher is added into DefaultScopeDefine 29.
2022-09-01 06:50:11,294 org.apache.skywalking.oap.server.core.analysis.DispatcherManager 117 [main] INFO  [] - Dispatcher org.apache.skywalking.oap.server.core.analysis.manual.service.ServiceTrafficDispatcher is added into DefaultScopeDefine 1.
2022-09-01 06:50:11,296 org.apache.skywalking.oap.server.core.analysis.DispatcherManager 117 [main] INFO  [] - Dispatcher org.apache.skywalking.oap.server.core.browser.manual.endpoint.BrowserAppPageTrafficDispatcher is added into DefaultScopeDefine 40.
2022-09-01 06:50:11,296 org.apache.skywalking.oap.server.core.analysis.DispatcherManager 117 [main] INFO  [] - Dispatcher org.apache.skywalking.oap.server.core.browser.manual.errorlog.BrowserErrorLogRecordDispatcher is added into DefaultScopeDefine 34.
2022-09-01 06:50:11,296 org.apache.skywalking.oap.server.core.analysis.DispatcherManager 117 [main] INFO  [] - Dispatcher org.apache.skywalking.oap.server.core.browser.manual.instance.BrowserAppSingleVersionTrafficDispatcher is added into DefaultScopeDefine 39.
2022-09-01 06:50:11,296 org.apache.skywalking.oap.server.core.analysis.DispatcherManager 117 [main] INFO  [] - Dispatcher org.apache.skywalking.oap.server.core.browser.manual.service.BrowserAppTrafficDispatcher is added into DefaultScopeDefine 38.
2022-09-01 06:50:11,297 org.apache.skywalking.oap.server.core.analysis.DispatcherManager 117 [main] INFO  [] - Dispatcher org.apache.skywalking.oap.server.core.profiling.ebpf.storage.EBPFProcessProfilingDataDispatcher is added into DefaultScopeDefine 48.
2022-09-01 06:50:11,297 org.apache.skywalking.oap.server.core.analysis.DispatcherManager 117 [main] INFO  [] - Dispatcher org.apache.skywalking.oap.server.core.profiling.ebpf.storage.EBPFProcessProfilingScheduleDispatcher is added into DefaultScopeDefine 47.
2022-09-01 06:50:11,298 org.apache.skywalking.oap.server.core.analysis.DispatcherManager 117 [main] INFO  [] - Dispatcher org.apache.skywalking.oap.server.core.zipkin.ZipkinSpanRecordDispatcher is added into DefaultScopeDefine 23.
2022-09-01 06:50:11,445 org.apache.skywalking.oap.server.library.module.BootstrapFlow 43 [main] INFO  [] - start the provider default in agent-analyzer module.
2022-09-01 06:50:12,439 org.apache.skywalking.oap.server.core.analysis.DispatcherManager 117 [main] INFO  [] - Dispatcher org.apache.skywalking.oap.server.core.source.oal.rt.dispatcher.EndpointRelationDispatcher is added into DefaultScopeDefine 6.
2022-09-01 06:50:12,439 org.apache.skywalking.oap.server.core.analysis.DispatcherManager 117 [main] INFO  [] - Dispatcher org.apache.skywalking.oap.server.core.source.oal.rt.dispatcher.ServiceRelationDispatcher is added into DefaultScopeDefine 4.
2022-09-01 06:50:12,439 org.apache.skywalking.oap.server.core.analysis.DispatcherManager 117 [main] INFO  [] - Dispatcher org.apache.skywalking.oap.server.core.source.oal.rt.dispatcher.EndpointDispatcher is added into DefaultScopeDefine 3.
2022-09-01 06:50:12,439 org.apache.skywalking.oap.server.core.analysis.DispatcherManager 117 [main] INFO  [] - Dispatcher org.apache.skywalking.oap.server.core.source.oal.rt.dispatcher.DatabaseAccessDispatcher is added into DefaultScopeDefine 17.
2022-09-01 06:50:12,440 org.apache.skywalking.oap.server.core.analysis.DispatcherManager 117 [main] INFO  [] - Dispatcher org.apache.skywalking.oap.server.core.source.oal.rt.dispatcher.ServiceInstanceDispatcher is added into DefaultScopeDefine 2.
2022-09-01 06:50:12,440 org.apache.skywalking.oap.server.core.analysis.DispatcherManager 117 [main] INFO  [] - Dispatcher org.apache.skywalking.oap.server.core.source.oal.rt.dispatcher.ServiceDispatcher is added into DefaultScopeDefine 1.
2022-09-01 06:50:12,440 org.apache.skywalking.oap.server.core.analysis.DispatcherManager 117 [main] INFO  [] - Dispatcher org.apache.skywalking.oap.server.core.source.oal.rt.dispatcher.ServiceInstanceRelationDispatcher is added into DefaultScopeDefine 5.
2022-09-01 06:50:13,452 org.apache.skywalking.oap.server.library.module.BootstrapFlow 43 [main] INFO  [] - start the provider kubernetes in cluster module.
2022-09-01 06:50:13,694 org.apache.skywalking.oap.server.library.module.BootstrapFlow 43 [main] INFO  [] - start the provider default in event-analyzer module.
2022-09-01 06:50:13,695 org.apache.skywalking.oap.server.library.module.BootstrapFlow 43 [main] INFO  [] - start the provider elasticsearch in storage module.
2022-09-01 06:50:13,700 io.kubernetes.client.informer.cache.Controller 102 [informer-controller-V1Pod] INFO  [] - informer#Controller: ready to run resync & reflector runnable
2022-09-01 06:50:13,700 io.kubernetes.client.informer.cache.Controller 111 [informer-controller-V1Pod] INFO  [] - informer#Controller: resync skipped due to 0 full resync period
2022-09-01 06:50:13,703 io.kubernetes.client.informer.cache.ReflectorRunnable 84 [controller-reflector-io.kubernetes.client.openapi.models.V1Pod-1] INFO  [] - class io.kubernetes.client.openapi.models.V1Pod#Start listing and watching...
2022-09-01 06:50:13,802 com.linecorp.armeria.common.util.SystemInfo 519 [main] INFO  [] - IPv6: disabled (from /proc/sys/net/ipv6/conf/all/disable_ipv6)
2022-09-01 06:50:13,829 com.linecorp.armeria.common.Flags 1464 [main] INFO  [] - com.linecorp.armeria.useOpenSsl: true (default)
2022-09-01 06:50:13,941 com.linecorp.armeria.common.Flags 637 [main] INFO  [] - Using OpenSSL: BoringSSL, 0x1010107f
2022-09-01 06:50:13,941 com.linecorp.armeria.common.Flags 1464 [main] INFO  [] - com.linecorp.armeria.dumpOpenSslInfo: false (default)
2022-09-01 06:50:14,081 com.linecorp.armeria.internal.common.JavaVersionSpecific 45 [main] INFO  [] - Using the APIs optimized for: Java 9+
2022-09-01 06:50:14,475 org.apache.skywalking.library.elasticsearch.ElasticSearch 150 [armeria-common-worker-epoll-2-1] INFO  [] - ElasticSearch version is: ElasticSearch 6.8
2022-09-01 06:50:16,754 org.apache.skywalking.oap.server.library.module.BootstrapFlow 43 [main] INFO  [] - start the provider default in log-analyzer module.
2022-09-01 06:50:17,100 org.apache.skywalking.oap.server.library.module.BootstrapFlow 43 [main] INFO  [] - start the provider default in receiver-sharing-server module.
2022-09-01 06:50:17,100 org.apache.skywalking.oap.server.library.module.BootstrapFlow 43 [main] INFO  [] - start the provider default in receiver-profile module.
2022-09-01 06:50:17,101 org.apache.skywalking.oap.server.library.server.grpc.GRPCServer 131 [main] INFO  [] - Bind handler ProfileTaskServiceHandler into gRPC server 0.0.0.0:11800
2022-09-01 06:50:17,105 org.apache.skywalking.oap.server.library.server.grpc.GRPCServer 131 [main] INFO  [] - Bind handler ProfileTaskServiceHandlerCompat into gRPC server 0.0.0.0:11800
2022-09-01 06:50:17,106 org.apache.skywalking.oap.server.library.module.BootstrapFlow 43 [main] INFO  [] - start the provider default in alarm module.
2022-09-01 06:50:17,107 org.apache.skywalking.oap.server.library.module.BootstrapFlow 43 [main] INFO  [] - start the provider default in receiver-clr module.
2022-09-01 06:50:17,456 org.apache.skywalking.oap.server.core.analysis.DispatcherManager 117 [main] INFO  [] - Dispatcher org.apache.skywalking.oap.server.core.source.oal.rt.dispatcher.ServiceInstanceCLRCPUDispatcher is added into DefaultScopeDefine 19.
2022-09-01 06:50:17,456 org.apache.skywalking.oap.server.core.analysis.DispatcherManager 117 [main] INFO  [] - Dispatcher org.apache.skywalking.oap.server.core.source.oal.rt.dispatcher.ServiceInstanceCLRGCDispatcher is added into DefaultScopeDefine 20.
2022-09-01 06:50:17,456 org.apache.skywalking.oap.server.core.analysis.DispatcherManager 117 [main] INFO  [] - Dispatcher org.apache.skywalking.oap.server.core.source.oal.rt.dispatcher.ServiceInstanceCLRThreadDispatcher is added into DefaultScopeDefine 21.
2022-09-01 06:50:17,457 org.apache.skywalking.oap.server.library.server.grpc.GRPCServer 131 [main] INFO  [] - Bind handler CLRMetricReportServiceHandler into gRPC server 0.0.0.0:11800
2022-09-01 06:50:17,459 org.apache.skywalking.oap.server.library.server.grpc.GRPCServer 131 [main] INFO  [] - Bind handler CLRMetricReportServiceHandlerCompat into gRPC server 0.0.0.0:11800
2022-09-01 06:50:17,461 org.apache.skywalking.oap.server.library.module.BootstrapFlow 43 [main] INFO  [] - start the provider default in receiver-otel module.
2022-09-01 06:50:17,796 io.kubernetes.client.informer.cache.Controller 102 [informer-controller-V1Service] INFO  [] - informer#Controller: ready to run resync & reflector runnable
2022-09-01 06:50:17,796 io.kubernetes.client.informer.cache.Controller 111 [informer-controller-V1Service] INFO  [] - informer#Controller: resync skipped due to 0 full resync period
2022-09-01 06:50:17,796 io.kubernetes.client.informer.cache.Controller 102 [informer-controller-V1Pod] INFO  [] - informer#Controller: ready to run resync & reflector runnable
2022-09-01 06:50:17,797 io.kubernetes.client.informer.cache.Controller 111 [informer-controller-V1Pod] INFO  [] - informer#Controller: resync skipped due to 0 full resync period
2022-09-01 06:50:17,797 io.kubernetes.client.informer.cache.ReflectorRunnable 84 [controller-reflector-io.kubernetes.client.openapi.models.V1Service-1] INFO  [] - class io.kubernetes.client.openapi.models.V1Service#Start listing and watching...
2022-09-01 06:50:17,797 io.kubernetes.client.informer.cache.ReflectorRunnable 84 [controller-reflector-io.kubernetes.client.openapi.models.V1Pod-1] INFO  [] - class io.kubernetes.client.openapi.models.V1Pod#Start listing and watching...
2022-09-01 06:50:20,987 org.apache.skywalking.oap.server.library.server.grpc.GRPCServer 131 [main] INFO  [] - Bind handler OCMetricHandler into gRPC server 0.0.0.0:11800
2022-09-01 06:50:20,993 org.apache.skywalking.oap.server.library.module.BootstrapFlow 43 [main] INFO  [] - start the provider default in receiver-trace module.
2022-09-01 06:50:20,994 org.apache.skywalking.oap.server.library.server.grpc.GRPCServer 131 [main] INFO  [] - Bind handler TraceSegmentReportServiceHandler into gRPC server 0.0.0.0:11800
2022-09-01 06:50:20,997 org.apache.skywalking.oap.server.library.server.grpc.GRPCServer 131 [main] INFO  [] - Bind handler TraceSegmentReportServiceHandlerCompat into gRPC server 0.0.0.0:11800
2022-09-01 06:50:20,998 org.apache.skywalking.oap.server.library.server.http.HTTPServer 83 [main] INFO  [] - Bind handler TraceSegmentReportHandler into http server 0.0.0.0:12800
2022-09-01 06:50:20,998 org.apache.skywalking.oap.server.library.module.BootstrapFlow 43 [main] INFO  [] - start the provider default in receiver-jvm module.
2022-09-01 06:50:21,675 org.apache.skywalking.oap.server.core.analysis.DispatcherManager 117 [main] INFO  [] - Dispatcher org.apache.skywalking.oap.server.core.source.oal.rt.dispatcher.ServiceInstanceJVMClassDispatcher is added into DefaultScopeDefine 44.
2022-09-01 06:50:21,675 org.apache.skywalking.oap.server.core.analysis.DispatcherManager 117 [main] INFO  [] - Dispatcher org.apache.skywalking.oap.server.core.source.oal.rt.dispatcher.ServiceInstanceJVMMemoryDispatcher is added into DefaultScopeDefine 9.
2022-09-01 06:50:21,675 org.apache.skywalking.oap.server.core.analysis.DispatcherManager 117 [main] INFO  [] - Dispatcher org.apache.skywalking.oap.server.core.source.oal.rt.dispatcher.ServiceInstanceJVMGCDispatcher is added into DefaultScopeDefine 11.
2022-09-01 06:50:21,675 org.apache.skywalking.oap.server.core.analysis.DispatcherManager 117 [main] INFO  [] - Dispatcher org.apache.skywalking.oap.server.core.source.oal.rt.dispatcher.ServiceInstanceJVMThreadDispatcher is added into DefaultScopeDefine 33.
2022-09-01 06:50:21,676 org.apache.skywalking.oap.server.core.analysis.DispatcherManager 117 [main] INFO  [] - Dispatcher org.apache.skywalking.oap.server.core.source.oal.rt.dispatcher.ServiceInstanceJVMCPUDispatcher is added into DefaultScopeDefine 8.
2022-09-01 06:50:21,676 org.apache.skywalking.oap.server.library.server.grpc.GRPCServer 131 [main] INFO  [] - Bind handler JVMMetricReportServiceHandler into gRPC server 0.0.0.0:11800
2022-09-01 06:50:21,679 org.apache.skywalking.oap.server.library.server.grpc.GRPCServer 131 [main] INFO  [] - Bind handler JVMMetricReportServiceHandlerCompat into gRPC server 0.0.0.0:11800
2022-09-01 06:50:21,680 org.apache.skywalking.oap.server.library.module.BootstrapFlow 43 [main] INFO  [] - start the provider default in service-mesh module.
2022-09-01 06:50:22,164 org.apache.skywalking.oap.server.core.analysis.DispatcherManager 117 [main] INFO  [] - Dispatcher org.apache.skywalking.oap.server.core.source.oal.rt.dispatcher.ServiceMeshServiceRelationDispatcher is added into DefaultScopeDefine 4.
2022-09-01 06:50:22,165 org.apache.skywalking.oap.server.core.analysis.DispatcherManager 117 [main] INFO  [] - Dispatcher org.apache.skywalking.oap.server.core.source.oal.rt.dispatcher.ServiceMeshEndpointDispatcher is added into DefaultScopeDefine 3.
2022-09-01 06:50:22,165 org.apache.skywalking.oap.server.core.analysis.DispatcherManager 117 [main] INFO  [] - Dispatcher org.apache.skywalking.oap.server.core.source.oal.rt.dispatcher.ServiceMeshServiceInstanceDispatcher is added into DefaultScopeDefine 2.
2022-09-01 06:50:22,165 org.apache.skywalking.oap.server.core.analysis.DispatcherManager 117 [main] INFO  [] - Dispatcher org.apache.skywalking.oap.server.core.source.oal.rt.dispatcher.ServiceMeshServiceDispatcher is added into DefaultScopeDefine 1.
2022-09-01 06:50:22,165 org.apache.skywalking.oap.server.core.analysis.DispatcherManager 117 [main] INFO  [] - Dispatcher org.apache.skywalking.oap.server.core.source.oal.rt.dispatcher.ServiceMeshServiceInstanceRelationDispatcher is added into DefaultScopeDefine 5.
2022-09-01 06:50:22,166 org.apache.skywalking.oap.server.library.server.grpc.GRPCServer 131 [main] INFO  [] - Bind handler MeshGRPCHandler into gRPC server 0.0.0.0:11800
2022-09-01 06:50:22,170 org.apache.skywalking.oap.server.library.server.grpc.GRPCServer 131 [main] INFO  [] - Bind handler MeshGRPCHandlerCompat into gRPC server 0.0.0.0:11800
2022-09-01 06:50:22,171 org.apache.skywalking.oap.server.library.module.BootstrapFlow 43 [main] INFO  [] - start the provider default in configuration-discovery module.
2022-09-01 06:50:22,171 org.apache.skywalking.oap.server.library.server.grpc.GRPCServer 131 [main] INFO  [] - Bind handler ConfigurationDiscoveryServiceHandler into gRPC server 0.0.0.0:11800
2022-09-01 06:50:22,173 org.apache.skywalking.oap.server.library.module.BootstrapFlow 43 [main] INFO  [] - start the provider default in receiver-register module.
2022-09-01 06:50:22,174 org.apache.skywalking.oap.server.library.server.grpc.GRPCServer 131 [main] INFO  [] - Bind handler ManagementServiceGRPCHandler into gRPC server 0.0.0.0:11800
2022-09-01 06:50:22,176 org.apache.skywalking.oap.server.library.server.grpc.GRPCServer 131 [main] INFO  [] - Bind handler ManagementServiceGrpcHandlerCompat into gRPC server 0.0.0.0:11800
2022-09-01 06:50:22,178 org.apache.skywalking.oap.server.library.server.http.HTTPServer 83 [main] INFO  [] - Bind handler ManagementServiceHTTPHandler into http server 0.0.0.0:12800
2022-09-01 06:50:22,178 org.apache.skywalking.oap.server.library.module.BootstrapFlow 43 [main] INFO  [] - start the provider default in receiver-browser module.
2022-09-01 06:50:23,168 org.apache.skywalking.oap.server.core.analysis.DispatcherManager 117 [main] INFO  [] - Dispatcher org.apache.skywalking.oap.server.core.source.oal.rt.dispatcher.BrowserAppPagePerfDispatcher is added into DefaultScopeDefine 36.
2022-09-01 06:50:23,168 org.apache.skywalking.oap.server.core.analysis.DispatcherManager 117 [main] INFO  [] - Dispatcher org.apache.skywalking.oap.server.core.source.oal.rt.dispatcher.BrowserAppPageTrafficDispatcher is added into DefaultScopeDefine 40.
2022-09-01 06:50:23,168 org.apache.skywalking.oap.server.core.analysis.DispatcherManager 117 [main] INFO  [] - Dispatcher org.apache.skywalking.oap.server.core.source.oal.rt.dispatcher.BrowserAppSingleVersionTrafficDispatcher is added into DefaultScopeDefine 39.
2022-09-01 06:50:23,169 org.apache.skywalking.oap.server.core.analysis.DispatcherManager 117 [main] INFO  [] - Dispatcher org.apache.skywalking.oap.server.core.source.oal.rt.dispatcher.BrowserAppTrafficDispatcher is added into DefaultScopeDefine 38.
2022-09-01 06:50:23,170 org.apache.skywalking.oap.server.library.server.grpc.GRPCServer 131 [main] INFO  [] - Bind handler BrowserPerfServiceHandler into gRPC server 0.0.0.0:11800
2022-09-01 06:50:23,173 org.apache.skywalking.oap.server.library.server.grpc.GRPCServer 131 [main] INFO  [] - Bind handler BrowserPerfServiceHandlerCompat into gRPC server 0.0.0.0:11800
2022-09-01 06:50:23,175 org.apache.skywalking.oap.server.library.server.http.HTTPServer 83 [main] INFO  [] - Bind handler BrowserPerfServiceHTTPHandler into http server 0.0.0.0:12800
2022-09-01 06:50:23,175 org.apache.skywalking.oap.server.library.module.BootstrapFlow 43 [main] INFO  [] - start the provider default in receiver-event module.
2022-09-01 06:50:23,176 org.apache.skywalking.oap.server.library.server.grpc.GRPCServer 131 [main] INFO  [] - Bind handler EventGrpcServiceHandler into gRPC server 0.0.0.0:11800
2022-09-01 06:50:23,178 org.apache.skywalking.oap.server.library.server.http.HTTPServer 83 [main] INFO  [] - Bind handler EventRestServiceHandler into http server 0.0.0.0:12800
2022-09-01 06:50:23,178 org.apache.skywalking.oap.server.library.module.BootstrapFlow 43 [main] INFO  [] - start the provider default in receiver-log module.
2022-09-01 06:50:23,179 org.apache.skywalking.oap.server.library.server.grpc.GRPCServer 131 [main] INFO  [] - Bind handler LogReportServiceGrpcHandler into gRPC server 0.0.0.0:11800
2022-09-01 06:50:23,181 org.apache.skywalking.oap.server.library.server.http.HTTPServer 83 [main] INFO  [] - Bind handler LogReportServiceHTTPHandler into http server 0.0.0.0:12800
2022-09-01 06:50:23,181 org.apache.skywalking.oap.server.library.module.BootstrapFlow 43 [main] INFO  [] - start the provider default in receiver-ebpf module.
2022-09-01 06:50:23,181 org.apache.skywalking.oap.server.library.server.grpc.GRPCServer 131 [main] INFO  [] - Bind handler EBPFProcessServiceHandler into gRPC server 0.0.0.0:11800
2022-09-01 06:50:23,185 org.apache.skywalking.oap.server.library.server.grpc.GRPCServer 131 [main] INFO  [] - Bind handler EBPFProfilingServiceHandler into gRPC server 0.0.0.0:11800
2022-09-01 06:50:23,187 org.apache.skywalking.oap.server.library.module.BootstrapFlow 43 [main] INFO  [] - start the provider default in receiver-meter module.
2022-09-01 06:50:23,187 org.apache.skywalking.oap.server.library.server.grpc.GRPCServer 131 [main] INFO  [] - Bind handler MeterServiceHandler into gRPC server 0.0.0.0:11800
2022-09-01 06:50:23,190 org.apache.skywalking.oap.server.library.server.grpc.GRPCServer 131 [main] INFO  [] - Bind handler MeterServiceHandlerCompat into gRPC server 0.0.0.0:11800
2022-09-01 06:50:23,191 org.apache.skywalking.oap.server.library.module.BootstrapFlow 43 [main] INFO  [] - start the provider default in envoy-metric module.
2022-09-01 06:50:24,340 org.apache.skywalking.oap.server.library.server.grpc.GRPCServer 131 [main] INFO  [] - Bind handler MetricServiceGRPCHandler into gRPC server 0.0.0.0:11800
2022-09-01 06:50:24,347 org.apache.skywalking.oap.server.library.server.grpc.GRPCServer 131 [main] INFO  [] - Bind handler MetricServiceGRPCHandlerV3 into gRPC server 0.0.0.0:11800
2022-09-01 06:50:24,349 org.apache.skywalking.oap.server.library.server.grpc.GRPCServer 131 [main] INFO  [] - Bind handler AccessLogServiceGRPCHandler into gRPC server 0.0.0.0:11800
2022-09-01 06:50:24,357 org.apache.skywalking.oap.server.library.server.grpc.GRPCServer 131 [main] INFO  [] - Bind handler AccessLogServiceGRPCHandlerV3 into gRPC server 0.0.0.0:11800
2022-09-01 06:50:24,358 org.apache.skywalking.oap.server.library.server.grpc.GRPCServer 131 [main] INFO  [] - Bind handler SatelliteAccessLogServiceGRPCHandlerV3 into gRPC server 0.0.0.0:11800
2022-09-01 06:50:24,379 com.linecorp.armeria.common.util.SystemInfo 237 [main] INFO  [] - hostname: skywalking-oap-d8ffc6d4-s8x8q (from /proc/sys/kernel/hostname)
2022-09-01 06:50:24,790 com.linecorp.armeria.server.Server 755 [armeria-boss-http-*:12800] INFO  [] - Serving HTTP at /0.0.0.0:12800 - http://127.0.0.1:12800/
2022-09-01 06:50:24,792 org.apache.skywalking.oap.server.core.storage.PersistenceTimer 58 [main] INFO  [] - persistence timer start
2022-09-01 06:50:24,797 org.apache.skywalking.oap.server.core.cache.CacheUpdateTimer 46 [main] INFO  [] - Cache updateServiceInventory timer start
2022-09-01 06:50:25,523 org.apache.skywalking.oap.server.starter.OAPServerBootstrap 53 [main] INFO  [] - Version of OAP: 9.1.0-f1f519c
2022-09-01 06:55:24,794 org.apache.skywalking.oap.server.core.storage.ttl.DataTTLKeeperTimer 88 [pool-17-thread-1] INFO  [] - Beginning to remove expired metrics from the storage.
2022-09-01 06:55:25,480 org.apache.skywalking.oap.server.core.storage.ttl.DataTTLKeeperTimer 91 [pool-17-thread-1] INFO  [] - Beginning to inspect data boundaries.
2022-09-01 07:00:24,794 org.apache.skywalking.oap.server.core.storage.ttl.DataTTLKeeperTimer 88 [pool-17-thread-1] INFO  [] - Beginning to remove expired metrics from the storage.
2022-09-01 07:00:25,388 org.apache.skywalking.oap.server.core.storage.ttl.DataTTLKeeperTimer 91 [pool-17-thread-1] INFO  [] - Beginning to inspect data boundaries.
2022-09-01 07:05:24,794 org.apache.skywalking.oap.server.core.storage.ttl.DataTTLKeeperTimer 88 [pool-17-thread-1] INFO  [] - Beginning to remove expired metrics from the storage.
2022-09-01 07:05:25,379 org.apache.skywalking.oap.server.core.storage.ttl.DataTTLKeeperTimer 91 [pool-17-thread-1] INFO  [] - Beginning to inspect data boundaries.
2022-09-01 07:10:24,794 org.apache.skywalking.oap.server.core.storage.ttl.DataTTLKeeperTimer 88 [pool-17-thread-1] INFO  [] - Beginning to remove expired metrics from the storage.
2022-09-01 07:10:25,411 org.apache.skywalking.oap.server.core.storage.ttl.DataTTLKeeperTimer 91 [pool-17-thread-1] INFO  [] - Beginning to inspect data boundaries.
2022-09-01 07:15:24,794 org.apache.skywalking.oap.server.core.storage.ttl.DataTTLKeeperTimer 88 [pool-17-thread-1] INFO  [] - Beginning to remove expired metrics from the storage.
2022-09-01 07:15:25,398 org.apache.skywalking.oap.server.core.storage.ttl.DataTTLKeeperTimer 91 [pool-17-thread-1] INFO  [] - Beginning to inspect data boundaries.
2022-09-01 07:16:14,054 io.kubernetes.client.informer.cache.ReflectorRunnable 240 [controller-reflector-io.kubernetes.client.openapi.models.V1Pod-1] INFO  [] - ResourceVersion 684313697 and Watch connection expired: too old resource version: 684313697 (684321063) , will retry w/o resourceVersion next time
2022-09-01 07:16:14,054 io.kubernetes.client.informer.cache.ReflectorRunnable 139 [controller-reflector-io.kubernetes.client.openapi.models.V1Pod-1] INFO  [] - class io.kubernetes.client.openapi.models.V1Pod#Watch expired, will re-list-watch soon
2022-09-01 07:16:15,055 io.kubernetes.client.informer.cache.ReflectorRunnable 84 [controller-reflector-io.kubernetes.client.openapi.models.V1Pod-1] INFO  [] - class io.kubernetes.client.openapi.models.V1Pod#Start listing and watching...
2022-09-01 07:20:24,794 org.apache.skywalking.oap.server.core.storage.ttl.DataTTLKeeperTimer 88 [pool-17-thread-1] INFO  [] - Beginning to remove expired metrics from the storage.
2022-09-01 07:20:25,388 org.apache.skywalking.oap.server.core.storage.ttl.DataTTLKeeperTimer 91 [pool-17-thread-1] INFO  [] - Beginning to inspect data boundaries.

wu-sheng · 2022-09-01T07:26:14Z

wu-sheng
Sep 1, 2022
Collaborator

Try showcase first, https://skywalking.apache.org/docs/skywalking-showcase/latest/readme/.

1 reply

92ppl Sep 1, 2022
Author

ok, i deploy it according
https://www.youtube.com/watch?v=Osk1oYNthqU
https://github.com/apache/skywalking-showcase/tree/main/deploy/platform/kubernetes/feature-kubernetes-monitor

wankai123 · 2022-09-01T08:38:28Z

wankai123
Sep 1, 2022
Collaborator

Hi, @crystal-lee. The otlp, we will support on the next version 9.2 and will release soon, so the showcase used otlp.
If you using 9.1, I suggest to use opencensus and changing your otel configure from this:

service:
  pipelines:
    metrics:
      receivers: [ prometheus ]
      exporters: [ logging, otlp ]
exporters:
  otlp:
    endpoint: "skywalking-oap.skywalking:11800"
    tls:
      insecure: true

to:

    service:
      pipelines:
        metrics:
          receivers: [ prometheus ]
          exporters: [ logging, opencensus ]
    exporters:
      opencensus:
        endpoint: "skywalking-oap.skywalking:11800"
        tls:
          insecure: true

5 replies

92ppl Sep 1, 2022
Author

thanks, i will try 9.1 with opencensus and 9.2 with otlp

92ppl Sep 1, 2022
Author

If i use 9.1 , should I modify this config?

receiver-otel:
  selector: ${SW_OTEL_RECEIVER:default}
  default:
    enabledHandlers: ${SW_OTEL_RECEIVER_ENABLED_HANDLERS:"oc"}
    enabledOcRules: ${SW_OTEL_RECEIVER_ENABLED_OC_RULES:"k8s-cluster,k8s-node,k8s-service"}

wankai123 Sep 1, 2022
Collaborator

no, oc means opencensus, in the next release 9.2 you will see otlp in there.

skywalking/oap-server/server-starter/src/main/resources/application.yml

Line 341 in fefe90b

enabledHandlers: ${SW_OTEL_RECEIVER_ENABLED_HANDLERS:"oc,otlp"}

92ppl Sep 1, 2022
Author

i will try 9.1 with opencensus, its ok.

92ppl Sep 1, 2022
Author

thanks🙏🙏🙏

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

k8s cluster monitor #9550

{{title}}

Replies: 2 comments 6 replies

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

Select a reply

k8s cluster monitor #9550

92ppl Sep 1, 2022

I want monitor k8s-cluster,k8s-node,k8s-service. but I cant see it in UI.

I deploy skywalking in the k8s use helm and It collect java client ok.

kube-state-metrics info

cadvisor info

I deploy otel-collector in k8s according to the showcase , modify skywalking oap address config

modify skywalking oap config application.yml and restart

Replies: 2 comments · 6 replies

wu-sheng Sep 1, 2022 Collaborator

92ppl Sep 1, 2022 Author

wankai123 Sep 1, 2022 Collaborator

92ppl Sep 1, 2022 Author

92ppl Sep 1, 2022 Author

wankai123 Sep 1, 2022 Collaborator

92ppl Sep 1, 2022 Author

92ppl Sep 1, 2022 Author

92ppl
Sep 1, 2022

Replies: 2 comments 6 replies

wu-sheng
Sep 1, 2022
Collaborator

92ppl Sep 1, 2022
Author

wankai123
Sep 1, 2022
Collaborator

92ppl Sep 1, 2022
Author

92ppl Sep 1, 2022
Author

wankai123 Sep 1, 2022
Collaborator

92ppl Sep 1, 2022
Author

92ppl Sep 1, 2022
Author