[nr-k8s-otel-collector] feat: Add additional OOM metrics (#1904)

<!--
Thank you for contributing to New Relic's Helm charts. Before you submit
this PR we'd like to
make sure you are aware of our technical requirements:

*
https://github.com/newrelic-experimental/helm-charts/blob/master/CONTRIBUTING.md#technical-requirements

For a quick overview across what we will look at reviewing your PR,
please read
our review guidelines:

*
https://github.com/newrelic-experimental/helm-charts/blob/master/REVIEW_GUIDELINES.md

Following our best practices right from the start will accelerate the
review process and
help get your PR merged quicker.

When updates to your PR are requested, please add new commits and do not
squash the
history. This will make it easier to identify new changes. The PR will
be squashed
anyways when it is merged. Thanks.

For fast feedback, please @-mention maintainers that are listed in the
Chart.yaml file.

Please make sure you test your changes before you push them. Once
pushed, a Github Action
will run across your changes and do some initial checks and linting.
These checks run
very quickly. Please check the results. We would like these checks to
pass before we
even continue reviewing your changes.
-->
#### Is this a new chart

#### What this PR does / why we need it:

#### Which issue this PR fixes
*(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)`
format, will close that issue when PR gets merged)*
  - fixes #

#### Special notes for your reviewer:

#### Checklist
[Place an '[x]' (no spaces) in all applicable fields. Please remove
unrelated fields.]
- [X] Chart Version bumped
- [ ] Variables are documented in the README.md
- [ ] Title of the PR starts with chart name (e.g. `[mychartname]`)

# Release Notes to Publish (nr-k8s-otel-collector)
If this PR contains changes in `nr-k8s-otel-collector`, please complete
the following section. All other charts should ignore this section.

<!--BEGIN-RELEASE-NOTES-->
## 🚀 What's Changed
* Adds additional OOM metrics to LDM:
`kube_pod_container_status_last_terminated_exitcode`,
`kube_pod_container_status_last_terminated_reason`,
`kube_pod_container_status_last_terminated_timestamp`, and
`kube_pod_deletion_timestamp`
<!--END-RELEASE-NOTES-->

Author: dbudziwojskiNR

charts/nr-k8s-otel-collector/Chart.yaml

@@ -17,7 +17,7 @@ type: application
 # This is the chart version. This version number should be incremented each time you make changes
 # to the chart and its templates, including the app version.
 # Versions are expected to follow Semantic Versioning (https://semver.org/)
-version: 0.8.51
+version: 0.8.52
 
 dependencies:
   - name: common-library

charts/nr-k8s-otel-collector/docs/metrics-full.md

@@ -985,6 +985,7 @@
 | KubeStateMetrics   | Prometheus Receiver   | kube_pod_container_state_started                                       | Gauge             | Whether the Pod container has started (1) or not (0).                                    |
 | KubeStateMetrics   | Prometheus Receiver   | kube_pod_container_status_last_terminated_exitcode                     | Gauge             | Exit code of the last terminated state of the container.                                 |
 | KubeStateMetrics   | Prometheus Receiver   | kube_pod_container_status_last_terminated_reason                       | Gauge             | Reason for the last termination of the container.                                        |
+| KubeStateMetrics   | Prometheus Receiver   | kube_pod_container_status_last_terminated_timestamp                    | Gauge             | Last terminated time for a pod container in unix timestamp.                              |
 | KubeStateMetrics   | Prometheus Receiver   | kube_pod_container_status_phase                                        | Gauge             | Current phase of the Pod container.                                                      |
 | KubeStateMetrics   | Prometheus Receiver   | kube_pod_container_status_ready                                        | Gauge             | Whether the Pod container is ready (1) or not (0).                                       |
 | KubeStateMetrics   | Prometheus Receiver   | kube_pod_container_status_restarts_total                               | Counter           | Total number of restarts for the Pod container.                                          |

charts/nr-k8s-otel-collector/docs/metrics-lowDataMode.md

@@ -94,11 +94,15 @@
 | KubeStateMetrics   | Prometheus Receiver   | kube_pod_container_info                                    | Gauge   | Information about the Pod container.                                           |
 | KubeStateMetrics   | Prometheus Receiver   | kube_pod_container_resource_limits                         | Gauge   | Resource limits of the Pod container.                                          |
 | KubeStateMetrics   | Prometheus Receiver   | kube_pod_container_resource_requests                       | Gauge   | Resource requests of the Pod container.                                        |
+| KubeStateMetrics   | Prometheus Receiver   | kube_pod_container_status_last_terminated_exitcode         | Gauge   | Exit code of the last terminated state of the container.                       |
+| KubeStateMetrics   | Prometheus Receiver   | kube_pod_container_status_last_terminated_reason           | Gauge   | Reason for the last termination of the container.                              |
+| KubeStateMetrics   | Prometheus Receiver   | kube_pod_container_status_last_terminated_timestamp        | Gauge   | Last terminated time for a pod container in unix timestamp.                    |
 | KubeStateMetrics   | Prometheus Receiver   | kube_pod_container_status_phase                            | Gauge   | Current phase of the Pod container.                                            |
 | KubeStateMetrics   | Prometheus Receiver   | kube_pod_container_status_ready                            | Gauge   | Whether the Pod container is ready (1) or not (0).                             |
 | KubeStateMetrics   | Prometheus Receiver   | kube_pod_container_status_restarts_total                   | Counter | Total number of restarts for the Pod container.                                |
 | KubeStateMetrics   | Prometheus Receiver   | kube_pod_container_status_waiting_reason                   | Gauge   | Reason for the container waiting state.                                        |
 | KubeStateMetrics   | Prometheus Receiver   | kube_pod_created                                           | Gauge   | Creation timestamp of the Pod.                                                 |
+| KubeStateMetrics   | Prometheus Receiver   | kube_pod_deletion_timestamp                                | Gauge   | Deletion timestamp of the Pod.                                                 |
 | KubeStateMetrics   | Prometheus Receiver   | kube_pod_info                                              | Gauge   | Information about the Pod.                                                     |
 | KubeStateMetrics   | Prometheus Receiver   | kube_pod_owner                                             | Gauge   | Owner information of the Pod.                                                  |
 | KubeStateMetrics   | Prometheus Receiver   | kube_pod_start_time                                        | Gauge   | Start time of the Pod.                                                         |

charts/nr-k8s-otel-collector/examples/k8s/rendered/clusterrole.yaml

@@ -9,7 +9,7 @@ metadata:
     app.kubernetes.io/managed-by: Helm
     app.kubernetes.io/name: nr-k8s-otel-collector
     app.kubernetes.io/version: 1.2.0
-    helm.sh/chart: nr-k8s-otel-collector-0.8.51
+    helm.sh/chart: nr-k8s-otel-collector-0.8.52
 rules:
   - apiGroups:
     - ""

charts/nr-k8s-otel-collector/examples/k8s/rendered/clusterrolebinding.yaml

@@ -9,7 +9,7 @@ metadata:
     app.kubernetes.io/managed-by: Helm
     app.kubernetes.io/name: nr-k8s-otel-collector
     app.kubernetes.io/version: 1.2.0
-    helm.sh/chart: nr-k8s-otel-collector-0.8.51
+    helm.sh/chart: nr-k8s-otel-collector-0.8.52
 subjects:
   - kind: ServiceAccount
     name: nr-k8s-otel-collector

charts/nr-k8s-otel-collector/examples/k8s/rendered/daemonset-configmap.yaml

@@ -10,7 +10,7 @@ metadata:
     app.kubernetes.io/managed-by: Helm
     app.kubernetes.io/name: nr-k8s-otel-collector
     app.kubernetes.io/version: 1.2.0
-    helm.sh/chart: nr-k8s-otel-collector-0.8.51
+    helm.sh/chart: nr-k8s-otel-collector-0.8.52
 data:
   daemonset-config.yaml: |
     receivers:
@@ -558,7 +558,7 @@ data:
             value: <cluser_name>
           - key: "newrelic.chart.version"
             action: upsert
-            value: 0.8.51
+            value: 0.8.52
           - key: newrelic.entity.type
             action: upsert
             value: "k8s"

charts/nr-k8s-otel-collector/examples/k8s/rendered/daemonset.yaml

@@ -10,7 +10,7 @@ metadata:
     app.kubernetes.io/managed-by: Helm
     app.kubernetes.io/name: nr-k8s-otel-collector
     app.kubernetes.io/version: 1.2.0
-    helm.sh/chart: nr-k8s-otel-collector-0.8.51
+    helm.sh/chart: nr-k8s-otel-collector-0.8.52
 spec:
   selector:
     matchLabels:
@@ -24,7 +24,7 @@ spec:
         app.kubernetes.io/name: nr-k8s-otel-collector
         component: daemonset
       annotations:
-        checksum/config: 67d806e2365ef2eba7e2da21f2c10e94e8c69edb8e81e2d81e0b04d561d647d1
+        checksum/config: ab4fecb38ba638aedcd5707a3705e627c70ada0681dad70d1dc6d1d80657f70e
     spec:
       serviceAccountName: nr-k8s-otel-collector
       containers:

charts/nr-k8s-otel-collector/examples/k8s/rendered/deployment-configmap.yaml

@@ -10,7 +10,7 @@ metadata:
     app.kubernetes.io/managed-by: Helm
     app.kubernetes.io/name: nr-k8s-otel-collector
     app.kubernetes.io/version: 1.2.0
-    helm.sh/chart: nr-k8s-otel-collector-0.8.51
+    helm.sh/chart: nr-k8s-otel-collector-0.8.52
 data:
   deployment-config.yaml: |
     receivers:
@@ -305,6 +305,14 @@ data:
               - value: 'false'
                 new_value: 'true'
 
+      transform/convert_timestamp:
+        metric_statements:
+          - context: datapoint
+            conditions:
+              - IsMatch(metric.name, "kube_pod_container_status_last_terminated_timestamp")
+            statements:
+              - set(datapoint.attributes["kube_pod_container_status_last_terminated_timestamp_formatted"], FormatTime(Unix(Int(datapoint.value_double)), "%Y-%m-%dT%H:%M:%SZ"))
+
       metricstransform/ksm:
         transforms:
           - include: kube_cronjob_(created|spec_suspend|status_(active|last_schedule_time))
@@ -379,7 +387,7 @@ data:
               value_actions:
               - value: 'false'
                 new_value: 'true'
-          - include: kube_pod_container_(info|resource_(limits|requests)|status_(phase|ready|restarts_total|waiting_reason))
+          - include: kube_pod_container_(info|resource_(limits|requests)|status_(phase|ready|restarts_total|waiting_reason|last_terminated_timestamp|last_terminated_exitcode|last_terminated_reason))
             action: update
             match_type: regexp
             operations:
@@ -388,7 +396,7 @@ data:
               value_actions:
               - value: 'false'
                 new_value: 'true'
-          - include: ^kube_pod_(owner|created|info|status_(phase|ready|scheduled)|start_time)$$
+          - include: ^kube_pod_(owner|created|info|status_(phase|ready|scheduled)|start_time|deletion_timestamp)$$
             action: update
             match_type: regexp
             operations:
@@ -499,7 +507,7 @@ data:
             value: <cluser_name>
           - key: "newrelic.chart.version"
             action: upsert
-            value: 0.8.51
+            value: 0.8.52
           - key: newrelic.entity.type
             action: upsert
             value: "k8s"
@@ -517,7 +525,7 @@ data:
             value: <cluser_name>
           - key: "newrelic.chart.version"
             action: upsert
-            value: 0.8.51
+            value: 0.8.52
 
       transform/events:
         log_statements:
@@ -742,6 +750,7 @@ data:
             - filter/exclude_zero_value_kube_node_status_condition
             - filter/exclude_zero_value_kube_persistentvolumeclaim_status_phase
             - filter/nr_exclude_zero_value_kube_pod_container_deployment_statuses
+            - transform/convert_timestamp
             - metricstransform/ldm
             - metricstransform/k8s_cluster_info_ldm
             - metricstransform/ksm

charts/nr-k8s-otel-collector/examples/k8s/rendered/deployment.yaml

@@ -10,7 +10,7 @@ metadata:
     app.kubernetes.io/managed-by: Helm
     app.kubernetes.io/name: nr-k8s-otel-collector
     app.kubernetes.io/version: 1.2.0
-    helm.sh/chart: nr-k8s-otel-collector-0.8.51
+    helm.sh/chart: nr-k8s-otel-collector-0.8.52
 spec:
   replicas: 1
   minReadySeconds: 5
@@ -26,7 +26,7 @@ spec:
         app.kubernetes.io/name: nr-k8s-otel-collector
         component: deployment
       annotations:
-        checksum/config: 6a6ac337894e9ea5a26468001e1200d936353f335947fc057cf655abd2fcfbb5
+        checksum/config: 154d8d67e68b767a358527bec4cae823c5a814746233f4d5967cf6eb39a32207
     spec:
       serviceAccountName: nr-k8s-otel-collector
       containers:

charts/nr-k8s-otel-collector/examples/k8s/rendered/secret.yaml

@@ -10,6 +10,6 @@ metadata:
     app.kubernetes.io/managed-by: Helm
     app.kubernetes.io/name: nr-k8s-otel-collector
     app.kubernetes.io/version: 1.2.0
-    helm.sh/chart: nr-k8s-otel-collector-0.8.51
+    helm.sh/chart: nr-k8s-otel-collector-0.8.52
 data:
   licenseKey: PE5SX2xpY2Vuc2VLZXk+