Add Kueue integration (#23908)

* Add initial Kueue OpenMetrics integration scaffold.

Start with a basic OpenMetrics V2 check that forwards endpoint metrics under the kueue namespace to enable early endpoint validation before adding curated mappings.

* Add basic Kueue OpenMetrics scraping

* Add curated Kueue OpenMetrics mapping

* Add Kueue resource metric suffixing

* Document Kueue as a cluster check

* Implement Kueue integration

* Fix code coverage missing

* Update README

* Fix manifest

* Update metadata

* Add owners

* Fix Kueue CI validation

* Address Kueue review feedback.

* Add memory

* Pin kind networking and node image for Kueue E2E

Use non-default service/pod subnets so the kind cluster's API service IP
does not collide with the host environment's Kubernetes networking, which
hijacked in-cluster traffic and broke Kueue's webhook cert bootstrap. Also
scope the LocalQueue readiness wait to the default namespace.

* Fix Kueue go info tag validation.

Rename the generic Go version label before submission so E2E metrics pass tag validation.

* Make Kueue E2E test pass against live cluster

Relax metric tag assertions to match the actual tag set emitted by the
controller (endpoint, replica_role, cohort tags) instead of pinning an
exact subset, and add the missing assets/service_checks.json (with its
manifest reference) that assert_service_checks requires.

* Wait for Kueue webhook before applying queue manifests

The controller deployment can report `Available` before its webhook server
is actually serving, causing intermittent `connection refused` failures when
applying ResourceFlavor/ClusterQueue. Wait for the webhook service endpoints
and retry the apply to absorb the brief cert-propagation window.

* Use remapped tag names in Kueue metric descriptions

Metric descriptions referenced the raw Prometheus labels ('cluster_queue',
'local_queue'/'localQueue') instead of the tags Datadog actually emits after
remapping ('kueue_cluster_queue', 'kueue_local_queue').

* Rename cluster_queue.pending_workloads to pending_workloads

The raw kueue_pending_workloads metric has no cluster_queue in its name, so
the cluster_queue. prefix was inconsistent with every other cluster-queue-
indexed metric (which keep bare names and just carry the kueue_cluster_queue
tag). Drop the prefix to match the source name and the rest of the convention.

* Sync Kueue configuration example

* Update codeowners

* Apply suggestions from code review

* Apply Kueue review cleanup

* Use metadata assertion for Kueue metric coverage

* Remove Kueue service check metadata

* Configure Kueue manifestless metadata

* Refactor Kueue tag assertions

* Assert Kueue e2e metrics from metadata

* Assert idle Kueue e2e metrics

* Rename Kueue flavor label

* Document Kueue GC summary metrics

* Remove checks

* Add more e2e metrics

* Fix e2e setup

* Fix Kueue e2e controller rollout wait.

* Change codeowners

* Unify Kueue unit and e2e metric expectations.

Share EXPECTED_METRIC_TAGS between tests, align the OpenMetrics fixture with
e2e queue labels, expand unit coverage, and pin go_version to go1.26.3 for
kueue.go.info to match the controller toolchain.

Author: gjulianm

.ddev/config.toml

@@ -41,6 +41,7 @@ teamcity = "TeamCity"
 win32_event_log = "Windows Event Log"
 krakend = "KrakenD"
 lustre = "Lustre"
+kueue = "Kueue"
 prefect = "Prefect"
 n8n = "n8n"
 hpe_aruba_edgeconnect = "HPE Aruba EdgeConnect"
@@ -51,6 +52,7 @@ dell_powerflex = "Dell Powerflex"
 [overrides.metrics-prefix]
 krakend = "krakend.api."
 lustre = "lustre."
+kueue = "kueue."
 prefect = "prefect.server."
 n8n = "n8n."
 control_m = "control_m."
@@ -270,6 +272,7 @@ __pycache__ = false
 [overrides.manifest.platforms]
 krakend = ["linux", "windows", "mac_os"]
 lustre = ["linux", "windows", "mac_os"]
+kueue = ["linux", "windows", "mac_os"]
 prefect = ["linux", "windows", "mac_os"]
 n8n = ["linux", "windows", "mac_os"]
 control_m = ["linux", "windows", "mac_os"]

.github/CODEOWNERS

@@ -635,6 +635,10 @@ plaid/assets/logs/                                                  @DataDog/saa
 /gpu/*.md                                                            @DataDog/ebpf-platform @DataDog/documentation
 /gpu/manifest.json                                                   @DataDog/ebpf-platform @DataDog/agent-integrations @DataDog/documentation
 
+/kueue/                                                                @DataDog/gpu-monitoring-agent
+/kueue/*.md                                                            @DataDog/gpu-monitoring-agent @DataDog/documentation
+/kueue/manifest.json                                                   @DataDog/gpu-monitoring-agent @DataDog/agent-integrations @DataDog/documentation
+
 /linux_audit_logs/                                                  @DataDog/agent-integrations
 /linux_audit_logs/*.md                                              @DataDog/agent-integrations @DataDog/documentation
 /linux_audit_logs/manifest.json                                     @DataDog/agent-integrations @DataDog/documentation

.github/workflows/config/labeler.yml

@@ -889,6 +889,10 @@ integration/kubevirt_handler:
 - changed-files:
   - any-glob-to-any-file:
     - kubevirt_handler/**/*
+integration/kueue:
+- changed-files:
+  - any-glob-to-any-file:
+    - kueue/**/*
 integration/kuma:
 - changed-files:
   - any-glob-to-any-file:

.github/workflows/test-all.yml

@@ -2338,6 +2338,26 @@ jobs:
       minimum-base-package: ${{ inputs.minimum-base-package }}
       pytest-args: ${{ inputs.pytest-args }}
     secrets: inherit
+  j3c620e6:
+    uses: ./.github/workflows/test-target.yml
+    with:
+      job-name: Kueue
+      target: kueue
+      platform: linux
+      runner: '["ubuntu-22.04"]'
+      repo: "${{ inputs.repo }}"
+      context: ${{ inputs.context }}
+      python-version: "${{ inputs.python-version }}"
+      latest: ${{ inputs.latest }}
+      agent-image: "${{ inputs.agent-image }}"
+      agent-image-py2: "${{ inputs.agent-image-py2 }}"
+      agent-image-windows: "${{ inputs.agent-image-windows }}"
+      agent-image-windows-py2: "${{ inputs.agent-image-windows-py2 }}"
+      test-py2: ${{ inputs.test-py2 }}
+      test-py3: ${{ inputs.test-py3 }}
+      minimum-base-package: ${{ inputs.minimum-base-package }}
+      pytest-args: ${{ inputs.pytest-args }}
+    secrets: inherit
   j739f9be:
     uses: ./.github/workflows/test-target.yml
     with:

code-coverage.datadog.yml

@@ -421,6 +421,9 @@ services:
 - id: kubevirt_handler
   paths:
   - kubevirt_handler/datadog_checks/kubevirt_handler/
+- id: kueue
+  paths:
+  - kueue/datadog_checks/kueue/
 - id: kuma
   paths:
   - kuma/datadog_checks/kuma/

kueue/CHANGELOG.md

@@ -0,0 +1,4 @@
+# CHANGELOG - Kueue
+
+<!-- towncrier release notes start -->
+

kueue/README.md

@@ -0,0 +1,80 @@
+# Agent Check: Kueue
+
+## Overview
+
+This check monitors Kueue through the Datadog Agent.
+
+Kueue is a Kubernetes workload queueing system that allows you to manage and schedule workloads on your Kubernetes cluster. It provides a way to prioritize and manage workloads, and to ensure that workloads are scheduled in a fair and efficient manner. This integration collects metrics from the Kueue controller manager and Kueue API server to help you monitor the health and performance of your Kueue cluster.
+
+## Setup
+
+Follow the instructions below to install and configure this check for an Agent running on a host. For containerized environments, see the [Autodiscovery Integration Templates][3].
+
+### Installation
+
+The Kueue check is included in the [Datadog Agent][2] package.
+No additional installation is required on your server.
+
+### Configuration
+
+Kueue is a cluster-level service. Configure this integration as a Cluster Agent cluster check so only one Agent instance scrapes the Kueue metrics endpoint.
+
+1. To collect optional ClusterQueue resource metrics, such as `kueue.cluster_queue.resource_usage.gpu`, configure Kueue with `metrics.enableClusterQueueResources: true` and restart the Kueue controller manager.
+
+2. Provide a [cluster check configuration][10] to the Cluster Agent. For file or ConfigMap based configuration, set `cluster_check: true` in the instance:
+
+   ```yaml
+   clusterAgent:
+     confd:
+       kueue.yaml: |-
+         cluster_check: true
+         init_config:
+         instances:
+         - openmetrics_endpoint: http://kueue-controller-manager-metrics-service.kueue-system.svc:8080/metrics
+   ```
+
+3. Alternatively, annotate the Kueue metrics service with Autodiscovery cluster check annotations:
+
+   ```yaml
+   ad.datadoghq.com/endpoints.checks: |
+     {
+       "kueue": {
+         "instances": [
+           {
+             "openmetrics_endpoint": "http://%%host%%:%%port%%/metrics"
+           }
+         ]
+       }
+     }
+   ```
+
+See the [sample kueue.d/conf.yaml][4] for all available configuration options.
+
+### Validation
+
+[Run the Cluster Agent's `clusterchecks` subcommand][11] and look for `kueue` under the Checks section.
+
+## Data Collected
+
+### Metrics
+
+See [metadata.csv][7] for a list of metrics provided by this integration.
+
+### Events
+
+The Kueue integration does not include any events.
+
+## Troubleshooting
+
+Need help? Contact [Datadog support][8].
+
+
+[2]: https://app.datadoghq.com/account/settings/agent/latest
+[3]: https://docs.datadoghq.com/containers/kubernetes/integrations/
+[4]: https://github.com/DataDog/integrations-core/blob/master/kueue/datadog_checks/kueue/data/conf.yaml.example
+[5]: https://docs.datadoghq.com/agent/configuration/agent-commands/#start-stop-and-restart-the-agent
+[6]: https://docs.datadoghq.com/agent/configuration/agent-commands/#agent-status-and-information
+[7]: https://github.com/DataDog/integrations-core/blob/master/kueue/metadata.csv
+[8]: https://docs.datadoghq.com/help/
+[10]: https://docs.datadoghq.com/containers/cluster_agent/clusterchecks/?tab=helm#configuration-from-configuration-files
+[11]: https://docs.datadoghq.com/containers/troubleshooting/cluster-and-endpoint-checks/#dispatching-logic-in-the-cluster-agent

kueue/assets/configuration/spec.yaml

@@ -0,0 +1,31 @@
+name: Kueue
+fleet_configurable: true
+files:
+- name: kueue.yaml
+  options:
+  - template: init_config
+    options:
+    - template: init_config/openmetrics
+  - template: instances
+    options:
+    - template: instances/openmetrics
+      overrides:
+        openmetrics_endpoint.value.example: http://localhost:8080/metrics
+        openmetrics_endpoint.description: |
+          Endpoint exposing Kueue's Prometheus metrics.
+    - name: cluster_check
+      description: |
+        Set to true when configuring this integration as a Cluster Agent cluster check.
+      value:
+        type: boolean
+        example: true
+    - name: resource_name_map
+      description: |
+        Mapping of Kueue resource label values to metric name suffixes for resource metrics.
+
+        By default, `cpu` is reported as `cpu`, `memory` is reported as `memory`, `nvidia.com/gpu` is reported as
+        `gpu`, and unmapped resources are reported as `other`. Built-in resource names cannot be overridden.
+      value:
+        type: object
+        example:
+          example.com/fpga: fpga

kueue/changelog.d/23908.added

@@ -0,0 +1 @@
+Initial Release.

kueue/datadog_checks/kueue/__about__.py

@@ -0,0 +1,4 @@
+# (C) Datadog, Inc. 2026-present
+# All rights reserved
+# Licensed under a 3-clause BSD style license (see LICENSE)
+__version__ = '0.0.1'