Skip to content

Releases: DataDog/datadog-agent

7.71.2

15 Oct 15:45
7.71.2
a13e160
Compare
Choose a tag to compare

Agent

Prelude

Release on: 2025-10-15

Bug Fixes

  • Stopped sending the example.metric metric to the /sketches endpoint

Datadog Cluster Agent

Prelude

Released on: 2025-10-15 Pinned to datadog-agent v7.71.2: CHANGELOG.

7.71.1

08 Oct 14:35
7.71.1
bc04a78
Compare
Choose a tag to compare

Agent

Prelude

Release on: 2025-10-08

Bug Fixes

  • Fixes configuration parsing for extended container metric collection on the container core check.

  • Fix Remote Agent management configuration changes on Windows.

  • Fix race condition that in rare cases caused remote updates on Windows to fail without an error.

    The Go context used when creating a detached subprocess was closed on exit. This triggered an async action to kill the detached subprocess, which in rare cases completed before the process exited.

Datadog Cluster Agent

Prelude

Released on: 2025-10-07 Pinned to datadog-agent v7.71.1: CHANGELOG.

7.71.0

01 Oct 15:01
7.71.0
f1671a4
Compare
Choose a tag to compare

Agent

Prelude

Release on: 2025-10-01

Upgrade Notes

  • pkg/opentelemetry-mapping-go/otlp/metrics: Add interval argument to Consumer methods. All intervals passed as of this change will be 0, which is equivalent to the previous behavior. [#725](DataDog/opentelemetry-mapping-go#725)
  • Upgrade go-sqllexer to v0.1.8

New Features

  • Added eBPF support for the prctl syscall. The following fields are now collected:

    • `prctl.option`: The option value used in the syscall.
    • `prctl.new_name`: If the option is PR_SET_NAME, the new process name.
    • `prctl.is_name_truncated`: If the option is PR_SET_NAME, indicates whether the retrieved name was truncated. A metric also tracks the number of truncated names.
  • The infraattributes processor included in DDOT pipelines can now determine a missing container.id attribute based on (in order of priority):

    1. process.pid;
    2. datadog.container.cgroup_inode (inode number of the container's cgroup);
    3. k8s.pod.uid, k8s.container.name, and optionally datadog.container.is_init.
  • This PR adds the HTTP Method and HTTP Endpoint to the stats protobuf file for the resource renaming feature.

Enhancement Notes

  • DogStatsD emits a new metric, metric_type_count, that tracks total gauges, counters, etc.

  • Remote tagger is now enabled by default in Datadog cluster check runners, resulting in improved tag support and coverage for metrics from checks such as kube_state_core when configured to run in cluster check runners.

  • Improved logs destination warning log with additional endpoint metadata such as full url, track type, EvP category, and origin.

  • Displays the partially redacted API key to each endpoint on the Logs Agent status page.

  • Add debugger v2 intake proxy.

  • Add scrubber to JMX integration config and metadata.

  • Add the new metric kubernetes.pod.terminating.duration to kubelet check to track pods that are stuck in the termination phase. If deletionTimestamp is set to a time in the future,`kubernetes.pod.terminating.duration` is only emitted when the current time reaches the time set in deletionTimestamp.

  • Adds kubernetes.deployment.rollout_duration metric to ksm check.

  • On Linux, the Agent is now able to bind to ports below 1024 by default, simplifying common logs, SNMP, and integrations configurations. This is done by setting AmbientCapabilities=CAP_NET_BIND_SERVICE in the Agent systemd units.

    If you want to disable this, create a systemd drop-in file (e.g., /etc/systemd/system/datadog-agent.service.d/disable-capability.conf) with: ` [Service] AmbientCapabilities=`.

  • Added kube_argo_rollout tag for workloads controlled by Argo Rollouts.

  • Agents are now built with Go 1.24.6.

  • APM: Add new configuration "DD_APM_CLIENT_STATS_FLUSH_INTERVAL" to adjust client stats flushing interval. This can be used to test if longer flushing intervals can improve stats processing throughput.

  • Consistently retrieve the socket protocol (sk_protocol) and include it in the key for the flow PID map. This change ensures that the flow PID map uses a consistent key format that includes the socket protocol, improving the accuracy and reliability of flow tracking in network operations.

  • Increase the Logs Agent default max message payload size from 256 KB to 900 KB.

  • Install-Datadog.ps1 now checks that the downloaded datadog-installer-x86_64.exe has a valid Datadog code signature.

  • gather and expose kubernetes state metrics for init containers. gather and expose init containers resources requests and limits when container is set with restartPolicy=Always.

  • Add a new tag kube_static_cpus on kubernetes CPU metrics that indicates whether a container is using dedicated cores.

  • Adds a disable field to interface_configs to disable metric collection for selected interfaces.

  • Add RUM support to the OpenTelemetry mapping library.

  • DDOT now supports sending host metadata from OTel resource attributes. This is required for Gateway support. See https://docs.datadoghq.com/opentelemetry/mapping/host_metadata/ on how to configure the attributes.

  • The non-DDOT OTLP ingestion pipelines for traces and metrics now include the infraattributes processor, enabling more complete Kubernetes tag enrichment.

  • pkg/opentelemetry-mapping-go: Sync with upstream library through [commit 7c614b196a40f883502e86e195e89c233b4c1006](DataDog/opentelemetry-mapping-go@7c614b1).

  • pkg/util/quantile: Sync with upstream library through [commit 7c614b196a40f883502e86e195e89c233b4c1006](DataDog/opentelemetry-mapping-go@7c614b1).

  • Adds complete workloadmeta process-entity information to workload-list command logs (datadog-agent workload-list)

Deprecation Notes

  • Remove the deprecated routing processor from DDOT. Use the routing connector instead.
  • Logging to syslog with TLS is no longer supported.

Bug Fixes

  • Fixed an issue during Agent upgrade where all datadog-prefixed packages were treated as integrations, preventing non-integration libraries from being reinstalled.
  • De-duplicates service checks when auto-discovery is enabled with the docker listener. Ensuring pod annotated services only have one check and ignores configuration from the default file source.
  • Restores the ability to update the trace-agent in the Azure App Services Extension by removing the remote tagger requirement. The remote tagger is disabled when running in AAS Extension.
  • Upgrade datadog-traceroute to v0.1.4.
  • Add a safety check before calculating the container.memory.working_set metric to prevent an inflated, incorrect result (16 EiB).
  • Remediate duplicated logs when using the native EKS Fargate logging method.
  • Fix profiling billing when using Azure App Services.
  • Fix potential deadlock when querying sub-processes configuration. When other processes are in a failed state, the Agent HTTPS timeout would not be taken into account, causing it to wait forever. This would block the creation of the status page and cause missing information in flares.
  • Install-Datadog.ps1 now displays error messages when run in environments without a proper console, such as PSRemoting or PowerShell ISE.
  • Fixes a bug in the kubelet check where the first seen eviction would not result in the kubernetes.kubelet.evictions metric being emitted.
  • Fix redis span obfuscation for HSET command, as it allows multiples fields to be set at once since redis 4.0.0
  • Store previously seen images in workloadmeta, and only query the image status endpoint for new images. Previously, if image collection for CRI-O was enabled, the Agent would query the image status endpoint for every image, on every check. This was an expensive network request and would log verbose output to journald.
  • Fixed could not create SSL context: library has no ciphers error in the postgres integration for the FIPS version of the Agent.
  • Remove the call to the API server resource type cache when the kubernetes_state_core check is running on the node Agent, as the cache is not initialized.
  • Adds filtering for metrics in the kubelet summary provider that are excluded by the Autodiscovery exclusion annotations.
  • Remote Agent updates on Windows now consider MSI exit codes 3010 and 1641 to indicate success
  • Remote Agent updates on Windows now use the /norestart MSI option to prevent Windows from automatically rebooting the host in rare cases when files are in use.
  • pkg/opentelemetry-mapping-go/otlp/metrics: Correctly treat summary counts as cumulative monotonic sums instead of cumulative non-monotonic sums. [#635](DataDog/opentelemetry-mapping-go#635)
  • pkg/opentelemetry-mapping-go/inframetadata: Send host meta on new hosts. [#652](DataDog/opentelemetry-mapping-go#652), [#655](DataDog/opentelemetry-mapping-go#655)
  • pkg/opentelemetry-mapping-go/otlp/metrics: Fix automatic intial point dropping when converting cumulative monotonic sum metrics. [#654](DataDog/opentelemetry-mapping-go#654)
  • pkg/opentelemetry-mapping-go/inframetadata: Add support for host aliasing using resource attribute datadog.host.aliases. [#661](DataDog/opentelemetry-mapping-go#661)
  • pkg/opentelemetry-mapping-go/otlp/metrics: Improve accuracy of exponential histogram conversion when count is 1. [#696](DataDog/opentelemetry-mapping-go#696)
  • pkg/util/quantile: Improve accuracy of exponential histogram conversion when count</spa...
Read more

7.70.2

15 Sep 12:47
7.70.2
83bbd72
Compare
Choose a tag to compare

Agent

Prelude

Release on: 2025-09-15

Enhancement Notes

  • Add new scrubbers for API keys and auth tokens in HTTP headers and YAML files. keys added:
    • authority
    • cms-svc-api-key
    • sec-websocket-key
    • x-api-key
    • x-auth
    • x-auth-token
    • x-dreamfactory-api-key
    • x-lz-api-key
    • x-rundeck-auth-token
    • x-stratum-auth
    • x-sungard-idp-api-key
    • auth-tenantid
    • x-vtex-api-appkey
    • x-octopus-apikey
    • cainzapp-api-key
    • x-pm-partner-key
    • x-rapidapi-key
    • lodauth
    • statuskey
    • x-functions-key

Datadog Cluster Agent

Prelude

Released on: 2025-09-15 Pinned to datadog-agent v7.70.2: CHANGELOG.

7.70.1

10 Sep 12:35
7.70.1
432517c
Compare
Choose a tag to compare

Agent

Prelude

Release on: 2025-09-10

Bug Fixes

  • gpum: fix patching of SystemD device permissions

Datadog Cluster Agent

Prelude

Released on: 2025-09-10 Pinned to datadog-agent v7.70.1: CHANGELOG.

7.70.0

03 Sep 12:17
7.70.0
952ac81
Compare
Choose a tag to compare

Agent

Prelude

Release on: 2025-09-03

Upgrade Notes

  • GPUM: GPU workload metadata and autodiscovery are now enabled by default. If you want to disable this functionality, add "nvml" to the autoconfig_exclude_features configuration flag in your datadog.yaml file.
  • Upgraded the WDK version used by ddnpm.
  • Upgrade ddprocmon to version 1.3.0. This version contains minor cosmetic changes to the ABI.
  • None. This change is backward-compatible and does not modify behavior unless users explicitly set new environment variables.

New Features

  • Windows: Add certificate chain validation to Windows Certificate Store integration.
  • Added agent remote-config reset command to reset the remote configuration state which can be useful in troubleshooting issues related to remote configuration.
  • GPUM: Add new configuration flag gpu.enabled to agent config to control the GPU Core-Check component, disabled by default.
  • Adds Cisco IPsec VPN tunnel metrics and options data collection to SNMP. This can be enabled and disabled using the collect_vpn config.
  • Support Cloud Run Jobs in serverless-init.
  • The Windows Agent install script (Install-Datadog.ps1) now supports setting host tags and enabling logs collection at install time via the DD_TAGS and DD_LOGS_ENABLED environment variables. This allows users to configure tags and logs without post-install edits to datadog.yaml.

Enhancement Notes

  • Add cluster_arn, service_arn, and task_arn tags to the ECS tasks.
  • Add container_instance_arn as a host tag when running on ECS EC2.
  • Add a script to manage IIS .NET APM instrumentation on Windows
  • Add macOS build for AArch64/ARM64.
  • Added garbage collection of the tmp directory to the datadog-installer.
  • The Datadog autoscaler now can apply vertical scaling recommendations to sidecar init containers.
  • Agents are now built with Go 1.24.6.
  • Expose additional cgroup memory metrics: active_anon, inactive_anon, active_file, inactive_file, unevictable, shmem, file_mapped, file_dirty, file_writeback, page_tables, refault_anon, refault_file. Metrics are disbaled be default. To enable them please modify conf.d/container.d/conf.yaml and flip extended_memory_metrics to true.
  • Add enhanced metrics for task started, ended, and duration for Cloud Run Jobs.
  • gpu: Renamed gpu.core.usage and gpu.memory.usage to gpu.process.core/memory.usage
  • If a path is specified in the URL in logs_config.logs_dd_url, use it as a prefix.
  • Add the datadog.snmp.requests metric, which tracks the number of SNMP requests sent by the Agent to devices.
  • Added detection and replacement of tags: blocks in datadog.yaml to ensure only top-level, uncommented, and non-nested tags are modified during install.
  • Add thumbprints and serial numbers as tags for certificates and CRLs to the Windows certificate store integration.
  • Remote Agent management on Windows now automatically retries when the MSI returns error 1601 (ERROR_INSTALL_SERVICE_FAILURE).
  • Remote Agent Management on Windows now automatically retries when an MSI custom action returns error 1601 (ERROR_INSTALL_SERVICE_FAILURE) and causes Error 1719. The Windows Installer Service could not be accessed.

Deprecation Notes

  • Remove deprecated serializer options.
    • enable_stream_payload_serialization
    • enable_service_checks_stream_payload_serialization
    • enable_events_stream_payload_serialization
    • enable_sketch_stream_payload_serialization

Bug Fixes

  • Fix a panic in Docker file log parsing when received messages are null equivalent.
  • When the Autodiscovery scheduler gets blocked, it triggers a health check failure (reported in the agent health command).
  • When the prometheus_scrape.enabled option is set to true and the pod has a prometheus.io/port annotation, containers must expose that port in their spec in order for the Agent to schedule openmetrics checks.
  • Fixes an issue where pending ECS tasks would temporarily remove the global tags ecs_cluster_name and cluster_arn.
  • Fix bug causing integrations configured via docker labels or K8s annotations to be overwritten in the agent so logs from integrations now work when configured using via docker labels or K8s annotations.
  • Fix noisy error logs when scrubbing large pod container commands.
  • Remote updates on Windows now quotes and escapes MSI property values. This fixes an issue that caused remote updates to fail when the Agent username contains whitespace, for example DDAGENTUSER_NAME=NT AUTHORITY\SYSTEM.
  • Remote Agent updates on Windows now handle computer name updates done after the initial install of the Agent. This allows the use of golden images to deploy remotely updatable hosts.
  • gpu: Java programs using deeplearning4j are now properly detected and monitored
  • gpu: fix container-to-device assignment for Docker containers
  • Data Streams Messages: Fix Unscheduling of kafka_consumer integrations that was leading to duplicate integrations running in parallel.
  • The Kafka messages feature is not working in some cases when using K8s labels because config is translated to yaml.
  • Load check tags onto the orchestrator check configured to be dispatched and run as a cluster check
  • APM: Fix issue where the probabilistic sampler would drop all OTLP traffic.
  • Kubernetes logs source timestamps are now validated. Invalid timestamps will not be passed.
  • The Agent no longer logs an error each time it fails to connect to system-probe through \\.\pipe\dd_system_probe. This log message was added in Agent 7.63.0. The error is still logged if it persists long enough, see [#35790](#35790). Each failed connection attempt still logs the error at debug level to aid troubleshooting.
  • Fixed an issue where DD_TAGS and DD_LOGS_ENABLED were silently ignored during install, requiring manual configuration edits.
  • Fixed an issue where metrics in the Windows certificate store integration are merged when multiple certificates have the same subject.
  • Fixed an issue where the Windows Event Log tailer could lose historical events (the 'amnesia bug') when it started with no prior bookmark and no events were processed immediately. The Agent now correctly seeds an initial bookmark from the most recent event upon startup, ensuring no events are missed on subsequent runs.

Other Notes

  • Add handling for dbm-health events in the event platform forwarder. These events are used by Database Monitoring integrations to report on Agent status.
  • Add a new metric counter to the Agent telemetry for transactions.errors. This will help to monitor the rate of empty or rejected sketch payloads sent to the backend.

Datadog Cluster Agent

Prelude

Released on: 2025-09-03 Pinned to datadog-agent v7.70.0: CHANGELOG.

Enhancement Notes

  • Created a new configuration option orchestrator_explorer.custom_resources.max_count that will allow customers to increase the number of custom resources they can collect in the Cluster Agent.
  • Time zones are now collected for CronJobs in the orchestrator check
  • Collect EndpointSlices by default.

Bug Fixes

  • Correctly set the VerticalPodAutoscaler mode to "Auto" when not provided
  • Fixed an issue that caused some Datadog Cluster Agent replicas to restart during the first install.
  • When using leases for leader election with the leader_election_default_resource option, the Datadog Cluster Agent no longer creates an unused config map.
  • Fix the cronjob.on_schedule_check service check of the kubernetes_state check for CronJobs that have a specific time zone.

7.69.4

27 Aug 06:35
7.69.4
9bd1f3e
Compare
Choose a tag to compare

Agent

Prelude

Release on: 2025-08-27

Upgrade Notes

  • Upgrade sqllite to 3.50.4 on Windows.

Datadog Cluster Agent

Prelude

Released on: 2025-08-27 Pinned to datadog-agent v7.69.4: CHANGELOG.

7.69.3

26 Aug 07:24
7.69.3
bec7e17
Compare
Choose a tag to compare

Agent

Prelude

Release on: 2025-08-26

Enhancement Notes

  • Agents are now built with Go 1.24.6.

Security Notes

Bug Fixes

  • Fixes a bug in the Trace Agent that prevented DDOT from shutting down gracefully.
  • Fixed truncation telemetry so it records service and source values correctly, by moving metrics recording to the tailer layer.

Datadog Cluster Agent

Prelude

Released on: 2025-08-26 Pinned to datadog-agent v7.69.3: CHANGELOG.

7.69.2

20 Aug 15:25
7.69.2
928f3f3
Compare
Choose a tag to compare

Agent

Prelude

Release on: 2025-08-20

Upgrade Notes

  • Upgrade libxml2 to 2.14.5.

Datadog Cluster Agent

Prelude

Released on: 2025-08-20 Pinned to datadog-agent v7.69.2: CHANGELOG.

7.69.1

18 Aug 15:56
7.69.1
4380b6c
Compare
Choose a tag to compare

Agent

Prelude

Release on: 2025-08-18

Bug Fixes

  • Remote Agent updates on Windows now checks if the custom Agent password is available before updating the Agent. This prevents the update from failing later and leaving the host without an Agent installed.

    This is only applicable to domain-joined hosts using a custom Agent username and password. See [Agent 7.66.0 upgrade notes](https://github.com/DataDog/datadog-agent/releases/tag/7.66.0) for more information.

Datadog Cluster Agent

Prelude

Released on: 2025-08-18 Pinned to datadog-agent v7.69.1: CHANGELOG.