Skip to content

track test branch for op - #19688

Draft
erikayasuda wants to merge 3 commits into
mainfrom
erikayasuda/test-op
Draft

track test branch for op#19688
erikayasuda wants to merge 3 commits into
mainfrom
erikayasuda/test-op

Conversation

@erikayasuda

Copy link
Copy Markdown
Collaborator

Description

Testing

Risks

Additional Notes

@datadog-datadog-us1-prod

datadog-datadog-us1-prod Bot commented Aug 13, 2026

Copy link
Copy Markdown

Pipelines  Tests

⚠️ Warnings

🚦 15 Pipeline jobs failed

DataDog/apm-reliability/dd-trace-py | build linux serverless: [amd64, cp315-cp315, v126532274-233089d-musllinux_1_2_x86_64, 1]   View in Datadog   GitLab

DataDog/apm-reliability/dd-trace-py | build linux serverless: [arm64, cp315-cp315, v113741357-d2b8243-manylinux2014_aarch64, 1]   View in Datadog   GitLab

DataDog/apm-reliability/dd-trace-py | build linux: [amd64, cp315-cp315, v113741238-d2b8243-manylinux2014_x86_64]   View in Datadog   GitLab

View all 15 failed jobs.

🧪 4 Tests failed in 4 jobs

DataDog/apm-reliability/dd-trace-py | contrib/kafka 1/4

test_service_override_env_var[py3.10] from test_kafka.py   View in Datadog
At request <Request GET /test/session/snapshot >:
   At snapshot (token='tests.contrib.kafka.test_kafka.test_service_override_env_var'):
    - Directory: /go/src/github.com/DataDog/apm-reliability/dd-trace-py/tests/snapshots
    - CI mode: 1
    - Trace File: /go/src/github.com/DataDog/apm-reliability/dd-trace-py/tests/snapshots/tests.contrib.kafka.test_kafka.test_service_override_env_var.json
    - Stats File: /go/src/github.com/DataDog/apm-reliability/dd-trace-py/tests/snapshots/tests.contrib.kafka.test_kafka.test_service_override_env_var_tracestats.json
    At compare of 2 expected trace(s) to 2 received trace(s):
     At trace 'kafka.consume' (1 spans):
      At snapshot compare of span 'kafka.consume' at position 1 in trace:
       - Expected span:
...

DataDog/apm-reliability/dd-trace-py | contrib/kafka 2/4

test_service_override_config[py3.9] from test_kafka.py   View in Datadog
At request <Request GET /test/session/snapshot >:
   At snapshot (token='tests.contrib.kafka.test_kafka.test_service_override'):
    - Directory: /go/src/github.com/DataDog/apm-reliability/dd-trace-py/tests/snapshots
    - CI mode: 1
    - Trace File: /go/src/github.com/DataDog/apm-reliability/dd-trace-py/tests/snapshots/tests.contrib.kafka.test_kafka.test_service_override.json
    - Stats File: /go/src/github.com/DataDog/apm-reliability/dd-trace-py/tests/snapshots/tests.contrib.kafka.test_kafka.test_service_override_tracestats.json
    At compare of 2 expected trace(s) to 2 received trace(s):
     At trace 'kafka.consume' (1 spans):
      At snapshot compare of span 'kafka.consume' at position 1 in trace:
       - Expected span:
...

DataDog/apm-reliability/dd-trace-py | contrib/kafka 3/4

test_service_override_config[py3.11] from test_kafka.py   View in Datadog
At request <Request GET /test/session/snapshot >:
   At snapshot (token='tests.contrib.kafka.test_kafka.test_service_override'):
    - Directory: /go/src/github.com/DataDog/apm-reliability/dd-trace-py/tests/snapshots
    - CI mode: 1
    - Trace File: /go/src/github.com/DataDog/apm-reliability/dd-trace-py/tests/snapshots/tests.contrib.kafka.test_kafka.test_service_override.json
    - Stats File: /go/src/github.com/DataDog/apm-reliability/dd-trace-py/tests/snapshots/tests.contrib.kafka.test_kafka.test_service_override_tracestats.json
    At compare of 2 expected trace(s) to 2 received trace(s):
     At trace 'kafka.consume' (1 spans):
      At snapshot compare of span 'kafka.consume' at position 1 in trace:
       - Expected span:
...

DataDog/apm-reliability/dd-trace-py | contrib/kafka 4/4

test_service_override_config[py3.10] from test_kafka.py   View in Datadog
At request <Request GET /test/session/snapshot >:
   At snapshot (token='tests.contrib.kafka.test_kafka.test_service_override'):
    - Directory: /go/src/github.com/DataDog/apm-reliability/dd-trace-py/tests/snapshots
    - CI mode: 1
    - Trace File: /go/src/github.com/DataDog/apm-reliability/dd-trace-py/tests/snapshots/tests.contrib.kafka.test_kafka.test_service_override.json
    - Stats File: /go/src/github.com/DataDog/apm-reliability/dd-trace-py/tests/snapshots/tests.contrib.kafka.test_kafka.test_service_override_tracestats.json
    At compare of 2 expected trace(s) to 2 received trace(s):
     At trace 'kafka.consume' (1 spans):
      At snapshot compare of span 'kafka.consume' at position 1 in trace:
       - Expected span:
...

ℹ️ Info

No other issues found (see more)

❄️ No new flaky tests detected

🔄 Datadog retried 15 tests - 11 passed on retry View in Datadog

🚧 1 test that failed was ignored due to quarantine View in Datadog

🔄 Datadog auto-retried 1 job - 1 passed on retry View in Datadog

Useful? React with 👍 / 👎

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 709832f | Docs | Datadog PR Page | Give us feedback!

@cit-pr-commenter-54b7da

Copy link
Copy Markdown

Codeowners resolved as

Resolved from the full PR diff against main using the target branch CODEOWNERS file.
CODEOWNERS team requests not listed below are not required by the current file set.

.gitlab/one-pipeline.locked.yml                                         @DataDog/python-guild @DataDog/apm-core-python

@cit-pr-commenter-54b7da

cit-pr-commenter-54b7da Bot commented Aug 13, 2026

Copy link
Copy Markdown

Dependency direction analysis

⚠️ Existing dependency direction violations

There are 255 dependency direction violations that already exist on the base branch and have not been changed by this PR.

Show existing violations (showing 5 of 255 highest severity)
ddtrace.internal.tracemethods -×-> ddtrace.trace  (internal-core -> product:tracing, score=134)
ddtrace.llmobs._integrations.langchain -×-> ddtrace.trace  (product:llmobs -> product:tracing, score=132)
ddtrace.internal.ci_visibility.filters -×-> ddtrace.trace  (product:ci_visibility -> product:tracing, score=132)
ddtrace.internal.ci_visibility.api._base -×-> ddtrace.trace  (product:ci_visibility -> product:tracing, score=132)
ddtrace.llmobs._integrations.base -×-> ddtrace.trace  (product:llmobs -> product:tracing, score=132)

To see all violations, download the layers-base.json and layers-pr.json artifacts from this CI job and run:

uv run --script scripts/import-analysis/layers.py compare layers-base.json layers-pr.json

@cit-pr-commenter-54b7da

cit-pr-commenter-54b7da Bot commented Aug 13, 2026

Copy link
Copy Markdown

Circular import analysis

⚠️ Existing circular imports

There are 5 circular imports that already exist on the base branch and have not been changed by this PR.

ddtrace.contrib.internal.django.patch -> ddtrace.contrib.internal.django.response -> ddtrace.contrib.internal.django.patch
ddtrace.contrib.internal.pytorch._distributed -> ddtrace.contrib.internal.pytorch._rank_root -> ddtrace.contrib.internal.pytorch._distributed
ddtrace.llmobs -> ddtrace.llmobs._evaluators -> ddtrace.llmobs._evaluators.format -> ddtrace.llmobs._experiment -> ddtrace.llmobs
ddtrace.errortracking._handled_exceptions.bytecode_injector -> ddtrace.errortracking._handled_exceptions.callbacks -> ddtrace.errortracking._handled_exceptions.collector -> ddtrace.errortracking._handled_exceptions.bytecode_reporting -> ddtrace.errortracking._handled_exceptions.bytecode_injector
ddtrace.appsec._asm_request_context -> ddtrace.appsec._iast._iast_request_context_base -> ddtrace.appsec._iast._iast_env -> ddtrace.appsec._iast.reporter -> ddtrace.appsec._exploit_prevention.stack_traces -> ddtrace.appsec._asm_request_context

@pr-commenter

pr-commenter Bot commented Aug 13, 2026

Copy link
Copy Markdown

Benchmarks

Benchmark execution time: 2026-08-13 20:49:58

Comparing candidate commit 709832f in PR branch erikayasuda/test-op with baseline commit 6f2816b in branch main.

Found 0 performance improvements and 8 performance regressions! Performance is the same for 612 metrics, 9 unstable metrics.

scenario:httppropagationinject-ids_only

  • 🟥 execution_time [+2.518µs; +2.703µs] or [+11.779%; +12.643%]

scenario:iastaspects-lower_aspect

  • 🟥 execution_time [+30.743µs; +36.763µs] or [+13.618%; +16.285%]

scenario:iastaspects-modulo_noaspect

  • 🟥 execution_time [+26.787µs; +32.167µs] or [+8.588%; +10.313%]

scenario:iastaspectsospath-ospathbasename_aspect

  • 🟥 execution_time [+80.975µs; +87.550µs] or [+20.957%; +22.658%]

scenario:iastaspectssplit-rsplit_aspect

  • 🟥 execution_time [+11.227µs; +15.029µs] or [+8.059%; +10.789%]

scenario:span-start

  • 🟥 execution_time [+1.314ms; +1.530ms] or [+8.216%; +9.568%]

scenario:telemetryaddmetric-1-count-metric-1-times

  • 🟥 execution_time [+375.755ns; +423.288ns] or [+14.381%; +16.200%]

scenario:tracer-small

  • 🟥 execution_time [+26.555µs; +29.253µs] or [+7.605%; +8.378%]

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant