wip allow versioned dataset pull #14921

gary-huang · 2025-10-16T19:37:55Z

Description

Testing

with the following script to first pull the latest version, then a specified version, and a non existent version, we get the following output:

import os
import math

from dotenv import load_dotenv
# Load environment variables from the .env file.
load_dotenv(override=True)

from typing import Dict, Any

from ddtrace.llmobs import LLMObs


LLMObs.enable(api_key=os.getenv("DD_API_KEY"), app_key=os.getenv("DD_APPLICATION_KEY"),  project_name="Onboarding", ml_app="Onboarding-ML-App")

import ddtrace
print(ddtrace.get_version())


dataset = LLMObs.pull_dataset("1-then-big-gh-09021124", project_name="default-project")
print("LATEST VERSION")
print(dataset.as_dataframe())

print(f"version: {dataset.version}")
print(f"current version: {dataset.current_version}")

print(dataset.url)

print("\nOLDER BELOW")
dataset1 = LLMObs.pull_dataset("1-then-big-gh-09021124", project_name="default-project", version=5)

print(dataset1.as_dataframe())

print(f"version: {dataset1.version}")
print(f"current version: {dataset1.current_version}")

print(dataset1.url)

dataset2 = LLMObs.pull_dataset("1-then-big-gh-09021124", project_name="default-project", version=500)
print("\nNON EXISTENT VERSION")
print(dataset2.as_dataframe())

print(f"version: {dataset2.version}")
print(f"current version: {dataset2.current_version}")

print(dataset2.url)

output:

3.17.0.dev70+g6cf1a5a8f
LATEST VERSION
unexpected metadata format <class 'str'>
                                              input_data                                    expected_output

0      aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa...  bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb...
1      aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa...  bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb...
2      aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa...  bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb...
3      aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa...  bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb...
4      aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa...  bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb...
...                                                  ...                                                ...
45000  aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa...  bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb...
45001  aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa...  bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb...
45002  aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa...  bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb...
45003  aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa...  bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb...
45004                                              first                                                  1

[45005 rows x 2 columns]
version: 6
current version: 6
https://app.datadoghq.com/llm/datasets/a68e7967-9d2b-4171-a887-f55ba4dbfe5e

OLDER BELOW
                                              input_data                                    expected_output

0      aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa...  bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb...
1      aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa...  bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb...
2      aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa...  bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb...
3      aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa...  bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb...
4      aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa...  bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb...
...                                                  ...                                                ...
34999  aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa...  bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb...
35000  aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa...  bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb...
35001  aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa...  bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb...
35002  aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa...  bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb...
35003                                              first                                                  1

[35004 rows x 2 columns]
version: 5
current version: 6
https://app.datadoghq.com/llm/datasets/a68e7967-9d2b-4171-a887-f55ba4dbfe5e
Traceback (most recent call last):
  File "/Users/gary.huang/go/src/github.com/DataDog/llm-observability/preview/experiments/notebooks/test-big-pull.py", line 42, in <module>
    dataset2 = LLMObs.pull_dataset("1-then-big-gh-09021124", project_name="default-project", version=500)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/gary.huang/go/src/github.com/DataDog/dd-trace-py/ddtrace/llmobs/_llmobs.py", line 673, in pull_dataset
    ds = cls._instance._dne_client.dataset_get_with_records(dataset_name, (project_name or cls._project_name), version)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/gary.huang/go/src/github.com/DataDog/dd-trace-py/ddtrace/llmobs/_writer.py", line 493, in dataset_get_with_records
    raise ValueError(
ValueError: Failed to pull dataset records for 1-then-big-gh-09021124, page=0: 400 {'errors': [{'title': 'Generic Error', 'detail': 'invalid version: version is greater than the current version or negative'}]}

the number of entries match the different versions of the dataset: https://dddev.datadoghq.com/llm/datasets/a68e7967-9d2b-4171-a887-f55ba4dbfe5e

Risks

Additional Notes

github-actions · 2025-10-16T19:38:34Z

CODEOWNERS have been resolved as:

ddtrace/llmobs/_experiment.py                                           @DataDog/ml-observability
ddtrace/llmobs/_llmobs.py                                               @DataDog/ml-observability
ddtrace/llmobs/_writer.py                                               @DataDog/ml-observability
tests/llmobs/test_experiments.py                                        @DataDog/ml-observability

github-actions · 2025-10-16T20:03:34Z

Bootstrap import analysis

Comparison of import times between this PR and base.

Summary

The average import time from this PR is: 242 ± 2 ms.

The average import time from base is: 244 ± 3 ms.

The import time difference between this PR and base is: -2.2 ± 0.1 ms.

Import time breakdown

The following import paths have shrunk:

ddtrace.auto 1.987 ms (0.82%)

ddtrace.bootstrap.sitecustomize 1.303 ms (0.54%)

ddtrace.bootstrap.preload 1.303 ms (0.54%)

ddtrace.internal.remoteconfig.client 0.630 ms (0.26%)

ddtrace 0.685 ms (0.28%)

ddtrace.internal._unpatched 0.031 ms (0.01%)

json 0.031 ms (0.01%)

json.decoder 0.031 ms (0.01%)

re 0.031 ms (0.01%)

enum 0.031 ms (0.01%)

types 0.031 ms (0.01%)

pr-commenter · 2025-10-16T20:45:43Z

Performance SLOs

Comparing candidate gary/mlob-3837 (6cf1a5a) with baseline main (24f0351)

🟡 Near SLO Breach (6 suites)

🟡 djangosimple - 30/30

✅ appsec

Time: ✅ 20.499ms (SLO: <22.300ms -8.1%) vs baseline: +0.4%

Memory: ✅ 65.426MB (SLO: <67.000MB -2.3%) vs baseline: +4.7%

✅ exception-replay-enabled

Time: ✅ 1.343ms (SLO: <1.450ms -7.4%) vs baseline: -0.7%

Memory: ✅ 64.535MB (SLO: <67.000MB -3.7%) vs baseline: +4.7%

✅ iast

Time: ✅ 20.544ms (SLO: <22.250ms -7.7%) vs baseline: +0.4%

Memory: ✅ 65.488MB (SLO: <67.000MB -2.3%) vs baseline: +4.9%

✅ profiler

Time: ✅ 15.288ms (SLO: <16.550ms -7.6%) vs baseline: +0.6%

Memory: ✅ 53.674MB (SLO: <54.500MB 🟡 -1.5%) vs baseline: +4.6%

✅ resource-renaming

Time: ✅ 20.519ms (SLO: <21.750ms -5.7%) vs baseline: ~same

Memory: ✅ 65.392MB (SLO: <67.000MB -2.4%) vs baseline: +4.7%

✅ span-code-origin

Time: ✅ 25.450ms (SLO: <28.200ms -9.8%) vs baseline: +0.3%

Memory: ✅ 67.519MB (SLO: <69.500MB -2.8%) vs baseline: +4.9%

✅ tracer

Time: ✅ 20.512ms (SLO: <21.750ms -5.7%) vs baseline: +0.1%

Memory: ✅ 65.471MB (SLO: <67.000MB -2.3%) vs baseline: +5.0%

✅ tracer-and-profiler

Time: ✅ 22.107ms (SLO: <23.500ms -5.9%) vs baseline: ~same

Memory: ✅ 66.547MB (SLO: <67.500MB 🟡 -1.4%) vs baseline: +4.6%

✅ tracer-dont-create-db-spans

Time: ✅ 19.347ms (SLO: <21.500ms 📉 -10.0%) vs baseline: ~same

Memory: ✅ 65.488MB (SLO: <66.000MB 🟡 -0.8%) vs baseline: +4.9%

✅ tracer-minimal

Time: ✅ 16.624ms (SLO: <17.500ms -5.0%) vs baseline: -0.3%

Memory: ✅ 65.379MB (SLO: <66.000MB 🟡 -0.9%) vs baseline: +4.7%

✅ tracer-native

Time: ✅ 20.518ms (SLO: <21.750ms -5.7%) vs baseline: +0.2%

Memory: ✅ 71.468MB (SLO: <72.500MB 🟡 -1.4%) vs baseline: +4.9%

✅ tracer-no-caches

Time: ✅ 18.452ms (SLO: <19.650ms -6.1%) vs baseline: ~same

Memory: ✅ 65.411MB (SLO: <67.000MB -2.4%) vs baseline: +4.7%

✅ tracer-no-databases

Time: ✅ 18.789ms (SLO: <20.100ms -6.5%) vs baseline: +0.5%

Memory: ✅ 65.443MB (SLO: <67.000MB -2.3%) vs baseline: +4.8%

✅ tracer-no-middleware

Time: ✅ 20.169ms (SLO: <21.500ms -6.2%) vs baseline: +0.5%

Memory: ✅ 65.456MB (SLO: <67.000MB -2.3%) vs baseline: +4.8%

✅ tracer-no-templates

Time: ✅ 20.280ms (SLO: <22.000ms -7.8%) vs baseline: ~same

Memory: ✅ 65.460MB (SLO: <67.000MB -2.3%) vs baseline: +4.7%

🟡 errortrackingdjangosimple - 6/6

✅ errortracking-enabled-all

Time: ✅ 18.057ms (SLO: <19.850ms -9.0%) vs baseline: +0.2%

Memory: ✅ 65.274MB (SLO: <66.500MB 🟡 -1.8%) vs baseline: +4.9%

✅ errortracking-enabled-user

Time: ✅ 18.040ms (SLO: <19.400ms -7.0%) vs baseline: +0.4%

Memory: ✅ 65.333MB (SLO: <66.500MB 🟡 -1.8%) vs baseline: +5.0%

✅ tracer-enabled

Time: ✅ 18.049ms (SLO: <19.450ms -7.2%) vs baseline: -0.2%

Memory: ✅ 65.313MB (SLO: <66.500MB 🟡 -1.8%) vs baseline: +4.9%

🟡 flasksimple - 18/18

✅ appsec-get

Time: ✅ 4.603ms (SLO: <4.750ms -3.1%) vs baseline: +0.4%

Memory: ✅ 62.010MB (SLO: <65.000MB -4.6%) vs baseline: +4.9%

✅ appsec-post

Time: ✅ 6.614ms (SLO: <6.750ms -2.0%) vs baseline: +0.2%

Memory: ✅ 61.991MB (SLO: <65.000MB -4.6%) vs baseline: +4.7%

✅ appsec-telemetry

Time: ✅ 4.588ms (SLO: <4.750ms -3.4%) vs baseline: +0.2%

Memory: ✅ 61.991MB (SLO: <65.000MB -4.6%) vs baseline: +4.9%

✅ debugger

Time: ✅ 1.858ms (SLO: <2.000ms -7.1%) vs baseline: ~same

Memory: ✅ 45.416MB (SLO: <47.000MB -3.4%) vs baseline: +4.9%

✅ iast-get

Time: ✅ 1.860ms (SLO: <2.000ms -7.0%) vs baseline: -0.2%

Memory: ✅ 42.369MB (SLO: <49.000MB 📉 -13.5%) vs baseline: +4.8%

✅ profiler

Time: ✅ 1.908ms (SLO: <2.100ms -9.2%) vs baseline: -0.3%

Memory: ✅ 46.498MB (SLO: <47.000MB 🟡 -1.1%) vs baseline: +5.0%

✅ resource-renaming

Time: ✅ 3.375ms (SLO: <3.650ms -7.5%) vs baseline: ~same

Memory: ✅ 52.258MB (SLO: <53.500MB -2.3%) vs baseline: +4.9%

✅ tracer

Time: ✅ 3.367ms (SLO: <3.650ms -7.7%) vs baseline: +0.3%

Memory: ✅ 52.258MB (SLO: <53.500MB -2.3%) vs baseline: +4.8%

✅ tracer-native

Time: ✅ 3.367ms (SLO: <3.650ms -7.8%) vs baseline: +0.2%

Memory: ✅ 58.287MB (SLO: <60.000MB -2.9%) vs baseline: +4.9%

🟡 otelspan - 22/22

✅ add-event

Time: ✅ 41.901ms (SLO: <47.150ms 📉 -11.1%) vs baseline: +2.4%

Memory: ✅ 44.177MB (SLO: <47.000MB -6.0%) vs baseline: +5.0%

✅ add-metrics

Time: ✅ 319.819ms (SLO: <344.800ms -7.2%) vs baseline: +0.3%

Memory: ✅ 616.677MB (SLO: <630.000MB -2.1%) vs baseline: +5.0%

✅ add-tags

Time: ✅ 288.376ms (SLO: <314.000ms -8.2%) vs baseline: -1.4%

Memory: ✅ 618.873MB (SLO: <630.000MB 🟡 -1.8%) vs baseline: +4.7%

✅ get-context

Time: ✅ 81.354ms (SLO: <92.350ms 📉 -11.9%) vs baseline: +0.6%

Memory: ✅ 39.747MB (SLO: <46.500MB 📉 -14.5%) vs baseline: +4.7%

✅ is-recording

Time: ✅ 38.501ms (SLO: <44.500ms 📉 -13.5%) vs baseline: +0.4%

Memory: ✅ 43.538MB (SLO: <47.500MB -8.3%) vs baseline: +4.7%

✅ record-exception

Time: ✅ 59.573ms (SLO: <67.650ms 📉 -11.9%) vs baseline: +2.3%

Memory: ✅ 40.053MB (SLO: <47.000MB 📉 -14.8%) vs baseline: +4.6%

✅ set-status

Time: ✅ 44.819ms (SLO: <50.400ms 📉 -11.1%) vs baseline: +1.8%

Memory: ✅ 43.636MB (SLO: <47.000MB -7.2%) vs baseline: +4.9%

✅ start

Time: ✅ 37.952ms (SLO: <43.450ms 📉 -12.7%) vs baseline: +0.7%

Memory: ✅ 43.658MB (SLO: <47.000MB -7.1%) vs baseline: +4.8%

✅ start-finish

Time: ✅ 82.612ms (SLO: <88.000ms -6.1%) vs baseline: -0.3%

Memory: ✅ 34.564MB (SLO: <46.500MB 📉 -25.7%) vs baseline: +4.9%

✅ start-finish-telemetry

Time: ✅ 84.171ms (SLO: <89.000ms -5.4%) vs baseline: -0.2%

Memory: ✅ 34.623MB (SLO: <46.500MB 📉 -25.5%) vs baseline: +5.2%

✅ update-name

Time: ✅ 39.351ms (SLO: <45.150ms 📉 -12.8%) vs baseline: +0.6%

Memory: ✅ 43.963MB (SLO: <47.000MB -6.5%) vs baseline: +4.8%

🟡 span - 26/26

✅ add-event

Time: ✅ 20.291ms (SLO: <22.500ms -9.8%) vs baseline: +0.1%

Memory: ✅ 49.702MB (SLO: <53.000MB -6.2%) vs baseline: +4.9%

✅ add-metrics

Time: ✅ 91.145ms (SLO: <93.500ms -2.5%) vs baseline: +0.2%

Memory: ✅ 690.303MB (SLO: <961.000MB 📉 -28.2%) vs baseline: +4.8%

✅ add-tags

Time: ✅ 147.584ms (SLO: <155.000ms -4.8%) vs baseline: ~same

Memory: ✅ 690.322MB (SLO: <962.500MB 📉 -28.3%) vs baseline: +4.8%

✅ get-context

Time: ✅ 18.938ms (SLO: <20.500ms -7.6%) vs baseline: +1.0%

Memory: ✅ 48.373MB (SLO: <53.000MB -8.7%) vs baseline: +4.8%

✅ is-recording

Time: ✅ 19.247ms (SLO: <20.500ms -6.1%) vs baseline: +0.9%

Memory: ✅ 48.432MB (SLO: <53.000MB -8.6%) vs baseline: +4.7%

✅ record-exception

Time: ✅ 38.875ms (SLO: <40.000ms -2.8%) vs baseline: +3.7%

Memory: ✅ 42.464MB (SLO: <53.000MB 📉 -19.9%) vs baseline: +4.8%

✅ set-status

Time: ✅ 20.792ms (SLO: <22.000ms -5.5%) vs baseline: +0.4%

Memory: ✅ 48.497MB (SLO: <53.000MB -8.5%) vs baseline: +4.9%

✅ start

Time: ✅ 18.881ms (SLO: <20.500ms -7.9%) vs baseline: +1.0%

Memory: ✅ 48.422MB (SLO: <53.000MB -8.6%) vs baseline: +4.9%

✅ start-finish

Time: ✅ 51.618ms (SLO: <52.500ms 🟡 -1.7%) vs baseline: +0.4%

Memory: ✅ 32.165MB (SLO: <34.000MB -5.4%) vs baseline: +4.8%

✅ start-finish-telemetry

Time: ✅ 53.713ms (SLO: <54.500ms 🟡 -1.4%) vs baseline: +2.1%

Memory: ✅ 32.086MB (SLO: <34.000MB -5.6%) vs baseline: +4.6%

✅ start-finish-traceid128

Time: ✅ 54.816ms (SLO: <57.000ms -3.8%) vs baseline: ~same

Memory: ✅ 32.165MB (SLO: <34.000MB -5.4%) vs baseline: +5.0%

✅ start-traceid128

Time: ✅ 19.336ms (SLO: <22.500ms 📉 -14.1%) vs baseline: +1.5%

Memory: ✅ 48.491MB (SLO: <53.000MB -8.5%) vs baseline: +4.7%

✅ update-name

Time: ✅ 19.445ms (SLO: <22.000ms 📉 -11.6%) vs baseline: +0.7%

Memory: ✅ 49.135MB (SLO: <53.000MB -7.3%) vs baseline: +4.8%

🟡 telemetryaddmetric - 30/30

✅ 1-count-metric-1-times

Time: ✅ 3.217µs (SLO: <20.000µs 📉 -83.9%) vs baseline: +9.1%

Memory: ✅ 32.165MB (SLO: <34.000MB -5.4%) vs baseline: +4.9%

✅ 1-count-metrics-100-times

Time: ✅ 203.653µs (SLO: <220.000µs -7.4%) vs baseline: +0.7%

Memory: ✅ 32.165MB (SLO: <34.000MB -5.4%) vs baseline: +5.1%

✅ 1-distribution-metric-1-times

Time: ✅ 3.317µs (SLO: <20.000µs 📉 -83.4%) vs baseline: +0.7%

Memory: ✅ 32.185MB (SLO: <34.000MB -5.3%) vs baseline: +4.9%

✅ 1-distribution-metrics-100-times

Time: ✅ 214.657µs (SLO: <220.000µs -2.4%) vs baseline: -0.4%

Memory: ✅ 32.204MB (SLO: <34.000MB -5.3%) vs baseline: +4.9%

✅ 1-gauge-metric-1-times

Time: ✅ 2.211µs (SLO: <20.000µs 📉 -88.9%) vs baseline: +0.3%

Memory: ✅ 32.086MB (SLO: <34.000MB -5.6%) vs baseline: +4.7%

✅ 1-gauge-metrics-100-times

Time: ✅ 137.236µs (SLO: <150.000µs -8.5%) vs baseline: +0.3%

Memory: ✅ 32.185MB (SLO: <34.000MB -5.3%) vs baseline: +4.9%

✅ 1-rate-metric-1-times

Time: ✅ 3.067µs (SLO: <20.000µs 📉 -84.7%) vs baseline: +0.5%

Memory: ✅ 32.165MB (SLO: <34.000MB -5.4%) vs baseline: +5.0%

✅ 1-rate-metrics-100-times

Time: ✅ 213.973µs (SLO: <250.000µs 📉 -14.4%) vs baseline: -0.8%

Memory: ✅ 32.086MB (SLO: <34.000MB -5.6%) vs baseline: +4.6%

✅ 100-count-metrics-100-times

Time: ✅ 20.686ms (SLO: <22.000ms -6.0%) vs baseline: +1.2%

Memory: ✅ 32.106MB (SLO: <34.000MB -5.6%) vs baseline: +4.8%

✅ 100-distribution-metrics-100-times

Time: ✅ 2.261ms (SLO: <2.300ms 🟡 -1.7%) vs baseline: -0.6%

Memory: ✅ 32.165MB (SLO: <34.000MB -5.4%) vs baseline: +4.9%

✅ 100-gauge-metrics-100-times

Time: ✅ 1.406ms (SLO: <1.550ms -9.3%) vs baseline: +0.3%

Memory: ✅ 32.067MB (SLO: <34.000MB -5.7%) vs baseline: +4.6%

✅ 100-rate-metrics-100-times

Time: ✅ 2.214ms (SLO: <2.550ms 📉 -13.2%) vs baseline: +0.9%

Memory: ✅ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +5.1%

✅ flush-1-metric

Time: ✅ 4.499µs (SLO: <20.000µs 📉 -77.5%) vs baseline: +0.4%

Memory: ✅ 32.126MB (SLO: <34.000MB -5.5%) vs baseline: +4.9%

✅ flush-100-metrics

Time: ✅ 176.091µs (SLO: <250.000µs 📉 -29.6%) vs baseline: ~same

Memory: ✅ 32.086MB (SLO: <34.000MB -5.6%) vs baseline: +4.7%

✅ flush-1000-metrics

Time: ✅ 2.108ms (SLO: <2.500ms 📉 -15.7%) vs baseline: -1.2%

Memory: ✅ 32.932MB (SLO: <34.500MB -4.5%) vs baseline: +4.9%

⚠️ Unstable Tests (1 suite)

⚠️

coreapiscenario - 10/10 (1 unstable)

⚠️ context_with_data_listeners

Time: ⚠️ 13.304µs (SLO: <20.000µs 📉 -33.5%) vs baseline: +0.2%

Memory: ✅ 32.106MB (SLO: <33.500MB -4.2%) vs baseline: +4.7%

✅ context_with_data_no_listeners

Time: ✅ 3.285µs (SLO: <10.000µs 📉 -67.2%) vs baseline: -0.1%

Memory: ✅ 32.126MB (SLO: <33.500MB -4.1%) vs baseline: +4.7%

✅ get_item_exists

Time: ✅ 0.590µs (SLO: <10.000µs 📉 -94.1%) vs baseline: +0.3%

Memory: ✅ 32.067MB (SLO: <33.500MB -4.3%) vs baseline: +4.7%

✅ get_item_missing

Time: ✅ 0.637µs (SLO: <10.000µs 📉 -93.6%) vs baseline: -0.3%

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +5.1%

✅ set_item

Time: ✅ 24.243µs (SLO: <30.000µs 📉 -19.2%) vs baseline: +0.6%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +5.1%

✅ All Tests Passing (17 suites)

✅ errortrackingflasksqli - 6/6

✅ errortracking-enabled-all

Time: ✅ 2.070ms (SLO: <2.300ms -10.0%) vs baseline: +0.2%

Memory: ✅ 51.865MB (SLO: <53.500MB -3.1%) vs baseline: +4.7%

✅ errortracking-enabled-user

Time: ✅ 2.074ms (SLO: <2.250ms -7.8%) vs baseline: +0.3%

Memory: ✅ 51.944MB (SLO: <53.500MB -2.9%) vs baseline: +4.7%

✅ tracer-enabled

Time: ✅ 2.071ms (SLO: <2.300ms -10.0%) vs baseline: -0.1%

Memory: ✅ 52.003MB (SLO: <53.500MB -2.8%) vs baseline: +5.0%

✅ flasksqli - 6/6

✅ appsec-enabled

Time: ✅ 3.943ms (SLO: <4.200ms -6.1%) vs baseline: +0.2%

Memory: ✅ 62.246MB (SLO: <66.000MB -5.7%) vs baseline: +4.7%

✅ iast-enabled

Time: ✅ 2.438ms (SLO: <2.800ms 📉 -12.9%) vs baseline: -0.8%

Memory: ✅ 58.609MB (SLO: <60.000MB -2.3%) vs baseline: +4.9%

✅ tracer-enabled

Time: ✅ 2.057ms (SLO: <2.250ms -8.6%) vs baseline: -0.5%

Memory: ✅ 52.239MB (SLO: <54.500MB -4.1%) vs baseline: +5.1%

✅ httppropagationextract - 60/60

✅ all_styles_all_headers

Time: ✅ 81.541µs (SLO: <100.000µs 📉 -18.5%) vs baseline: +0.7%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.7%

✅ b3_headers

Time: ✅ 14.176µs (SLO: <20.000µs 📉 -29.1%) vs baseline: ~same

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%

✅ b3_single_headers

Time: ✅ 13.209µs (SLO: <20.000µs 📉 -34.0%) vs baseline: -0.3%

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +4.9%

✅ datadog_tracecontext_tracestate_not_propagated_on_trace_id_no_match

Time: ✅ 64.138µs (SLO: <80.000µs 📉 -19.8%) vs baseline: +0.6%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +5.1%

✅ datadog_tracecontext_tracestate_propagated_on_trace_id_match

Time: ✅ 66.151µs (SLO: <80.000µs 📉 -17.3%) vs baseline: -0.3%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +4.9%

✅ empty_headers

Time: ✅ 1.595µs (SLO: <10.000µs 📉 -84.0%) vs baseline: +0.3%

Memory: ✅ 32.244MB (SLO: <33.500MB -3.8%) vs baseline: +5.1%

✅ full_t_id_datadog_headers

Time: ✅ 22.720µs (SLO: <30.000µs 📉 -24.3%) vs baseline: -0.1%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +4.8%

✅ invalid_priority_header

Time: ✅ 6.469µs (SLO: <10.000µs 📉 -35.3%) vs baseline: -0.4%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.7%

✅ invalid_span_id_header

Time: ✅ 6.513µs (SLO: <10.000µs 📉 -34.9%) vs baseline: -0.1%

Memory: ✅ 32.106MB (SLO: <33.500MB -4.2%) vs baseline: +4.5%

✅ invalid_tags_header

Time: ✅ 6.524µs (SLO: <10.000µs 📉 -34.8%) vs baseline: +0.5%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%

✅ invalid_trace_id_header

Time: ✅ 6.497µs (SLO: <10.000µs 📉 -35.0%) vs baseline: -0.4%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +5.0%

✅ large_header_no_matches

Time: ✅ 27.502µs (SLO: <30.000µs -8.3%) vs baseline: -0.4%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.8%

✅ large_valid_headers_all

Time: ✅ 28.572µs (SLO: <40.000µs 📉 -28.6%) vs baseline: -0.5%

Memory: ✅ 32.126MB (SLO: <33.500MB -4.1%) vs baseline: +4.6%

✅ medium_header_no_matches

Time: ✅ 9.851µs (SLO: <20.000µs 📉 -50.7%) vs baseline: +0.4%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.7%

✅ medium_valid_headers_all

Time: ✅ 11.198µs (SLO: <20.000µs 📉 -44.0%) vs baseline: +0.2%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.8%

✅ none_propagation_style

Time: ✅ 1.724µs (SLO: <10.000µs 📉 -82.8%) vs baseline: +1.2%

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +5.1%

✅ tracecontext_headers

Time: ✅ 34.505µs (SLO: <40.000µs 📉 -13.7%) vs baseline: +0.6%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%

✅ valid_headers_all

Time: ✅ 6.480µs (SLO: <10.000µs 📉 -35.2%) vs baseline: -0.2%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +5.2%

✅ valid_headers_basic

Time: ✅ 6.086µs (SLO: <10.000µs 📉 -39.1%) vs baseline: +0.2%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%

✅ wsgi_empty_headers

Time: ✅ 1.597µs (SLO: <10.000µs 📉 -84.0%) vs baseline: +0.2%

Memory: ✅ 32.145MB (SLO: <33.500MB -4.0%) vs baseline: +4.8%

✅ wsgi_invalid_priority_header

Time: ✅ 6.564µs (SLO: <10.000µs 📉 -34.4%) vs baseline: +0.3%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%

✅ wsgi_invalid_span_id_header

Time: ✅ 1.594µs (SLO: <10.000µs 📉 -84.1%) vs baseline: +0.7%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +5.0%

✅ wsgi_invalid_tags_header

Time: ✅ 6.538µs (SLO: <10.000µs 📉 -34.6%) vs baseline: ~same

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +4.8%

✅ wsgi_invalid_trace_id_header

Time: ✅ 6.524µs (SLO: <10.000µs 📉 -34.8%) vs baseline: -0.2%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%

✅ wsgi_large_header_no_matches

Time: ✅ 28.687µs (SLO: <40.000µs 📉 -28.3%) vs baseline: -0.1%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%

✅ wsgi_large_valid_headers_all

Time: ✅ 29.685µs (SLO: <40.000µs 📉 -25.8%) vs baseline: -0.3%

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +4.8%

✅ wsgi_medium_header_no_matches

Time: ✅ 10.051µs (SLO: <20.000µs 📉 -49.7%) vs baseline: ~same

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%

✅ wsgi_medium_valid_headers_all

Time: ✅ 11.643µs (SLO: <20.000µs 📉 -41.8%) vs baseline: +0.6%

Memory: ✅ 32.126MB (SLO: <33.500MB -4.1%) vs baseline: +4.7%

✅ wsgi_valid_headers_all

Time: ✅ 6.534µs (SLO: <10.000µs 📉 -34.7%) vs baseline: -0.9%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%

✅ wsgi_valid_headers_basic

Time: ✅ 6.133µs (SLO: <10.000µs 📉 -38.7%) vs baseline: +0.8%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%

✅ httppropagationinject - 16/16

✅ ids_only

Time: ✅ 21.578µs (SLO: <30.000µs 📉 -28.1%) vs baseline: -0.7%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%

✅ with_all

Time: ✅ 29.114µs (SLO: <40.000µs 📉 -27.2%) vs baseline: +0.7%

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +4.8%

✅ with_dd_origin

Time: ✅ 25.559µs (SLO: <30.000µs 📉 -14.8%) vs baseline: +0.4%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.7%

✅ with_priority_and_origin

Time: ✅ 24.909µs (SLO: <40.000µs 📉 -37.7%) vs baseline: +0.2%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +4.9%

✅ with_sampling_priority

Time: ✅ 21.578µs (SLO: <30.000µs 📉 -28.1%) vs baseline: -0.5%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.7%

✅ with_tags

Time: ✅ 27.123µs (SLO: <40.000µs 📉 -32.2%) vs baseline: +0.4%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.8%

✅ with_tags_invalid

Time: ✅ 28.501µs (SLO: <40.000µs 📉 -28.7%) vs baseline: -0.3%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +5.0%

✅ with_tags_max_size

Time: ✅ 27.466µs (SLO: <40.000µs 📉 -31.3%) vs baseline: -0.2%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.7%

✅ iast_aspects - 40/40

✅ re_expand_aspect

Time: ✅ 31.897µs (SLO: <40.000µs 📉 -20.3%) vs baseline: -0.3%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.7%

✅ re_expand_noaspect

Time: ✅ 28.818µs (SLO: <40.000µs 📉 -28.0%) vs baseline: +0.4%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +5.0%

✅ re_findall_aspect

Time: ✅ 2.914µs (SLO: <10.000µs 📉 -70.9%) vs baseline: -0.3%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%

✅ re_findall_noaspect

Time: ✅ 1.424µs (SLO: <10.000µs 📉 -85.8%) vs baseline: +0.2%

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%

✅ re_finditer_aspect

Time: ✅ 4.425µs (SLO: <10.000µs 📉 -55.8%) vs baseline: -0.4%

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +5.1%

✅ re_finditer_noaspect

Time: ✅ 1.419µs (SLO: <10.000µs 📉 -85.8%) vs baseline: ~same

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ re_fullmatch_aspect

Time: ✅ 2.655µs (SLO: <10.000µs 📉 -73.4%) vs baseline: -0.5%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%

✅ re_fullmatch_noaspect

Time: ✅ 1.295µs (SLO: <10.000µs 📉 -87.0%) vs baseline: -0.1%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%

✅ re_group_aspect

Time: ✅ 2.997µs (SLO: <10.000µs 📉 -70.0%) vs baseline: -1.8%

Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +4.7%

✅ re_group_noaspect

Time: ✅ 1.624µs (SLO: <10.000µs 📉 -83.8%) vs baseline: +1.2%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%

✅ re_groups_aspect

Time: ✅ 3.253µs (SLO: <10.000µs 📉 -67.5%) vs baseline: +2.3%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.8%

✅ re_groups_noaspect

Time: ✅ 1.703µs (SLO: <10.000µs 📉 -83.0%) vs baseline: -0.1%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%

✅ re_match_aspect

Time: ✅ 2.697µs (SLO: <10.000µs 📉 -73.0%) vs baseline: -3.1%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%

✅ re_match_noaspect

Time: ✅ 1.299µs (SLO: <10.000µs 📉 -87.0%) vs baseline: -0.8%

Memory: ✅ 37.591MB (SLO: <39.000MB -3.6%) vs baseline: +4.7%

✅ re_search_aspect

Time: ✅ 2.557µs (SLO: <10.000µs 📉 -74.4%) vs baseline: +0.7%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%

✅ re_search_noaspect

Time: ✅ 1.208µs (SLO: <10.000µs 📉 -87.9%) vs baseline: +0.8%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.8%

✅ re_sub_aspect

Time: ✅ 3.447µs (SLO: <10.000µs 📉 -65.5%) vs baseline: -0.2%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ re_sub_noaspect

Time: ✅ 1.535µs (SLO: <10.000µs 📉 -84.7%) vs baseline: +0.9%

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%

✅ re_subn_aspect

Time: ✅ 3.703µs (SLO: <10.000µs 📉 -63.0%) vs baseline: ~same

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +5.2%

✅ re_subn_noaspect

Time: ✅ 1.622µs (SLO: <10.000µs 📉 -83.8%) vs baseline: +0.9%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%

✅ iastaspects - 118/118

✅ add_aspect

Time: ✅ 0.406µs (SLO: <10.000µs 📉 -95.9%) vs baseline: -0.2%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ add_inplace_aspect

Time: ✅ 0.404µs (SLO: <10.000µs 📉 -96.0%) vs baseline: -0.8%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ add_inplace_noaspect

Time: ✅ 0.320µs (SLO: <10.000µs 📉 -96.8%) vs baseline: +0.6%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ add_noaspect

Time: ✅ 0.277µs (SLO: <10.000µs 📉 -97.2%) vs baseline: +0.8%

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +5.1%

✅ bytearray_aspect

Time: ✅ 1.329µs (SLO: <10.000µs 📉 -86.7%) vs baseline: -1.8%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.8%

✅ bytearray_extend_aspect

Time: ✅ 1.517µs (SLO: <10.000µs 📉 -84.8%) vs baseline: -0.3%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%

✅ bytearray_extend_noaspect

Time: ✅ 0.613µs (SLO: <10.000µs 📉 -93.9%) vs baseline: +0.2%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ bytearray_noaspect

Time: ✅ 0.480µs (SLO: <10.000µs 📉 -95.2%) vs baseline: -0.2%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.1%

✅ bytes_aspect

Time: ✅ 1.278µs (SLO: <10.000µs 📉 -87.2%) vs baseline: -1.9%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.9%

✅ bytes_noaspect

Time: ✅ 0.498µs (SLO: <10.000µs 📉 -95.0%) vs baseline: +1.0%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%

✅ bytesio_aspect

Time: ✅ 1.316µs (SLO: <10.000µs 📉 -86.8%) vs baseline: -1.1%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.7%

✅ bytesio_noaspect

Time: ✅ 0.495µs (SLO: <10.000µs 📉 -95.1%) vs baseline: ~same

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ capitalize_aspect

Time: ✅ 0.740µs (SLO: <10.000µs 📉 -92.6%) vs baseline: +0.2%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%

✅ capitalize_noaspect

Time: ✅ 0.432µs (SLO: <10.000µs 📉 -95.7%) vs baseline: -1.3%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.8%

✅ casefold_aspect

Time: ✅ 0.735µs (SLO: <10.000µs 📉 -92.7%) vs baseline: -0.8%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.9%

✅ casefold_noaspect

Time: ✅ 0.369µs (SLO: <10.000µs 📉 -96.3%) vs baseline: +0.1%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%

✅ decode_aspect

Time: ✅ 0.725µs (SLO: <10.000µs 📉 -92.8%) vs baseline: ~same

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.0%

✅ decode_noaspect

Time: ✅ 0.429µs (SLO: <10.000µs 📉 -95.7%) vs baseline: +2.1%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.6%

✅ encode_aspect

Time: ✅ 0.710µs (SLO: <10.000µs 📉 -92.9%) vs baseline: ~same

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.0%

✅ encode_noaspect

Time: ✅ 0.404µs (SLO: <10.000µs 📉 -96.0%) vs baseline: -0.2%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ format_aspect

Time: ✅ 3.484µs (SLO: <10.000µs 📉 -65.2%) vs baseline: +4.2%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.4%

✅ format_map_aspect

Time: ✅ 3.589µs (SLO: <10.000µs 📉 -64.1%) vs baseline: +0.4%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.9%

✅ format_map_noaspect

Time: ✅ 0.783µs (SLO: <10.000µs 📉 -92.2%) vs baseline: +1.5%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.9%

✅ format_noaspect

Time: ✅ 0.596µs (SLO: <10.000µs 📉 -94.0%) vs baseline: +0.2%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%

✅ index_aspect

Time: ✅ 0.353µs (SLO: <10.000µs 📉 -96.5%) vs baseline: -2.6%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%

✅ index_noaspect

Time: ✅ 0.274µs (SLO: <10.000µs 📉 -97.3%) vs baseline: -0.5%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%

✅ join_aspect

Time: ✅ 1.329µs (SLO: <10.000µs 📉 -86.7%) vs baseline: +0.9%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ join_noaspect

Time: ✅ 0.492µs (SLO: <10.000µs 📉 -95.1%) vs baseline: -0.5%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%

✅ ljust_aspect

Time: ✅ 2.594µs (SLO: <20.000µs 📉 -87.0%) vs baseline: -0.8%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ ljust_noaspect

Time: ✅ 0.400µs (SLO: <10.000µs 📉 -96.0%) vs baseline: -1.2%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.7%

✅ lower_aspect

Time: ✅ 2.253µs (SLO: <10.000µs 📉 -77.5%) vs baseline: -0.5%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ lower_noaspect

Time: ✅ 0.365µs (SLO: <10.000µs 📉 -96.3%) vs baseline: +0.1%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.8%

✅ lstrip_aspect

Time: ✅ 2.456µs (SLO: <20.000µs 📉 -87.7%) vs baseline: +9.6%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +3.9%

✅ lstrip_noaspect

Time: ✅ 0.386µs (SLO: <10.000µs 📉 -96.1%) vs baseline: +2.2%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%

✅ modulo_aspect

Time: ✅ 1.005µs (SLO: <10.000µs 📉 -89.9%) vs baseline: +0.9%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.0%

✅ modulo_aspect_for_bytearray_bytearray

Time: ✅ 1.532µs (SLO: <10.000µs 📉 -84.7%) vs baseline: -0.5%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.8%

✅ modulo_aspect_for_bytes

Time: ✅ 0.983µs (SLO: <10.000µs 📉 -90.2%) vs baseline: +0.4%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.8%

✅ modulo_aspect_for_bytes_bytearray

Time: ✅ 1.201µs (SLO: <10.000µs 📉 -88.0%) vs baseline: -0.5%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.3%

✅ modulo_noaspect

Time: ✅ 0.631µs (SLO: <10.000µs 📉 -93.7%) vs baseline: +0.4%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.9%

✅ replace_aspect

Time: ✅ 4.829µs (SLO: <10.000µs 📉 -51.7%) vs baseline: -0.4%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ replace_noaspect

Time: ✅ 0.464µs (SLO: <10.000µs 📉 -95.4%) vs baseline: +0.9%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.6%

✅ repr_aspect

Time: ✅ 0.914µs (SLO: <10.000µs 📉 -90.9%) vs baseline: +1.2%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ repr_noaspect

Time: ✅ 0.416µs (SLO: <10.000µs 📉 -95.8%) vs baseline: -0.5%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.7%

✅ rstrip_aspect

Time: ✅ 1.911µs (SLO: <20.000µs 📉 -90.4%) vs baseline: -1.4%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +3.7%

✅ rstrip_noaspect

Time: ✅ 0.385µs (SLO: <10.000µs 📉 -96.1%) vs baseline: +1.5%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ slice_aspect

Time: ✅ 0.495µs (SLO: <10.000µs 📉 -95.0%) vs baseline: +0.3%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%

✅ slice_noaspect

Time: ✅ 0.452µs (SLO: <10.000µs 📉 -95.5%) vs baseline: +1.5%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.8%

✅ stringio_aspect

Time: ✅ 1.568µs (SLO: <10.000µs 📉 -84.3%) vs baseline: -0.3%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ stringio_noaspect

Time: ✅ 0.721µs (SLO: <10.000µs 📉 -92.8%) vs baseline: -1.2%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.8%

✅ strip_aspect

Time: ✅ 2.241µs (SLO: <20.000µs 📉 -88.8%) vs baseline: +1.2%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ strip_noaspect

Time: ✅ 0.389µs (SLO: <10.000µs 📉 -96.1%) vs baseline: +1.5%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%

✅ swapcase_aspect

Time: ✅ 2.459µs (SLO: <10.000µs 📉 -75.4%) vs baseline: +0.3%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%

✅ swapcase_noaspect

Time: ✅ 0.534µs (SLO: <10.000µs 📉 -94.7%) vs baseline: -1.0%

Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +4.7%

✅ title_aspect

Time: ✅ 2.379µs (SLO: <10.000µs 📉 -76.2%) vs baseline: -0.4%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.7%

✅ title_noaspect

Time: ✅ 0.507µs (SLO: <10.000µs 📉 -94.9%) vs baseline: +0.8%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.8%

✅ translate_aspect

Time: ✅ 3.368µs (SLO: <10.000µs 📉 -66.3%) vs baseline: +1.3%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%

✅ translate_noaspect

Time: ✅ 1.048µs (SLO: <10.000µs 📉 -89.5%) vs baseline: +0.7%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.8%

✅ upper_aspect

Time: ✅ 2.280µs (SLO: <10.000µs 📉 -77.2%) vs baseline: +1.0%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ upper_noaspect

Time: ✅ 0.370µs (SLO: <10.000µs 📉 -96.3%) vs baseline: -1.2%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%

✅ iastaspectsospath - 24/24

✅ ospathbasename_aspect

Time: ✅ 4.323µs (SLO: <10.000µs 📉 -56.8%) vs baseline: +0.5%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.8%

✅ ospathbasename_noaspect

Time: ✅ 1.099µs (SLO: <10.000µs 📉 -89.0%) vs baseline: +1.1%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%

✅ ospathjoin_aspect

Time: ✅ 6.226µs (SLO: <10.000µs 📉 -37.7%) vs baseline: ~same

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%

✅ ospathjoin_noaspect

Time: ✅ 2.317µs (SLO: <10.000µs 📉 -76.8%) vs baseline: +0.6%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ ospathnormcase_aspect

Time: ✅ 3.571µs (SLO: <10.000µs 📉 -64.3%) vs baseline: -0.9%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%

✅ ospathnormcase_noaspect

Time: ✅ 0.579µs (SLO: <10.000µs 📉 -94.2%) vs baseline: +0.3%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%

✅ ospathsplit_aspect

Time: ✅ 4.949µs (SLO: <10.000µs 📉 -50.5%) vs baseline: +0.1%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ ospathsplit_noaspect

Time: ✅ 1.598µs (SLO: <10.000µs 📉 -84.0%) vs baseline: +0.6%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.8%

✅ ospathsplitdrive_aspect

Time: ✅ 3.775µs (SLO: <10.000µs 📉 -62.3%) vs baseline: ~same

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.9%

✅ ospathsplitdrive_noaspect

Time: ✅ 0.710µs (SLO: <10.000µs 📉 -92.9%) vs baseline: -1.3%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.6%

✅ ospathsplitext_aspect

Time: ✅ 4.634µs (SLO: <10.000µs 📉 -53.7%) vs baseline: -0.3%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%

✅ ospathsplitext_noaspect

Time: ✅ 1.401µs (SLO: <10.000µs 📉 -86.0%) vs baseline: +0.4%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ iastaspectssplit - 12/12

✅ rsplit_aspect

Time: ✅ 1.404µs (SLO: <10.000µs 📉 -86.0%) vs baseline: -0.9%

Memory: ✅ 37.749MB (SLO: <39.000MB -3.2%) vs baseline: +5.0%

✅ rsplit_noaspect

Time: ✅ 0.577µs (SLO: <10.000µs 📉 -94.2%) vs baseline: +0.3%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.7%

✅ split_aspect

Time: ✅ 1.379µs (SLO: <10.000µs 📉 -86.2%) vs baseline: -0.1%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ split_noaspect

Time: ✅ 0.574µs (SLO: <10.000µs 📉 -94.3%) vs baseline: +0.2%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.8%

✅ splitlines_aspect

Time: ✅ 1.375µs (SLO: <10.000µs 📉 -86.2%) vs baseline: -1.6%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.8%

✅ splitlines_noaspect

Time: ✅ 0.588µs (SLO: <10.000µs 📉 -94.1%) vs baseline: +0.6%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%

✅ iastpropagation - 2/2

✅ no-propagation

Time: ✅ 48.988µs (SLO: <60.000µs 📉 -18.4%) vs baseline: -0.4%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.6%

✅ otelsdkspan - 24/24

✅ add-event

Time: ✅ 40.487ms (SLO: <42.000ms -3.6%) vs baseline: +0.2%

Memory: ✅ 34.603MB (SLO: <39.000MB 📉 -11.3%) vs baseline: +4.3%

✅ add-link

Time: ✅ 36.377ms (SLO: <38.550ms -5.6%) vs baseline: +0.8%

Memory: ✅ 34.564MB (SLO: <39.000MB 📉 -11.4%) vs baseline: +4.9%

✅ add-metrics

Time: ✅ 217.713ms (SLO: <232.000ms -6.2%) vs baseline: -1.8%

Memory: ✅ 34.603MB (SLO: <39.000MB 📉 -11.3%) vs baseline: +4.0%

✅ add-tags

Time: ✅ 210.340ms (SLO: <221.600ms -5.1%) vs baseline: -0.9%

Memory: ✅ 34.505MB (SLO: <39.000MB 📉 -11.5%) vs baseline: +3.7%

✅ get-context

Time: ✅ 29.033ms (SLO: <31.300ms -7.2%) vs baseline: ~same

Memory: ✅ 34.524MB (SLO: <39.000MB 📉 -11.5%) vs baseline: +3.7%

✅ is-recording

Time: ✅ 29.172ms (SLO: <31.000ms -5.9%) vs baseline: -0.6%

Memory: ✅ 34.505MB (SLO: <39.000MB 📉 -11.5%) vs baseline: +3.6%

✅ record-exception

Time: ✅ 64.003ms (SLO: <65.850ms -2.8%) vs baseline: +2.2%

Memory: ✅ 34.957MB (SLO: <39.000MB 📉 -10.4%) vs baseline: +5.0%

✅ set-status

Time: ✅ 31.887ms (SLO: <34.150ms -6.6%) vs baseline: ~same

Memory: ✅ 34.524MB (SLO: <39.000MB 📉 -11.5%) vs baseline: +3.9%

✅ start

Time: ✅ 28.661ms (SLO: <30.150ms -4.9%) vs baseline: -0.4%

Memory: ✅ 34.544MB (SLO: <39.000MB 📉 -11.4%) vs baseline: +4.9%

✅ start-finish

Time: ✅ 34.011ms (SLO: <35.350ms -3.8%) vs baseline: +0.1%

Memory: ✅ 34.524MB (SLO: <39.000MB 📉 -11.5%) vs baseline: +3.7%

✅ start-finish-telemetry

Time: ✅ 33.803ms (SLO: <35.450ms -4.6%) vs baseline: -0.4%

Memory: ✅ 34.603MB (SLO: <39.000MB 📉 -11.3%) vs baseline: +4.6%

✅ update-name

Time: ✅ 31.574ms (SLO: <33.400ms -5.5%) vs baseline: +1.7%

Memory: ✅ 34.524MB (SLO: <39.000MB 📉 -11.5%) vs baseline: +3.9%

✅ packagespackageforrootmodulemapping - 4/4

✅ cache_off

Time: ✅ 340.168ms (SLO: <354.300ms -4.0%) vs baseline: -0.3%

Memory: ✅ 38.045MB (SLO: <40.000MB -4.9%) vs baseline: +5.4%

✅ cache_on

Time: ✅ 0.386µs (SLO: <10.000µs 📉 -96.1%) vs baseline: ~same

Memory: ✅ 37.147MB (SLO: <39.000MB -4.8%) vs baseline: +4.9%

✅ packagesupdateimporteddependencies - 24/24

✅ import_many

Time: ✅ 154.922µs (SLO: <170.000µs -8.9%) vs baseline: ~same

Memory: ✅ 37.069MB (SLO: <38.500MB -3.7%) vs baseline: +4.4%

✅ import_many_cached

Time: ✅ 120.530µs (SLO: <130.000µs -7.3%) vs baseline: -0.2%

Memory: ✅ 37.437MB (SLO: <38.500MB -2.8%) vs baseline: +5.5%

✅ import_many_stdlib

Time: ✅ 1.627ms (SLO: <1.750ms -7.0%) vs baseline: -0.7%

Memory: ✅ 37.221MB (SLO: <38.500MB -3.3%) vs baseline: +4.6%

✅ import_many_stdlib_cached

Time: ✅ 0.983ms (SLO: <1.100ms 📉 -10.7%) vs baseline: +0.2%

Memory: ✅ 37.405MB (SLO: <38.500MB -2.8%) vs baseline: +5.2%

✅ import_many_unknown

Time: ✅ 827.193µs (SLO: <890.000µs -7.1%) vs baseline: -0.4%

Memory: ✅ 37.241MB (SLO: <38.500MB -3.3%) vs baseline: +5.3%

✅ import_many_unknown_cached

Time: ✅ 790.651µs (SLO: <870.000µs -9.1%) vs baseline: -1.9%

Memory: ✅ 37.314MB (SLO: <38.500MB -3.1%) vs baseline: +4.5%

✅ import_one

Time: ✅ 19.926µs (SLO: <30.000µs 📉 -33.6%) vs baseline: +1.0%

Memory: ✅ 37.129MB (SLO: <39.000MB -4.8%) vs baseline: +5.1%

✅ import_one_cache

Time: ✅ 6.292µs (SLO: <10.000µs 📉 -37.1%) vs baseline: +0.4%

Memory: ✅ 36.985MB (SLO: <38.500MB -3.9%) vs baseline: +4.3%

✅ import_one_stdlib

Time: ✅ 18.648µs (SLO: <20.000µs -6.8%) vs baseline: ~same

Memory: ✅ 37.012MB (SLO: <38.500MB -3.9%) vs baseline: +4.5%

✅ import_one_stdlib_cache

Time: ✅ 6.290µs (SLO: <10.000µs 📉 -37.1%) vs baseline: -0.3%

Memory: ✅ 37.268MB (SLO: <38.500MB -3.2%) vs baseline: +5.0%

✅ import_one_unknown

Time: ✅ 45.353µs (SLO: <50.000µs -9.3%) vs baseline: -0.3%

Memory: ✅ 37.193MB (SLO: <38.500MB -3.4%) vs baseline: +5.0%

✅ import_one_unknown_cache

Time: ✅ 6.271µs (SLO: <10.000µs 📉 -37.3%) vs baseline: -0.4%

Memory: ✅ 37.258MB (SLO: <38.500MB -3.2%) vs baseline: +5.1%

✅ ratelimiter - 12/12

✅ defaults

Time: ✅ 2.342µs (SLO: <10.000µs 📉 -76.6%) vs baseline: -1.3%

Memory: ✅ 31.693MB (SLO: <34.000MB -6.8%) vs baseline: +4.5%

✅ high_rate_limit

Time: ✅ 2.399µs (SLO: <10.000µs 📉 -76.0%) vs baseline: +0.3%

Memory: ✅ 31.792MB (SLO: <34.000MB -6.5%) vs baseline: +4.9%

✅ long_window

Time: ✅ 2.368µs (SLO: <10.000µs 📉 -76.3%) vs baseline: +0.4%

Memory: ✅ 31.811MB (SLO: <34.000MB -6.4%) vs baseline: +4.9%

✅ low_rate_limit

Time: ✅ 2.370µs (SLO: <10.000µs 📉 -76.3%) vs baseline: +0.5%

Memory: ✅ 31.752MB (SLO: <34.000MB -6.6%) vs baseline: +4.8%

✅ no_rate_limit

Time: ✅ 0.829µs (SLO: <10.000µs 📉 -91.7%) vs baseline: +0.8%

Memory: ✅ 31.792MB (SLO: <34.000MB -6.5%) vs baseline: +5.0%

✅ short_window

Time: ✅ 2.493µs (SLO: <10.000µs 📉 -75.1%) vs baseline: ~same

Memory: ✅ 31.772MB (SLO: <34.000MB -6.6%) vs baseline: +4.7%

✅ recursivecomputation - 8/8

✅ deep

Time: ✅ 308.857ms (SLO: <320.950ms -3.8%) vs baseline: -0.4%

Memory: ✅ 32.932MB (SLO: <34.500MB -4.5%) vs baseline: +4.9%

✅ deep-profiled

Time: ✅ 328.231ms (SLO: <359.150ms -8.6%) vs baseline: -0.1%

Memory: ✅ 37.198MB (SLO: <39.000MB -4.6%) vs baseline: +4.6%

✅ medium

Time: ✅ 7.048ms (SLO: <7.400ms -4.8%) vs baseline: -0.3%

Memory: ✅ 32.165MB (SLO: <34.000MB -5.4%) vs baseline: +5.1%

✅ shallow

Time: ✅ 0.951ms (SLO: <1.050ms -9.4%) vs baseline: -0.1%

Memory: ✅ 32.106MB (SLO: <34.000MB -5.6%) vs baseline: +4.9%

✅ samplingrules - 8/8

✅ average_match

Time: ✅ 137.498µs (SLO: <290.000µs 📉 -52.6%) vs baseline: +0.4%

Memory: ✅ 32.086MB (SLO: <34.000MB -5.6%) vs baseline: +4.5%

✅ high_match

Time: ✅ 173.396µs (SLO: <480.000µs 📉 -63.9%) vs baseline: -0.7%

Memory: ✅ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +5.0%

✅ low_match

Time: ✅ 98.589µs (SLO: <120.000µs 📉 -17.8%) vs baseline: -0.2%

Memory: ✅ 600.858MB (SLO: <700.000MB 📉 -14.2%) vs baseline: +4.9%

✅ very_low_match

Time: ✅ 2.669ms (SLO: <8.500ms 📉 -68.6%) vs baseline: ~same

Memory: ✅ 68.291MB (SLO: <75.000MB -8.9%) vs baseline: +4.9%

✅ sethttpmeta - 32/32

✅ all-disabled

Time: ✅ 10.838µs (SLO: <20.000µs 📉 -45.8%) vs baseline: +3.2%

Memory: ✅ 32.558MB (SLO: <34.000MB -4.2%) vs baseline: +5.0%

✅ all-enabled

Time: ✅ 40.811µs (SLO: <50.000µs 📉 -18.4%) vs baseline: +2.0%

Memory: ✅ 32.539MB (SLO: <34.000MB -4.3%) vs baseline: +4.6%

✅ collectipvariant_exists

Time: ✅ 40.723µs (SLO: <50.000µs 📉 -18.6%) vs baseline: +0.1%

Memory: ✅ 32.578MB (SLO: <34.000MB -4.2%) vs baseline: +4.9%

✅ no-collectipvariant

Time: ✅ 39.806µs (SLO: <50.000µs 📉 -20.4%) vs baseline: -0.8%

Memory: ✅ 32.539MB (SLO: <34.000MB -4.3%) vs baseline: +4.6%

✅ no-useragentvariant

Time: ✅ 38.561µs (SLO: <50.000µs 📉 -22.9%) vs baseline: -0.7%

Memory: ✅ 32.558MB (SLO: <34.000MB -4.2%) vs baseline: +4.9%

✅ obfuscation-no-query

Time: ✅ 40.527µs (SLO: <50.000µs 📉 -18.9%) vs baseline: ~same

Memory: ✅ 32.539MB (SLO: <34.000MB -4.3%) vs baseline: +4.8%

✅ obfuscation-regular-case-explicit-query

Time: ✅ 75.532µs (SLO: <90.000µs 📉 -16.1%) vs baseline: ~same

Memory: ✅ 32.952MB (SLO: <34.000MB -3.1%) vs baseline: +4.9%

✅ obfuscation-regular-case-implicit-query

Time: ✅ 77.254µs (SLO: <90.000µs 📉 -14.2%) vs baseline: +1.2%

Memory: ✅ 32.932MB (SLO: <34.000MB -3.1%) vs baseline: +4.8%

✅ obfuscation-send-querystring-disabled

Time: ✅ 155.638µs (SLO: <170.000µs -8.4%) vs baseline: +1.1%

Memory: ✅ 32.991MB (SLO: <34.500MB -4.4%) vs baseline: +5.0%

✅ obfuscation-worst-case-explicit-query

Time: ✅ 148.753µs (SLO: <160.000µs -7.0%) vs baseline: +0.4%

Memory: ✅ 33.010MB (SLO: <34.500MB -4.3%) vs baseline: +5.0%

✅ obfuscation-worst-case-implicit-query

Time: ✅ 155.225µs (SLO: <170.000µs -8.7%) vs baseline: +0.4%

Memory: ✅ 32.952MB (SLO: <34.500MB -4.5%) vs baseline: +4.7%

✅ useragentvariant_exists_1

Time: ✅ 39.326µs (SLO: <50.000µs 📉 -21.3%) vs baseline: ~same

Memory: ✅ 32.558MB (SLO: <34.000MB -4.2%) vs baseline: +4.9%

✅ useragentvariant_exists_2

Time: ✅ 40.541µs (SLO: <50.000µs 📉 -18.9%) vs baseline: -0.3%

Memory: ✅ 32.558MB (SLO: <34.000MB -4.2%) vs baseline: +4.9%

✅ useragentvariant_exists_3

Time: ✅ 39.987µs (SLO: <50.000µs 📉 -20.0%) vs baseline: -0.4%

Memory: ✅ 32.598MB (SLO: <34.000MB -4.1%) vs baseline: +4.8%

✅ useragentvariant_not_exists_1

Time: ✅ 39.432µs (SLO: <50.000µs 📉 -21.1%) vs baseline: +0.5%

Memory: ✅ 32.598MB (SLO: <34.000MB -4.1%) vs baseline: +4.8%

✅ useragentvariant_not_exists_2

Time: ✅ 39.587µs (SLO: <50.000µs 📉 -20.8%) vs baseline: +0.3%

Memory: ✅ 32.558MB (SLO: <34.000MB -4.2%) vs baseline: +4.9%

✅ tracer - 6/6

✅ large

Time: ✅ 30.081ms (SLO: <32.950ms -8.7%) vs baseline: +0.3%

Memory: ✅ 32.971MB (SLO: <34.500MB -4.4%) vs baseline: +5.1%

✅ medium

Time: ✅ 2.965ms (SLO: <3.200ms -7.3%) vs baseline: ~same

Memory: ✅ 32.126MB (SLO: <34.000MB -5.5%) vs baseline: +4.9%

✅ small

Time: ✅ 336.246µs (SLO: <370.000µs -9.1%) vs baseline: +1.5%

Memory: ✅ 32.067MB (SLO: <34.000MB -5.7%) vs baseline: +4.9%

ℹ️ Scenarios Missing SLO Configuration (9 scenarios)

The following scenarios exist in candidate data but have no SLO thresholds configured:

coreapiscenario-core_dispatch_listeners
coreapiscenario-core_dispatch_no_listeners
coreapiscenario-core_dispatch_with_results_listeners
coreapiscenario-core_dispatch_with_results_no_listeners
djangosimple-baseline
errortrackingdjangosimple-baseline
errortrackingflasksqli-baseline
flasksimple-baseline
flasksqli-baseline

gary-huang added 2 commits October 17, 2025 15:07

allow versioned dataset pull

f44c697

add current version and version as properties

6cf1a5a

gary-huang force-pushed the gary/mlob-3837 branch from ee5feda to 6cf1a5a Compare October 17, 2025 20:45

wip allow versioned dataset pull #14921

Are you sure you want to change the base?

wip allow versioned dataset pull #14921

Conversation

gary-huang commented Oct 16, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description

Testing

Risks

Additional Notes

Uh oh!

github-actions bot commented Oct 16, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Oct 16, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Bootstrap import analysis

Summary

Import time breakdown

Uh oh!

pr-commenter bot commented Oct 16, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Performance SLOs

✅ appsec

✅ exception-replay-enabled

✅ iast

✅ profiler

✅ resource-renaming

✅ span-code-origin

✅ tracer

✅ tracer-and-profiler

✅ tracer-dont-create-db-spans

✅ tracer-minimal

✅ tracer-native

✅ tracer-no-caches

✅ tracer-no-databases

✅ tracer-no-middleware

✅ tracer-no-templates

✅ errortracking-enabled-all

✅ errortracking-enabled-user

✅ tracer-enabled

✅ appsec-get

✅ appsec-post

✅ appsec-telemetry

✅ debugger

✅ iast-get

✅ profiler

✅ resource-renaming

✅ tracer

✅ tracer-native

✅ add-event

✅ add-metrics

✅ add-tags

✅ get-context

✅ is-recording

✅ record-exception

✅ set-status

✅ start

✅ start-finish

✅ start-finish-telemetry

✅ update-name

✅ add-event

✅ add-metrics

✅ add-tags

✅ get-context

✅ is-recording

✅ record-exception

✅ set-status

✅ start

✅ start-finish

✅ start-finish-telemetry

✅ start-finish-traceid128

✅ start-traceid128

✅ update-name

✅ 1-count-metric-1-times

✅ 1-count-metrics-100-times

✅ 1-distribution-metric-1-times

✅ 1-distribution-metrics-100-times

✅ 1-gauge-metric-1-times

✅ 1-gauge-metrics-100-times

gary-huang commented Oct 16, 2025 •

edited

Loading

github-actions bot commented Oct 16, 2025 •

edited

Loading

github-actions bot commented Oct 16, 2025 •

edited

Loading

pr-commenter bot commented Oct 16, 2025 •

edited

Loading