Skip to content

feat(python): add mem_domain 3.14/3.15 gate scenarios (PROF-15511) - #167

Draft
vlad-scherbich wants to merge 6 commits into
vlad/gate-infrafrom
vlad/gate-scenarios-mem-domain
Draft

feat(python): add mem_domain 3.14/3.15 gate scenarios (PROF-15511)#167
vlad-scherbich wants to merge 6 commits into
vlad/gate-infrafrom
vlad/gate-scenarios-mem-domain

Conversation

@vlad-scherbich

@vlad-scherbich vlad-scherbich commented Jul 26, 2026

Copy link
Copy Markdown
Contributor

Prev: #165 | Parallel: #166, #168

Motivation

Memory-domain profiling (DD_PROFILING_MEMORY_MEM_DOMAIN_ENABLED) needs paired 3.14/3.15 gate scenarios. Not in the default 22-scenario downstream regexp (feature-flagged).

Summary

Adds python_mem_domain_3.14 / python_mem_domain_3.15 with heap-space expectations and allow_first_profile_failure.

Demo FAIL / PASS

Intentional FAIL (current): python_mem_domain_3.14 heap-space expectation 99% ±0.

Check Expected failure
python / scenarios * python_mem_domain_3.14 profile mismatch

To demo PASS: revert top commit or restore first stack percent/error_margin to 50 / 50 in expected_profile.json.

Test plan

  • go test -run TestSchemaValidation
  • ruff check
  • python / scenarios fails on mem_domain (demo)
  • Downstream with TEST_SCENARIOS=python_mem_domain_3\.15 + DDTRACE_INSTALL_URL

@vlad-scherbich
vlad-scherbich force-pushed the vlad/gate-scenarios-mem-domain branch 2 times, most recently from 7936bf9 to 04ac80f Compare July 27, 2026 19:33
@vlad-scherbich
vlad-scherbich force-pushed the vlad/gate-scenarios-mem-domain branch from 04ac80f to 54ba6de Compare July 27, 2026 19:38
@vlad-scherbich
vlad-scherbich force-pushed the vlad/gate-scenarios-mem-domain branch from 54ba6de to 3ca0ab2 Compare July 27, 2026 21:40
@vlad-scherbich
vlad-scherbich force-pushed the vlad/gate-scenarios-mem-domain branch from 3ca0ab2 to ad2f88c Compare July 27, 2026 21:45
@vlad-scherbich
vlad-scherbich force-pushed the vlad/gate-scenarios-mem-domain branch from ad2f88c to ed55d6d Compare July 27, 2026 22:01
@vlad-scherbich
vlad-scherbich force-pushed the vlad/gate-scenarios-mem-domain branch from ed55d6d to 1609440 Compare July 27, 2026 22:05
@vlad-scherbich vlad-scherbich changed the title feat(python): add mem_domain 3.14/3.15 gate scenarios feat(python): add mem_domain 3.14/3.15 gate scenarios (PROF-15511) Jul 27, 2026
@vlad-scherbich
vlad-scherbich force-pushed the vlad/gate-scenarios-mem-domain branch from 1609440 to 42dbb08 Compare July 27, 2026 22:29
vlad-scherbich added a commit that referenced this pull request Aug 16, 2026
Demo-only: mem_domain heap-space expectation deliberately wrong (99% ±0).
Fix expected_profile.json to demo PASS.
@vlad-scherbich
vlad-scherbich force-pushed the vlad/gate-scenarios-mem-domain branch from 42dbb08 to e986834 Compare August 16, 2026 13:42
vlad-scherbich added a commit that referenced this pull request Aug 16, 2026
Demo-only: mem_domain heap-space expectation deliberately wrong (99% ±0).
Fix expected_profile.json to demo PASS.
@vlad-scherbich
vlad-scherbich force-pushed the vlad/gate-scenarios-mem-domain branch from e986834 to 90b32f6 Compare August 16, 2026 20:14
- ddprof_live_heap: widen alloc-space margin to 15% (CI often ~94% vs 100%
  due to C++ runtime overhead; see scenario README)
- ddprof_julia: pin julia:1.11.5-bookworm instead of :latest, and allow the
  first CPU profile cycle to fail when JIT symbols are not yet exported
…am gate

Add RE2-safe list-scenarios -exclude and ci.yml test_scenarios_exclude so
wheel-only Python scenarios are not silently skipped. Ship Python 3.14/3.15
base images, dd-trace-py STS trigger policy, and migration gate index README.
Scenario workloads land in follow-up PRs.
…am gate

Add RE2-safe list-scenarios -exclude and ci.yml test_scenarios_exclude so
wheel-only Python scenarios are not silently skipped. Ship Python 3.14/3.15
base images, dd-trace-py STS trigger policy, and a minimal migration gate
index README; scenario workloads land in follow-up PRs.
Absolute alloc_objects counts for the a();slice stack are unstable on CI
runners (16484 vs expected 100). Keep inuse_* and alloc_space ratio checks.
MEM-domain heap-space feature coverage (off by default). Stacks on
gate-infra (PR-0), parallel to core gate scenarios (PR-0a).
Demo-only: mem_domain heap-space expectation deliberately wrong (99% ±0).
Fix expected_profile.json to demo PASS.
@vlad-scherbich
vlad-scherbich force-pushed the vlad/gate-scenarios-mem-domain branch from 90b32f6 to 2c5d1fe Compare August 16, 2026 20:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant