feat(python): add core 3.14/3.15 gate scenarios (PROF-15511) - #166
Draft
vlad-scherbich wants to merge 6 commits into
Draft
feat(python): add core 3.14/3.15 gate scenarios (PROF-15511)#166vlad-scherbich wants to merge 6 commits into
vlad-scherbich wants to merge 6 commits into
Conversation
This was referenced Jul 26, 2026
vlad-scherbich
force-pushed
the
vlad/gate-scenarios-core
branch
2 times, most recently
from
July 27, 2026 19:33
a6f7352 to
000f4a9
Compare
vlad-scherbich
force-pushed
the
vlad/gate-scenarios-core
branch
from
July 27, 2026 19:37
000f4a9 to
60ea668
Compare
vlad-scherbich
force-pushed
the
vlad/gate-scenarios-core
branch
from
July 27, 2026 21:40
60ea668 to
62e3011
Compare
vlad-scherbich
force-pushed
the
vlad/gate-scenarios-core
branch
from
July 27, 2026 21:45
62e3011 to
f57b68e
Compare
vlad-scherbich
force-pushed
the
vlad/gate-scenarios-core
branch
from
July 27, 2026 22:01
f57b68e to
8005774
Compare
vlad-scherbich
force-pushed
the
vlad/gate-scenarios-core
branch
from
July 27, 2026 22:05
8005774 to
55c69de
Compare
vlad-scherbich
changed the title
vlad-scherbich
force-pushed
the
vlad/gate-scenarios-core
branch
2 times, most recently
from
July 28, 2026 02:38
b792769 to
318b89a
Compare
vlad-scherbich
added a commit
that referenced
this pull request
Aug 16, 2026
Demo-only: lock profile expectation is deliberately wrong (99% ±0). Fix expected_profile.json or revert to demo PASS for green CI.
vlad-scherbich
force-pushed
the
vlad/gate-scenarios-core
branch
from
August 16, 2026 13:42
318b89a to
be9aad4
Compare
vlad-scherbich
added a commit
that referenced
this pull request
Aug 16, 2026
Demo-only: lock profile expectation is deliberately wrong (99% ±0). Fix expected_profile.json or revert to demo PASS for green CI.
vlad-scherbich
force-pushed
the
vlad/gate-scenarios-core
branch
from
August 16, 2026 20:14
be9aad4 to
dc91d73
Compare
- ddprof_live_heap: widen alloc-space margin to 15% (CI often ~94% vs 100% due to C++ runtime overhead; see scenario README) - ddprof_julia: pin julia:1.11.5-bookworm instead of :latest, and allow the first CPU profile cycle to fail when JIT symbols are not yet exported
…am gate Add RE2-safe list-scenarios -exclude and ci.yml test_scenarios_exclude so wheel-only Python scenarios are not silently skipped. Ship Python 3.14/3.15 base images, dd-trace-py STS trigger policy, and migration gate index README. Scenario workloads land in follow-up PRs.
…am gate Add RE2-safe list-scenarios -exclude and ci.yml test_scenarios_exclude so wheel-only Python scenarios are not silently skipped. Ship Python 3.14/3.15 base images, dd-trace-py STS trigger policy, and a minimal migration gate index README; scenario workloads land in follow-up PRs.
Absolute alloc_objects counts for the a();slice stack are unstable on CI runners (16484 vs expected 100). Keep inuse_* and alloc_space ratio checks.
…ync_gen) Add six paired scenarios for the migration gate with lock-release and lock name labels plus exception type labels. Stacks on gate-infra (PR-0).
Demo-only: lock profile expectation is deliberately wrong (99% ±0). Fix expected_profile.json or revert to demo PASS for green CI.
vlad-scherbich
force-pushed
the
vlad/gate-scenarios-core
branch
from
August 16, 2026 20:21
dc91d73 to
31bf0f0
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Prev: #165 | Next: #169
Motivation
First scenario batch for the 3.14/3.15 migration gate: lock, exception, and async-generator profiler families.
Summary
Adds 6 scenario directories (3 families × 2 versions). All 3.15 dirs are wheel-only (excluded from prof-correctness
mainCI).python_lock_3.14python_lock_3.15python_exceptions_3.14python_exceptions_3.15python_async_gen_3.14python_async_gen_3.15Demo FAIL / PASS
Intentional FAIL (current):
python / scenariosshard runningpython_lock_3.14— profile expectation set to 99% ±0 (will not match).python / scenarios *python_lock_3.14profile mismatchTo demo PASS: revert top commit or restore
scenarios/python_lock_3.14/expected_profile.jsonfirstpercent/error_marginto50/100.Test plan
go test -run TestSchemaValidationruff checkon scenario sourcespython / scenariosfails on lock (demo)DDTRACE_INSTALL_URL