Skip to content

Add integration test for case apms19196#8438

Merged
anna-git merged 2 commits intosteven/attempt-fix-invalid-program-exceptionfrom
anna/add-integration-apms19196
Apr 10, 2026
Merged

Add integration test for case apms19196#8438
anna-git merged 2 commits intosteven/attempt-fix-invalid-program-exceptionfrom
anna/add-integration-apms19196

Conversation

@anna-git
Copy link
Copy Markdown
Contributor

@anna-git anna-git commented Apr 10, 2026

Summary of changes

This reproduces the crash described in this README on linux x64 arch.

Aim is to merge to #8428
First tested it's crashing on master
image

Reason for change

Implementation details

Test coverage

Other details

@anna-git anna-git force-pushed the anna/add-integration-apms19196 branch from 4edd0a3 to f3d6437 Compare April 10, 2026 10:38
@github-actions github-actions bot added the area:tests unit tests, integration tests label Apr 10, 2026
@anna-git anna-git force-pushed the anna/add-integration-apms19196 branch from f3d6437 to 86b18c5 Compare April 10, 2026 11:06
@github-actions
Copy link
Copy Markdown
Contributor

Snapshots difference summary

The following differences have been observed in committed snapshots. It is meant to help the reviewer.
The diff is simplistic, so please check some files anyway while we improve it.

3 occurrences of :

+  },
+  {
+    TraceId: Id_1,
+    SpanId: Id_62,
+    Name: trace.annotation,
+    Resource: ExtremeExceptionHandling.DeepNestedExceptionHandlingSync,
+    Service: Samples.TraceAnnotations,
+    ParentId: Id_2,
+    Tags: {
+      component: trace,
+      env: integration_tests,
+      language: dotnet,
+      version: 1.0.0
+    }

3 occurrences of :

+  },
+  {
+    TraceId: Id_1,
+    SpanId: Id_62,
+    Name: trace.annotation,
+    Resource: ExtremeExceptionHandling.DeepNestedExceptionHandlingSync,
+    Service: Samples.TraceAnnotations.VersionMismatch.AfterFeature,
+    ParentId: Id_2,
+    Tags: {
+      component: trace,
+      env: integration_tests,
+      language: dotnet,
+      version: 1.0.0
+    }

3 occurrences of :

+  },
+  {
+    TraceId: Id_1,
+    SpanId: Id_62,
+    Name: trace.annotation,
+    Resource: ExtremeExceptionHandling.DeepNestedExceptionHandlingSync,
+    Service: Samples.TraceAnnotations.VersionMismatch.BeforeFeature,
+    ParentId: Id_2,
+    Tags: {
+      component: trace,
+      env: integration_tests,
+      language: dotnet,
+      version: 1.0.0
+    }

@anna-git anna-git changed the title Add integration tests for Anna/add integration apms19196 Add integration test for case apms19196 Apr 10, 2026
@dd-trace-dotnet-ci-bot
Copy link
Copy Markdown

Execution-Time Benchmarks Report ⏱️

Execution-time results for samples comparing This PR (8438) and master.

✅ No regressions detected - check the details below

Full Metrics Comparison

FakeDbCommand

Metric Master (Mean ± 95% CI) Current (Mean ± 95% CI) Change Status
.NET Framework 4.8 - Baseline
duration71.64 ± (71.70 - 72.11) ms71.89 ± (71.73 - 72.08) ms+0.3%✅⬆️
.NET Framework 4.8 - Bailout
duration76.12 ± (75.87 - 76.26) ms76.22 ± (76.28 - 76.71) ms+0.1%✅⬆️
.NET Framework 4.8 - CallTarget+Inlining+NGEN
duration1062.39 ± (1066.52 - 1074.97) ms1066.52 ± (1066.10 - 1072.60) ms+0.4%✅⬆️
.NET Core 3.1 - Baseline
process.internal_duration_ms22.12 ± (22.08 - 22.16) ms22.15 ± (22.11 - 22.18) ms+0.1%✅⬆️
process.time_to_main_ms83.51 ± (83.32 - 83.69) ms82.97 ± (82.79 - 83.14) ms-0.6%
runtime.dotnet.exceptions.count0 ± (0 - 0)0 ± (0 - 0)+0.0%
runtime.dotnet.mem.committed10.90 ± (10.90 - 10.91) MB10.92 ± (10.92 - 10.92) MB+0.2%✅⬆️
runtime.dotnet.threads.count12 ± (12 - 12)12 ± (12 - 12)+0.0%
.NET Core 3.1 - Bailout
process.internal_duration_ms22.24 ± (22.20 - 22.28) ms22.19 ± (22.16 - 22.22) ms-0.2%
process.time_to_main_ms85.17 ± (84.98 - 85.36) ms84.45 ± (84.26 - 84.65) ms-0.8%
runtime.dotnet.exceptions.count0 ± (0 - 0)0 ± (0 - 0)+0.0%
runtime.dotnet.mem.committed10.94 ± (10.93 - 10.94) MB10.94 ± (10.94 - 10.95) MB+0.0%✅⬆️
runtime.dotnet.threads.count13 ± (13 - 13)13 ± (13 - 13)+0.0%
.NET Core 3.1 - CallTarget+Inlining+NGEN
process.internal_duration_ms225.10 ± (223.79 - 226.40) ms225.07 ± (223.93 - 226.21) ms-0.0%
process.time_to_main_ms513.91 ± (512.81 - 515.01) ms518.60 ± (517.55 - 519.65) ms+0.9%✅⬆️
runtime.dotnet.exceptions.count0 ± (0 - 0)0 ± (0 - 0)+0.0%
runtime.dotnet.mem.committed48.40 ± (48.36 - 48.44) MB48.30 ± (48.27 - 48.33) MB-0.2%
runtime.dotnet.threads.count28 ± (28 - 28)28 ± (28 - 28)-0.3%
.NET 6 - Baseline
process.internal_duration_ms20.94 ± (20.91 - 20.98) ms20.91 ± (20.87 - 20.95) ms-0.2%
process.time_to_main_ms72.16 ± (72.00 - 72.33) ms71.71 ± (71.55 - 71.86) ms-0.6%
runtime.dotnet.exceptions.count0 ± (0 - 0)0 ± (0 - 0)+0.0%
runtime.dotnet.mem.committed10.60 ± (10.60 - 10.61) MB10.62 ± (10.62 - 10.63) MB+0.2%✅⬆️
runtime.dotnet.threads.count10 ± (10 - 10)10 ± (10 - 10)+0.0%
.NET 6 - Bailout
process.internal_duration_ms20.70 ± (20.66 - 20.74) ms20.92 ± (20.89 - 20.94) ms+1.1%✅⬆️
process.time_to_main_ms72.11 ± (71.98 - 72.24) ms73.36 ± (73.19 - 73.53) ms+1.7%✅⬆️
runtime.dotnet.exceptions.count0 ± (0 - 0)0 ± (0 - 0)+0.0%
runtime.dotnet.mem.committed10.65 ± (10.65 - 10.66) MB10.74 ± (10.73 - 10.74) MB+0.8%✅⬆️
runtime.dotnet.threads.count11 ± (11 - 11)11 ± (11 - 11)+0.0%
.NET 6 - CallTarget+Inlining+NGEN
process.internal_duration_ms384.56 ± (382.46 - 386.65) ms385.58 ± (383.42 - 387.75) ms+0.3%✅⬆️
process.time_to_main_ms515.16 ± (514.33 - 515.99) ms515.96 ± (515.06 - 516.86) ms+0.2%✅⬆️
runtime.dotnet.exceptions.count0 ± (0 - 0)0 ± (0 - 0)+0.0%
runtime.dotnet.mem.committed49.93 ± (49.90 - 49.96) MB50.00 ± (49.97 - 50.03) MB+0.1%✅⬆️
runtime.dotnet.threads.count28 ± (28 - 28)28 ± (28 - 28)+0.1%✅⬆️
.NET 8 - Baseline
process.internal_duration_ms19.00 ± (18.97 - 19.03) ms19.16 ± (19.13 - 19.20) ms+0.9%✅⬆️
process.time_to_main_ms70.73 ± (70.58 - 70.88) ms71.51 ± (71.33 - 71.68) ms+1.1%✅⬆️
runtime.dotnet.exceptions.count0 ± (0 - 0)0 ± (0 - 0)+0.0%
runtime.dotnet.mem.committed7.68 ± (7.67 - 7.69) MB7.67 ± (7.67 - 7.68) MB-0.1%
runtime.dotnet.threads.count10 ± (10 - 10)10 ± (10 - 10)+0.0%
.NET 8 - Bailout
process.internal_duration_ms19.06 ± (19.03 - 19.09) ms19.17 ± (19.13 - 19.21) ms+0.6%✅⬆️
process.time_to_main_ms72.07 ± (71.93 - 72.20) ms72.29 ± (72.13 - 72.45) ms+0.3%✅⬆️
runtime.dotnet.exceptions.count0 ± (0 - 0)0 ± (0 - 0)+0.0%
runtime.dotnet.mem.committed7.75 ± (7.74 - 7.76) MB7.71 ± (7.70 - 7.72) MB-0.5%
runtime.dotnet.threads.count11 ± (11 - 11)11 ± (11 - 11)+0.0%
.NET 8 - CallTarget+Inlining+NGEN
process.internal_duration_ms304.26 ± (302.29 - 306.23) ms308.44 ± (306.36 - 310.52) ms+1.4%✅⬆️
process.time_to_main_ms477.13 ± (476.39 - 477.87) ms477.91 ± (477.18 - 478.64) ms+0.2%✅⬆️
runtime.dotnet.exceptions.count0 ± (0 - 0)0 ± (0 - 0)+0.0%
runtime.dotnet.mem.committed36.99 ± (36.97 - 37.01) MB37.00 ± (36.97 - 37.02) MB+0.0%✅⬆️
runtime.dotnet.threads.count27 ± (27 - 27)27 ± (27 - 27)-0.4%

HttpMessageHandler

Metric Master (Mean ± 95% CI) Current (Mean ± 95% CI) Change Status
.NET Framework 4.8 - Baseline
duration193.70 ± (193.65 - 194.31) ms192.89 ± (192.70 - 193.66) ms-0.4%
.NET Framework 4.8 - Bailout
duration197.67 ± (197.53 - 198.05) ms195.91 ± (195.79 - 196.32) ms-0.9%
.NET Framework 4.8 - CallTarget+Inlining+NGEN
duration1148.69 ± (1150.80 - 1159.08) ms1145.44 ± (1144.75 - 1150.72) ms-0.3%
.NET Core 3.1 - Baseline
process.internal_duration_ms189.02 ± (188.75 - 189.30) ms187.24 ± (186.90 - 187.57) ms-0.9%
process.time_to_main_ms81.17 ± (80.97 - 81.37) ms80.76 ± (80.55 - 80.97) ms-0.5%
runtime.dotnet.exceptions.count3 ± (3 - 3)3 ± (3 - 3)+0.0%
runtime.dotnet.mem.committed16.12 ± (16.10 - 16.15) MB16.13 ± (16.10 - 16.16) MB+0.0%✅⬆️
runtime.dotnet.threads.count20 ± (20 - 20)20 ± (19 - 20)-0.4%
.NET Core 3.1 - Bailout
process.internal_duration_ms188.34 ± (188.07 - 188.61) ms186.81 ± (186.51 - 187.11) ms-0.8%
process.time_to_main_ms82.68 ± (82.58 - 82.79) ms82.00 ± (81.87 - 82.13) ms-0.8%
runtime.dotnet.exceptions.count3 ± (3 - 3)3 ± (3 - 3)+0.0%
runtime.dotnet.mem.committed16.10 ± (16.07 - 16.13) MB16.20 ± (16.17 - 16.22) MB+0.6%✅⬆️
runtime.dotnet.threads.count21 ± (20 - 21)21 ± (21 - 21)+0.5%✅⬆️
.NET Core 3.1 - CallTarget+Inlining+NGEN
process.internal_duration_ms393.64 ± (392.04 - 395.24) ms391.35 ± (390.18 - 392.52) ms-0.6%
process.time_to_main_ms505.54 ± (504.22 - 506.86) ms507.65 ± (506.30 - 509.00) ms+0.4%✅⬆️
runtime.dotnet.exceptions.count3 ± (3 - 3)3 ± (3 - 3)+0.0%
runtime.dotnet.mem.committed58.49 ± (58.27 - 58.70) MB58.76 ± (58.56 - 58.96) MB+0.5%✅⬆️
runtime.dotnet.threads.count29 ± (29 - 30)30 ± (30 - 30)+0.5%✅⬆️
.NET 6 - Baseline
process.internal_duration_ms192.32 ± (192.06 - 192.59) ms191.82 ± (191.48 - 192.17) ms-0.3%
process.time_to_main_ms70.27 ± (70.14 - 70.41) ms70.34 ± (70.17 - 70.51) ms+0.1%✅⬆️
runtime.dotnet.exceptions.count4 ± (4 - 4)4 ± (4 - 4)+0.0%
runtime.dotnet.mem.committed16.12 ± (15.99 - 16.25) MB15.94 ± (15.78 - 16.10) MB-1.1%
runtime.dotnet.threads.count18 ± (18 - 18)18 ± (18 - 18)-0.7%
.NET 6 - Bailout
process.internal_duration_ms191.54 ± (191.28 - 191.81) ms191.28 ± (190.98 - 191.59) ms-0.1%
process.time_to_main_ms71.18 ± (71.11 - 71.25) ms71.18 ± (71.11 - 71.26) ms+0.0%✅⬆️
runtime.dotnet.exceptions.count4 ± (4 - 4)4 ± (4 - 4)+0.0%
runtime.dotnet.mem.committed16.19 ± (16.05 - 16.32) MB16.26 ± (16.15 - 16.37) MB+0.4%✅⬆️
runtime.dotnet.threads.count19 ± (19 - 20)20 ± (20 - 20)+2.3%✅⬆️
.NET 6 - CallTarget+Inlining+NGEN
process.internal_duration_ms602.58 ± (599.75 - 605.41) ms601.97 ± (598.83 - 605.11) ms-0.1%
process.time_to_main_ms510.28 ± (509.52 - 511.03) ms511.50 ± (510.52 - 512.47) ms+0.2%✅⬆️
runtime.dotnet.exceptions.count4 ± (4 - 4)4 ± (4 - 4)+0.0%
runtime.dotnet.mem.committed61.49 ± (61.40 - 61.58) MB61.71 ± (61.62 - 61.80) MB+0.4%✅⬆️
runtime.dotnet.threads.count30 ± (30 - 30)30 ± (30 - 30)+0.3%✅⬆️
.NET 8 - Baseline
process.internal_duration_ms189.90 ± (189.65 - 190.15) ms189.30 ± (189.03 - 189.58) ms-0.3%
process.time_to_main_ms69.86 ± (69.72 - 70.00) ms69.65 ± (69.52 - 69.78) ms-0.3%
runtime.dotnet.exceptions.count4 ± (4 - 4)4 ± (4 - 4)+0.0%
runtime.dotnet.mem.committed11.78 ± (11.76 - 11.81) MB11.82 ± (11.80 - 11.84) MB+0.3%✅⬆️
runtime.dotnet.threads.count18 ± (18 - 18)18 ± (18 - 18)-0.4%
.NET 8 - Bailout
process.internal_duration_ms188.98 ± (188.73 - 189.24) ms188.10 ± (187.88 - 188.32) ms-0.5%
process.time_to_main_ms70.82 ± (70.74 - 70.89) ms70.60 ± (70.53 - 70.67) ms-0.3%
runtime.dotnet.exceptions.count4 ± (4 - 4)4 ± (4 - 4)+0.0%
runtime.dotnet.mem.committed11.75 ± (11.66 - 11.83) MB11.88 ± (11.85 - 11.91) MB+1.1%✅⬆️
runtime.dotnet.threads.count19 ± (18 - 19)19 ± (19 - 19)+2.5%✅⬆️
.NET 8 - CallTarget+Inlining+NGEN
process.internal_duration_ms520.74 ± (518.26 - 523.23) ms518.82 ± (516.06 - 521.58) ms-0.4%
process.time_to_main_ms470.49 ± (469.75 - 471.22) ms470.13 ± (469.39 - 470.88) ms-0.1%
runtime.dotnet.exceptions.count4 ± (4 - 4)4 ± (4 - 4)+0.0%
runtime.dotnet.mem.committed50.73 ± (50.70 - 50.76) MB50.76 ± (50.73 - 50.79) MB+0.1%✅⬆️
runtime.dotnet.threads.count30 ± (30 - 30)30 ± (30 - 30)-0.1%
Comparison explanation

Execution-time benchmarks measure the whole time it takes to execute a program, and are intended to measure the one-off costs. Cases where the execution time results for the PR are worse than latest master results are highlighted in **red**. The following thresholds were used for comparing the execution times:

  • Welch test with statistical test for significance of 5%
  • Only results indicating a difference greater than 5% and 5 ms are considered.

Note that these results are based on a single point-in-time result for each branch. For full results, see the dashboard.

Graphs show the p99 interval based on the mean and StdDev of the test run, as well as the mean value of the run (shown as a diamond below the graph).

Duration charts
FakeDbCommand (.NET Framework 4.8)
gantt
    title Execution time (ms) FakeDbCommand (.NET Framework 4.8)
    dateFormat  x
    axisFormat %Q
    todayMarker off
    section Baseline
    This PR (8438) - mean (72ms)  : 69, 75
    master - mean (72ms)  : 69, 75

    section Bailout
    This PR (8438) - mean (76ms)  : 74, 79
    master - mean (76ms)  : 74, 78

    section CallTarget+Inlining+NGEN
    This PR (8438) - mean (1,069ms)  : 1023, 1115
    master - mean (1,071ms)  : 1008, 1134

Loading
FakeDbCommand (.NET Core 3.1)
gantt
    title Execution time (ms) FakeDbCommand (.NET Core 3.1)
    dateFormat  x
    axisFormat %Q
    todayMarker off
    section Baseline
    This PR (8438) - mean (112ms)  : 108, 116
    master - mean (112ms)  : 109, 115

    section Bailout
    This PR (8438) - mean (113ms)  : 111, 116
    master - mean (114ms)  : 112, 117

    section CallTarget+Inlining+NGEN
    This PR (8438) - mean (782ms)  : 756, 808
    master - mean (776ms)  : 756, 796

Loading
FakeDbCommand (.NET 6)
gantt
    title Execution time (ms) FakeDbCommand (.NET 6)
    dateFormat  x
    axisFormat %Q
    todayMarker off
    section Baseline
    This PR (8438) - mean (99ms)  : 96, 101
    master - mean (99ms)  : 95, 103

    section Bailout
    This PR (8438) - mean (100ms)  : 98, 103
    master - mean (99ms)  : 96, 101

    section CallTarget+Inlining+NGEN
    This PR (8438) - mean (930ms)  : 898, 963
    master - mean (927ms)  : 893, 961

Loading
FakeDbCommand (.NET 8)
gantt
    title Execution time (ms) FakeDbCommand (.NET 8)
    dateFormat  x
    axisFormat %Q
    todayMarker off
    section Baseline
    This PR (8438) - mean (98ms)  : 95, 101
    master - mean (97ms)  : 94, 100

    section Bailout
    This PR (8438) - mean (99ms)  : 96, 102
    master - mean (99ms)  : 96, 101

    section CallTarget+Inlining+NGEN
    This PR (8438) - mean (816ms)  : 782, 850
    master - mean (811ms)  : 783, 840

Loading
HttpMessageHandler (.NET Framework 4.8)
gantt
    title Execution time (ms) HttpMessageHandler (.NET Framework 4.8)
    dateFormat  x
    axisFormat %Q
    todayMarker off
    section Baseline
    This PR (8438) - mean (193ms)  : 188, 198
    master - mean (194ms)  : 191, 197

    section Bailout
    This PR (8438) - mean (196ms)  : 194, 199
    master - mean (198ms)  : 195, 200

    section CallTarget+Inlining+NGEN
    This PR (8438) - mean (1,148ms)  : 1105, 1190
    master - mean (1,155ms)  : 1094, 1216

Loading
HttpMessageHandler (.NET Core 3.1)
gantt
    title Execution time (ms) HttpMessageHandler (.NET Core 3.1)
    dateFormat  x
    axisFormat %Q
    todayMarker off
    section Baseline
    This PR (8438) - mean (276ms)  : 272, 280
    master - mean (279ms)  : 275, 283

    section Bailout
    This PR (8438) - mean (277ms)  : 273, 281
    master - mean (279ms)  : 276, 282

    section CallTarget+Inlining+NGEN
    This PR (8438) - mean (928ms)  : 904, 951
    master - mean (927ms)  : 905, 949

Loading
HttpMessageHandler (.NET 6)
gantt
    title Execution time (ms) HttpMessageHandler (.NET 6)
    dateFormat  x
    axisFormat %Q
    todayMarker off
    section Baseline
    This PR (8438) - mean (270ms)  : 266, 274
    master - mean (271ms)  : 267, 275

    section Bailout
    This PR (8438) - mean (271ms)  : 266, 275
    master - mean (271ms)  : 268, 273

    section CallTarget+Inlining+NGEN
    This PR (8438) - mean (1,143ms)  : 1098, 1189
    master - mean (1,142ms)  : 1097, 1186

Loading
HttpMessageHandler (.NET 8)
gantt
    title Execution time (ms) HttpMessageHandler (.NET 8)
    dateFormat  x
    axisFormat %Q
    todayMarker off
    section Baseline
    This PR (8438) - mean (269ms)  : 265, 273
    master - mean (269ms)  : 266, 273

    section Bailout
    This PR (8438) - mean (268ms)  : 265, 271
    master - mean (269ms)  : 266, 273

    section CallTarget+Inlining+NGEN
    This PR (8438) - mean (1,024ms)  : 981, 1066
    master - mean (1,024ms)  : 982, 1066

Loading

@anna-git anna-git changed the base branch from master to steven/attempt-fix-invalid-program-exception April 10, 2026 14:07
@anna-git anna-git marked this pull request as ready for review April 10, 2026 14:09
@anna-git anna-git requested review from a team as code owners April 10, 2026 14:09
@anna-git anna-git requested review from zacharycmontoya and removed request for a team April 10, 2026 14:09
@anna-git anna-git merged commit 4134da7 into steven/attempt-fix-invalid-program-exception Apr 10, 2026
136 of 140 checks passed
@anna-git anna-git deleted the anna/add-integration-apms19196 branch April 10, 2026 14:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:tests unit tests, integration tests

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant