Conversation
|
Execution-Time Benchmarks Report ⏱️Execution-time results for samples comparing This PR (8016) and master. ✅ No regressions detected - check the details below Full Metrics ComparisonFakeDbCommand
HttpMessageHandler
Comparison explanationExecution-time benchmarks measure the whole time it takes to execute a program, and are intended to measure the one-off costs. Cases where the execution time results for the PR are worse than latest master results are highlighted in **red**. The following thresholds were used for comparing the execution times:
Note that these results are based on a single point-in-time result for each branch. For full results, see the dashboard. Graphs show the p99 interval based on the mean and StdDev of the test run, as well as the mean value of the run (shown as a diamond below the graph). Duration chartsFakeDbCommand (.NET Framework 4.8)gantt
title Execution time (ms) FakeDbCommand (.NET Framework 4.8)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (8016) - mean (77ms) : 74, 79
master - mean (76ms) : 73, 80
section Bailout
This PR (8016) - mean (80ms) : 78, 83
master - mean (80ms) : 79, 82
section CallTarget+Inlining+NGEN
This PR (8016) - mean (1,080ms) : 1006, 1154
master - mean (1,088ms) : 1001, 1175
FakeDbCommand (.NET Core 3.1)gantt
title Execution time (ms) FakeDbCommand (.NET Core 3.1)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (8016) - mean (118ms) : 114, 123
master - mean (118ms) : 114, 122
section Bailout
This PR (8016) - mean (119ms) : 115, 124
master - mean (119ms) : 117, 121
section CallTarget+Inlining+NGEN
This PR (8016) - mean (796ms) : 730, 861
master - mean (809ms) : 747, 872
FakeDbCommand (.NET 6)gantt
title Execution time (ms) FakeDbCommand (.NET 6)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (8016) - mean (104ms) : 100, 107
master - mean (105ms) : 102, 107
section Bailout
This PR (8016) - mean (105ms) : 102, 107
master - mean (106ms) : 104, 108
section CallTarget+Inlining+NGEN
This PR (8016) - mean (753ms) : 693, 813
master - mean (765ms) : 714, 816
FakeDbCommand (.NET 8)gantt
title Execution time (ms) FakeDbCommand (.NET 8)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (8016) - mean (103ms) : 100, 105
master - mean (104ms) : 101, 108
section Bailout
This PR (8016) - mean (104ms) : 102, 106
master - mean (105ms) : 102, 108
section CallTarget+Inlining+NGEN
This PR (8016) - mean (675ms) : 652, 698
master - mean (685ms) : 662, 709
HttpMessageHandler (.NET Framework 4.8)gantt
title Execution time (ms) HttpMessageHandler (.NET Framework 4.8)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (8016) - mean (195ms) : 189, 200
master - mean (196ms) : 190, 203
section Bailout
This PR (8016) - mean (198ms) : 195, 200
master - mean (198ms) : 194, 201
section CallTarget+Inlining+NGEN
This PR (8016) - mean (1,124ms) : 1052, 1196
master - mean (1,117ms) : 1058, 1176
HttpMessageHandler (.NET Core 3.1)gantt
title Execution time (ms) HttpMessageHandler (.NET Core 3.1)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (8016) - mean (277ms) : 272, 283
master - mean (278ms) : 271, 284
section Bailout
This PR (8016) - mean (278ms) : 273, 284
master - mean (278ms) : 273, 283
section CallTarget+Inlining+NGEN
This PR (8016) - mean (924ms) : 880, 969
master - mean (930ms) : 879, 981
HttpMessageHandler (.NET 6)gantt
title Execution time (ms) HttpMessageHandler (.NET 6)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (8016) - mean (271ms) : 266, 276
master - mean (276ms) : 266, 286
section Bailout
This PR (8016) - mean (270ms) : 267, 272
master - mean (273ms) : 265, 281
section CallTarget+Inlining+NGEN
This PR (8016) - mean (926ms) : 881, 970
master - mean (933ms) : 886, 980
HttpMessageHandler (.NET 8)gantt
title Execution time (ms) HttpMessageHandler (.NET 8)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (8016) - mean (271ms) : 266, 276
master - mean (268ms) : 262, 274
section Bailout
This PR (8016) - mean (270ms) : 264, 276
master - mean (267ms) : 264, 271
section CallTarget+Inlining+NGEN
This PR (8016) - mean (824ms) : 802, 846
master - mean (825ms) : 803, 847
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
BenchmarksBenchmark execution time: 2025-12-29 18:17:35 Comparing candidate commit 74fa985 in PR branch Found 12 performance improvements and 7 performance regressions! Performance is the same for 159 metrics, 8 unstable metrics. scenario:Benchmarks.Trace.Asm.AppSecBodyBenchmark.ObjectExtractorSimpleBody net6.0
scenario:Benchmarks.Trace.Asm.AppSecEncoderBenchmark.EncodeLegacyArgs net6.0
scenario:Benchmarks.Trace.AspNetCoreBenchmark.SendRequest net6.0
scenario:Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark.WriteAndFlushEnrichedTraces net472
scenario:Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark.WriteAndFlushEnrichedTraces net6.0
scenario:Benchmarks.Trace.CharSliceBenchmark.OptimizedCharSliceWithPool net472
scenario:Benchmarks.Trace.ElasticsearchBenchmark.CallElasticsearch net6.0
scenario:Benchmarks.Trace.ElasticsearchBenchmark.CallElasticsearch netcoreapp3.1
scenario:Benchmarks.Trace.ElasticsearchBenchmark.CallElasticsearchAsync netcoreapp3.1
scenario:Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatBenchmark netcoreapp3.1
scenario:Benchmarks.Trace.NLogBenchmark.EnrichedLog net6.0
scenario:Benchmarks.Trace.RedisBenchmark.SendReceive net6.0
scenario:Benchmarks.Trace.SpanBenchmark.StartFinishScope net6.0
scenario:Benchmarks.Trace.SpanBenchmark.StartFinishScope netcoreapp3.1
scenario:Benchmarks.Trace.SpanBenchmark.StartFinishSpan netcoreapp3.1
|
|
Closed in favour of #8017 |
Summary of changes
Reason for change
Implementation details
Test coverage
Other details