Open
Description
Run Information
Architecture | x64 |
---|---|
OS | Windows 10.0.19042 |
Baseline | 8cada8ea5cbb72a6cc3f14af65e48b5076273ef9 |
Compare | 8e624b33465546e9d05da2afea5faea233d9f847 |
Diff | Diff |
Regressions in System.Text.Encodings.Web.Tests.Perf_Encoders
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
---|---|---|---|---|---|---|---|---|---|---|
EncodeUtf8 - Duration of single invocation | 41.13 ns | 47.77 ns | 1.16 | 0.04 | False | |||||
EncodeUtf8 - Duration of single invocation | 40.89 ns | 47.23 ns | 1.15 | 0.04 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Encodings.Web.Tests.Perf_Encoders*'
Payloads
Histogram
System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: UnsafeRelaxed,no <escaping /> required,512)
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 47.772814444235756 > 43.37863983296739.
IsChangePoint: Marked as a change because one of 3/7/2022 10:45:01 PM, 4/7/2022 3:14:09 PM, 4/29/2022 5:18:09 PM, 5/3/2022 11:42:39 AM falls between 4/24/2022 10:52:31 PM and 5/3/2022 11:42:39 AM.
IsRegressionStdDev: Marked as regression because -18.005966866375793 (T) = (0 -47.106017875195064) / Math.Sqrt((1.2577621928244864 / (43)) + (0.6299974377406298 / (18))) is less than -2.000995378087428 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (18) - 2, .025) and -0.10728431849377293 = (42.54193533533725 - 47.106017875195064) / 42.54193533533725 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: JavaScript,no escaping required,512)
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 47.226215084305764 > 43.17750218108369.
IsChangePoint: Marked as a change because one of 3/7/2022 10:45:01 PM, 4/7/2022 3:14:09 PM, 4/29/2022 5:18:09 PM, 5/3/2022 11:42:39 AM falls between 4/24/2022 10:52:31 PM and 5/3/2022 11:42:39 AM.
IsRegressionStdDev: Marked as regression because -21.33280955200132 (T) = (0 -47.17689151746384) / Math.Sqrt((1.0211644876569723 / (43)) + (0.5002273222949377 / (18))) is less than -2.000995378087428 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (18) - 2, .025) and -0.11439981085252672 = (42.33390122470772 - 47.17689151746384) / 42.33390122470772 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Architecture | x64 |
---|---|
OS | Windows 10.0.19042 |
Baseline | 8cada8ea5cbb72a6cc3f14af65e48b5076273ef9 |
Compare | 8e624b33465546e9d05da2afea5faea233d9f847 |
Diff | Diff |
Regressions in System.Text.Json.Reader.Tests.Perf_Base64
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
---|---|---|---|---|---|---|---|---|---|---|
ReadBase64EncodedByteArray_HeavyEscaping - Duration of single invocation | 107.43 ns | 118.16 ns | 1.10 | 0.26 | False | |||||
ReadBase64EncodedByteArray_NoEscaping - Duration of single invocation | 107.26 ns | 118.60 ns | 1.11 | 0.23 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Reader.Tests.Perf_Base64*'
Payloads
Histogram
System.Text.Json.Reader.Tests.Perf_Base64.ReadBase64EncodedByteArray_HeavyEscaping(NumberOfBytes: 100)
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 118.15730611582981 > 112.528548231773.
IsChangePoint: Marked as a change because one of 3/1/2022 10:24:04 PM, 3/11/2022 8:42:43 PM, 4/8/2022 7:02:49 PM, 4/29/2022 5:18:09 PM, 5/3/2022 11:42:39 AM falls between 4/24/2022 10:52:31 PM and 5/3/2022 11:42:39 AM.
IsRegressionStdDev: Marked as regression because -18.096793187947444 (T) = (0 -122.82801015826061) / Math.Sqrt((48.11993148945896 / (43)) + (7.076693423744189 / (18))) is less than -2.000995378087428 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (18) - 2, .025) and -0.2212703324395548 = (100.5739735877354 - 122.82801015826061) / 100.5739735877354 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Reader.Tests.Perf_Base64.ReadBase64EncodedByteArray_NoEscaping(NumberOfBytes: 100)
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 118.6007184493413 > 112.99080979065236.
IsChangePoint: Marked as a change because one of 2/26/2022 10:27:55 AM, 3/17/2022 6:54:53 PM, 3/30/2022 6:37:35 PM, 4/29/2022 5:18:09 PM, 5/3/2022 11:42:39 AM falls between 4/24/2022 10:52:31 PM and 5/3/2022 11:42:39 AM.
IsRegressionStdDev: Marked as regression because -18.670736042618184 (T) = (0 -123.90923544710004) / Math.Sqrt((43.78788994964401 / (43)) + (5.1490661617217715 / (18))) is less than -2.000995378087428 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (18) - 2, .025) and -0.20786339860338812 = (102.58547083252306 - 123.90923544710004) / 102.58547083252306 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Architecture | x64 |
---|---|
OS | Windows 10.0.19042 |
Baseline | 8cada8ea5cbb72a6cc3f14af65e48b5076273ef9 |
Compare | 8e624b33465546e9d05da2afea5faea233d9f847 |
Diff | Diff |
Regressions in System.Numerics.Tests.Perf_Vector2
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
---|---|---|---|---|---|---|---|---|---|---|
EqualsBenchmark - Duration of single invocation | 0.28 ns | 1.29 ns | 4.62 | 0.07 | True |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_Vector2*'
Payloads
Histogram
System.Numerics.Tests.Perf_Vector2.EqualsBenchmark
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.2876561297941465 > 0.2924412055561342.
IsChangePoint: Marked as a change because one of 4/29/2022 5:18:09 PM, 5/3/2022 11:42:39 AM falls between 4/24/2022 10:52:31 PM and 5/3/2022 11:42:39 AM.
IsRegressionStdDev: Marked as regression because -154.25960941238614 (T) = (0 -1.2879862186883484) / Math.Sqrt((0.0020172938232947456 / (43)) + (2.9968167142484406E-07 / (18))) is less than -2.000995378087428 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (18) - 2, .025) and -4.570434144942063 = (0.2312182830233862 - 1.2879862186883484) / 0.2312182830233862 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Architecture | x64 |
---|---|
OS | Windows 10.0.19042 |
Baseline | 8cada8ea5cbb72a6cc3f14af65e48b5076273ef9 |
Compare | 8e624b33465546e9d05da2afea5faea233d9f847 |
Diff | Diff |
Regressions in System.Numerics.Tests.Perf_Quaternion
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
---|---|---|---|---|---|---|---|---|---|---|
EqualsBenchmark - Duration of single invocation | 0.00 ns | 11.15 ns | ∞ | 0.95 | True |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_Quaternion*'
Payloads
Histogram
System.Numerics.Tests.Perf_Quaternion.EqualsBenchmark
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 11.14649432647553 > 2.2365692042930726E-05.
IsChangePoint: Marked as a change because one of 4/29/2022 5:18:09 PM, 5/3/2022 11:42:39 AM falls between 4/24/2022 10:52:31 PM and 5/3/2022 11:42:39 AM.
IsRegressionStdDev: Marked as regression because -181.94053983303652 (T) = (0 -11.273238302627806) / Math.Sqrt((4.477823620270642E-09 / (43)) + (0.06910451563348406 / (18))) is less than -2.000995378087428 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (18) - 2, .025) and -193740.73372137028 = (5.818693828166324E-05 - 11.273238302627806) / 5.818693828166324E-05 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Architecture | x64 |
---|---|
OS | Windows 10.0.19042 |
Baseline | 8cada8ea5cbb72a6cc3f14af65e48b5076273ef9 |
Compare | 8e624b33465546e9d05da2afea5faea233d9f847 |
Diff | Diff |
Regressions in System.Numerics.Tests.Perf_Matrix3x2
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
---|---|---|---|---|---|---|---|---|---|---|
EqualsBenchmark - Duration of single invocation | 5.85 ns | 11.83 ns | 2.02 | 0.05 | True |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_Matrix3x2*'
Payloads
Histogram
System.Numerics.Tests.Perf_Matrix3x2.EqualsBenchmark
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 11.827250105165023 > 6.179545171862462.
IsChangePoint: Marked as a change because one of 4/29/2022 5:18:09 PM, 5/3/2022 11:42:39 AM falls between 4/24/2022 10:52:31 PM and 5/3/2022 11:42:39 AM.
IsRegressionStdDev: Marked as regression because -23.65901729152748 (T) = (0 -11.320785504162444) / Math.Sqrt((0.0031768633803055148 / (43)) + (0.9359619784340367 / (18))) is less than -2.000995378087428 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (18) - 2, .025) and -0.911656209613231 = (5.921977731787287 - 11.320785504162444) / 5.921977731787287 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository