Skip to content

Conversation

@danielsn
Copy link
Contributor

What does this PR do?

A brief description of the change being made with this pull request.

Motivation

What inspired you to submit this pull request?

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

@datadog-datadog-prod-us1
Copy link

datadog-datadog-prod-us1 bot commented Oct 17, 2025

⚠️ Tests

⚠️ Warnings

🧪 39 Tests failed

test_crash_ping_timing_and_content from bin_tests::crashtracker_bin_test (Datadog)
thread 'test_crash_ping_timing_and_content' panicked at bin_tests/tests/crashtracker_bin_test.rs:276:5

thread 'test_crash_ping_timing_and_content' panicked at bin_tests/tests/crashtracker_bin_test.rs:276:5:
stack backtrace:
   0:     0x55ef916b3daa - std::backtrace_rs::backtrace::libunwind::trace::h886f3b0575353f6e
                               at /rustc/e71f9a9a98b0faf423844bf0ba7438f29dc27d58/library/std/src/../../backtrace/src/backtrace/libunwind.rs:116:5
   1:     0x55ef916b3daa - std::backtrace_rs::backtrace::trace_unsynchronized::h652d1041ec67eb09
                               at /rustc/e71f9a9a98b0faf423844bf0ba7438f29dc27d58/library/std/src/../../backtrace/src/backtrace/mod.rs:66:5
   2:     0x55ef916b3daa - std::sys::backtrace::_print_fmt::hd0317245a04c3039
                               at /rustc/e71f9a9a98b0faf423844bf0ba7438f29dc27d58/library/std/src/sys/backtrace.rs:66:9
...

    test_crash_ping_timing_and_content from bin_tests::crashtracker_bin_test

    test_crash_tracking_bin_chained from bin_tests::crashtracker_bin_test

View all

ℹ️ Info

❄️ No new flaky tests detected

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 80eadd7 | Docs | Was this helpful? Give us feedback!

@pr-commenter
Copy link

pr-commenter bot commented Oct 17, 2025

Benchmarks

Comparison

Benchmark execution time: 2025-10-17 14:07:07

Comparing candidate commit 80eadd7 in PR branch dsn/crashtracker-debug-info with baseline commit 0272ba4 in branch main.

Found 2 performance improvements and 0 performance regressions! Performance is the same for 51 metrics, 2 unstable metrics.

scenario:ip_address/quantize_peer_ip_address_benchmark

  • 🟩 execution_time [-380.149ns; -350.456ns] or [-7.049%; -6.499%]

scenario:redis/obfuscate_redis_string

  • 🟩 execution_time [-6.740µs; -6.462µs] or [-16.110%; -15.445%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 80eadd7 1760709234 dsn/crashtracker-debug-info
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 4.944µs 5.027µs ± 0.048µs 5.034µs ± 0.049µs 5.080µs 5.094µs 5.097µs 5.098µs 1.27% 0.106 -1.560 0.95% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.021µs; 5.034µs] or [-0.132%; +0.132%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 80eadd7 1760709234 dsn/crashtracker-debug-info
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 204.984µs 205.427µs ± 0.263µs 205.386µs ± 0.139µs 205.544µs 205.825µs 206.201µs 207.075µs 0.82% 2.343 11.074 0.13% 0.019µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4829169.436op/s 4867920.591op/s ± 6218.742op/s 4868877.830op/s ± 3297.749op/s 4871695.024op/s 4875326.825op/s 4877944.604op/s 4878424.390op/s 0.20% -2.314 10.859 0.13% 439.731op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.179µs 18.351µs ± 0.160µs 18.259µs ± 0.039µs 18.445µs 18.653µs 18.860µs 18.965µs 3.86% 1.349 1.426 0.87% 0.011µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 52728967.788op/s 54496457.977op/s ± 470495.375op/s 54766528.911op/s ± 116871.552op/s 54835077.170op/s 54920851.793op/s 54968955.454op/s 55008602.606op/s 0.44% -1.308 1.239 0.86% 33269.047op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.518µs 10.721µs ± 0.177µs 10.653µs ± 0.078µs 10.774µs 11.065µs 11.129µs 11.152µs 4.68% 1.006 -0.419 1.65% 0.013µs 1 200
normalization/normalize_name/normalize_name/good throughput 89673193.346op/s 93301836.511op/s ± 1517214.079op/s 93870580.788op/s ± 682452.359op/s 94454617.181op/s 94826512.122op/s 94937355.936op/s 95073707.919op/s 1.28% -0.977 -0.468 1.62% 107283.236op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [205.390µs; 205.463µs] or [-0.018%; +0.018%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4867058.734op/s; 4868782.449op/s] or [-0.018%; +0.018%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.329µs; 18.373µs] or [-0.121%; +0.121%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [54431251.843op/s; 54561664.111op/s] or [-0.120%; +0.120%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.696µs; 10.745µs] or [-0.229%; +0.229%] None None None
normalization/normalize_name/normalize_name/good throughput [93091565.232op/s; 93512107.791op/s] or [-0.225%; +0.225%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 80eadd7 1760709234 dsn/crashtracker-debug-info
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 10.625ms 10.651ms ± 0.015ms 10.649ms ± 0.008ms 10.658ms 10.674ms 10.700ms 10.732ms 0.78% 1.551 4.640 0.14% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [10.649ms; 10.653ms] or [-0.020%; +0.020%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 80eadd7 1760709234 dsn/crashtracker-debug-info
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 34.607µs 35.238µs ± 0.954µs 34.837µs ± 0.109µs 34.951µs 37.240µs 37.308µs 38.928µs 11.74% 1.756 1.434 2.70% 0.067µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [35.106µs; 35.370µs] or [-0.375%; +0.375%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 80eadd7 1760709234 dsn/crashtracker-debug-info
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 166.656µs 167.379µs ± 0.382µs 167.315µs ± 0.200µs 167.578µs 168.079µs 168.532µs 168.817µs 0.90% 0.929 1.160 0.23% 0.027µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [167.326µs; 167.432µs] or [-0.032%; +0.032%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 80eadd7 1760709234 dsn/crashtracker-debug-info
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.204µs 3.218µs ± 1.420µs 2.995µs ± 0.030µs 3.025µs 3.682µs 14.064µs 14.654µs 389.35% 7.285 54.395 44.02% 0.100µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.021µs; 3.415µs] or [-6.116%; +6.116%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 80eadd7 1760709234 dsn/crashtracker-debug-info
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 18.138µs 26.585µs ± 9.909µs 18.366µs ± 0.183µs 35.426µs 45.179µs 46.175µs 59.880µs 226.04% 0.673 -0.698 37.18% 0.701µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [25.212µs; 27.958µs] or [-5.166%; +5.166%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 80eadd7 1760709234 dsn/crashtracker-debug-info
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2597 execution_time 6.205ms 6.261ms ± 0.040ms 6.254ms ± 0.018ms 6.269ms 6.334ms 6.409ms 6.465ms 3.39% 2.086 5.885 0.63% 0.003ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2597 execution_time [6.255ms; 6.266ms] or [-0.088%; +0.088%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 80eadd7 1760709234 dsn/crashtracker-debug-info
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 14.729ms 14.782ms ± 0.031ms 14.781ms ± 0.017ms 14.796ms 14.826ms 14.897ms 14.925ms 0.98% 1.710 5.256 0.21% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [14.778ms; 14.786ms] or [-0.029%; +0.029%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 80eadd7 1760709234 dsn/crashtracker-debug-info
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 534.282µs 535.065µs ± 0.804µs 534.983µs ± 0.243µs 535.244µs 535.656µs 535.846µs 545.312µs 1.93% 10.419 130.267 0.15% 0.057µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1833813.361op/s 1868935.537op/s ± 2765.612op/s 1869216.630op/s ± 849.447op/s 1869999.299op/s 1870811.528op/s 1871304.768op/s 1871670.972op/s 0.13% -10.312 128.454 0.15% 195.558op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 383.600µs 384.320µs ± 0.308µs 384.282µs ± 0.182µs 384.472µs 384.867µs 385.246µs 385.468µs 0.31% 0.835 1.294 0.08% 0.022µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2594247.606op/s 2602002.684op/s ± 2081.836op/s 2602255.782op/s ± 1233.947op/s 2603459.352op/s 2604960.941op/s 2605683.756op/s 2606882.760op/s 0.18% -0.828 1.279 0.08% 147.208op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 195.284µs 195.729µs ± 0.164µs 195.726µs ± 0.113µs 195.843µs 196.003µs 196.101µs 196.151µs 0.22% 0.009 -0.210 0.08% 0.012µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5098109.768op/s 5109098.628op/s ± 4289.969op/s 5109184.963op/s ± 2943.549op/s 5112083.782op/s 5115857.650op/s 5118977.933op/s 5120742.389op/s 0.23% -0.004 -0.210 0.08% 303.347op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 37.836µs 37.912µs ± 0.038µs 37.910µs ± 0.026µs 37.938µs 37.977µs 37.999µs 38.030µs 0.32% 0.274 -0.386 0.10% 0.003µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26295063.362op/s 26376642.832op/s ± 26623.525op/s 26378328.893op/s ± 18093.314op/s 26394830.470op/s 26417409.291op/s 26427394.033op/s 26429963.919op/s 0.20% -0.270 -0.390 0.10% 1882.568op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 45.799µs 45.894µs ± 0.055µs 45.884µs ± 0.033µs 45.923µs 45.996µs 46.043µs 46.205µs 0.70% 1.456 4.548 0.12% 0.004µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 21642845.909op/s 21789232.862op/s ± 25909.978op/s 21794181.801op/s ± 15654.120op/s 21807616.359op/s 21819526.168op/s 21830226.652op/s 21834622.627op/s 0.19% -1.441 4.448 0.12% 1832.112op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [534.954µs; 535.177µs] or [-0.021%; +0.021%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1868552.250op/s; 1869318.825op/s] or [-0.021%; +0.021%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [384.277µs; 384.362µs] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2601714.161op/s; 2602291.206op/s] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [195.707µs; 195.752µs] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5108504.080op/s; 5109693.177op/s] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [37.907µs; 37.918µs] or [-0.014%; +0.014%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [26372953.068op/s; 26380332.597op/s] or [-0.014%; +0.014%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [45.887µs; 45.902µs] or [-0.017%; +0.017%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [21785641.988op/s; 21792823.735op/s] or [-0.016%; +0.016%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 80eadd7 1760709234 dsn/crashtracker-debug-info
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 88.186µs 88.436µs ± 0.134µs 88.419µs ± 0.035µs 88.454µs 88.561µs 88.672µs 90.017µs 1.81% 8.426 94.956 0.15% 0.009µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [88.417µs; 88.455µs] or [-0.021%; +0.021%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 80eadd7 1760709234 dsn/crashtracker-debug-info
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 244.379ns 255.624ns ± 13.742ns 248.499ns ± 2.739ns 260.211ns 282.767ns 292.987ns 295.996ns 19.11% 1.353 0.502 5.36% 0.972ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [253.719ns; 257.528ns] or [-0.745%; +0.745%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 80eadd7 1760709234 dsn/crashtracker-debug-info
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.899µs 3.912µs ± 0.002µs 3.912µs ± 0.001µs 3.914µs 3.917µs 3.918µs 3.924µs 0.30% 0.155 6.554 0.06% 0.000µs 1 200
credit_card/is_card_number/ throughput 254832419.270op/s 255593685.844op/s ± 153971.176op/s 255607987.750op/s ± 83292.425op/s 255683288.914op/s 255779535.499op/s 255829174.589op/s 256452808.168op/s 0.33% -0.139 6.581 0.06% 10887.406op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 78.448µs 80.579µs ± 0.974µs 80.488µs ± 0.730µs 81.369µs 82.147µs 82.818µs 83.295µs 3.49% 0.254 -0.473 1.21% 0.069µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12005473.721op/s 12411952.709op/s ± 149667.636op/s 12424246.612op/s ± 112157.941op/s 12522769.615op/s 12630944.509op/s 12709620.727op/s 12747297.573op/s 2.60% -0.202 -0.506 1.20% 10583.100op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 71.448µs 71.992µs ± 0.439µs 71.868µs ± 0.276µs 72.194µs 72.899µs 73.164µs 73.744µs 2.61% 1.175 1.318 0.61% 0.031µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 13560516.537op/s 13891022.701op/s ± 84034.868op/s 13914372.852op/s ± 53281.604op/s 13964510.113op/s 13983641.615op/s 13992434.949op/s 13996259.273op/s 0.59% -1.140 1.186 0.60% 5942.162op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.892µs 3.913µs ± 0.003µs 3.913µs ± 0.001µs 3.915µs 3.917µs 3.919µs 3.920µs 0.18% -2.828 18.426 0.08% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 255092722.612op/s 255559266.709op/s ± 199758.310op/s 255545172.786op/s ± 97814.811op/s 255645997.108op/s 255783559.268op/s 255936645.749op/s 256913573.409op/s 0.54% 2.857 18.655 0.08% 14125.046op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 68.249µs 69.004µs ± 0.368µs 68.960µs ± 0.264µs 69.266µs 69.666µs 69.981µs 70.297µs 1.94% 0.642 0.151 0.53% 0.026µs 1 200
credit_card/is_card_number/378282246310005 throughput 14225457.211op/s 14492234.719op/s ± 76996.550op/s 14501231.155op/s ± 55590.675op/s 14552479.153op/s 14595826.868op/s 14625361.435op/s 14652276.716op/s 1.04% -0.615 0.093 0.53% 5444.478op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 45.463µs 45.737µs ± 0.089µs 45.732µs ± 0.060µs 45.800µs 45.885µs 45.916µs 45.958µs 0.50% -0.087 -0.173 0.19% 0.006µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 21758774.673op/s 21864010.052op/s ± 42509.316op/s 21866635.887op/s ± 28882.104op/s 21892464.081op/s 21934248.582op/s 21959767.347op/s 21996036.897op/s 0.59% 0.098 -0.165 0.19% 3005.863op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.428µs 6.436µs ± 0.006µs 6.435µs ± 0.002µs 6.437µs 6.443µs 6.468µs 6.486µs 0.79% 4.718 31.638 0.09% 0.000µs 1 200
credit_card/is_card_number/x371413321323331 throughput 154179273.568op/s 155375233.839op/s ± 146704.766op/s 155390692.735op/s ± 52187.667op/s 155444865.342op/s 155513199.431op/s 155566995.203op/s 155577680.820op/s 0.12% -4.686 31.309 0.09% 10373.593op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.892µs 3.912µs ± 0.003µs 3.912µs ± 0.001µs 3.913µs 3.915µs 3.917µs 3.918µs 0.15% -3.762 22.746 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 255249000.541op/s 255637453.534op/s ± 195832.371op/s 255627350.707op/s ± 84306.703op/s 255707319.624op/s 255827373.919op/s 256818394.988op/s 256957214.564op/s 0.52% 3.786 22.934 0.08% 13847.440op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 61.509µs 62.702µs ± 0.627µs 62.721µs ± 0.458µs 63.065µs 63.776µs 64.054µs 64.622µs 3.03% 0.291 -0.280 1.00% 0.044µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15474686.991op/s 15949975.693op/s ± 159051.654op/s 15943570.507op/s ± 117127.973op/s 16070768.502op/s 16207339.866op/s 16251889.383op/s 16257794.978op/s 1.97% -0.243 -0.332 0.99% 11246.650op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 53.861µs 54.280µs ± 0.124µs 54.305µs ± 0.071µs 54.361µs 54.432µs 54.514µs 54.532µs 0.42% -0.997 1.291 0.23% 0.009µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 18337982.094op/s 18423184.818op/s ± 42319.991op/s 18414398.831op/s ± 24181.074op/s 18445654.031op/s 18499733.977op/s 18557570.903op/s 18566233.180op/s 0.82% 1.013 1.331 0.23% 2992.475op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.896µs 3.915µs ± 0.002µs 3.914µs ± 0.001µs 3.915µs 3.918µs 3.920µs 3.921µs 0.18% -2.761 29.969 0.05% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 255013637.990op/s 255445204.853op/s ± 136096.732op/s 255464209.468op/s ± 54101.056op/s 255511070.017op/s 255558010.391op/s 255588654.787op/s 256653941.788op/s 0.47% 2.800 30.347 0.05% 9623.492op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 50.291µs 50.637µs ± 0.149µs 50.631µs ± 0.068µs 50.696µs 50.863µs 51.179µs 51.263µs 1.25% 1.206 3.853 0.29% 0.011µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 19507437.210op/s 19748472.559op/s ± 57796.982op/s 19750673.681op/s ± 26663.389op/s 19781665.864op/s 19829195.557op/s 19872926.745op/s 19884401.330op/s 0.68% -1.167 3.729 0.29% 4086.864op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 45.492µs 45.723µs ± 0.088µs 45.722µs ± 0.058µs 45.783µs 45.864µs 45.911µs 45.935µs 0.47% -0.083 -0.121 0.19% 0.006µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 21770095.662op/s 21870990.896op/s ± 42127.768op/s 21871522.187op/s ± 27892.004op/s 21898168.222op/s 21942467.580op/s 21973599.276op/s 21981732.478op/s 0.50% 0.094 -0.117 0.19% 2978.883op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.427µs 6.436µs ± 0.004µs 6.436µs ± 0.003µs 6.438µs 6.442µs 6.444µs 6.446µs 0.17% 0.195 -0.449 0.06% 0.000µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 155129129.028op/s 155381602.507op/s ± 92669.450op/s 155387569.001op/s ± 65731.615op/s 155452842.308op/s 155525885.000op/s 155564102.250op/s 155603326.867op/s 0.14% -0.192 -0.451 0.06% 6552.720op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.912µs; 3.913µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/ throughput [255572346.920op/s; 255615024.768op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [80.444µs; 80.714µs] or [-0.168%; +0.168%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12391210.214op/s; 12432695.204op/s] or [-0.167%; +0.167%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [71.931µs; 72.052µs] or [-0.084%; +0.084%] None None None
credit_card/is_card_number/ 378282246310005 throughput [13879376.277op/s; 13902669.126op/s] or [-0.084%; +0.084%] None None None
credit_card/is_card_number/37828224631 execution_time [3.913µs; 3.913µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/37828224631 throughput [255531582.128op/s; 255586951.289op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/378282246310005 execution_time [68.953µs; 69.055µs] or [-0.074%; +0.074%] None None None
credit_card/is_card_number/378282246310005 throughput [14481563.737op/s; 14502905.700op/s] or [-0.074%; +0.074%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [45.725µs; 45.750µs] or [-0.027%; +0.027%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [21858118.670op/s; 21869901.435op/s] or [-0.027%; +0.027%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.435µs; 6.437µs] or [-0.013%; +0.013%] None None None
credit_card/is_card_number/x371413321323331 throughput [155354901.969op/s; 155395565.709op/s] or [-0.013%; +0.013%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.911µs; 3.912µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ throughput [255610313.051op/s; 255664594.017op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [62.615µs; 62.789µs] or [-0.139%; +0.139%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15927932.663op/s; 15972018.722op/s] or [-0.138%; +0.138%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [54.262µs; 54.297µs] or [-0.032%; +0.032%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [18417319.674op/s; 18429049.962op/s] or [-0.032%; +0.032%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.914µs; 3.915µs] or [-0.007%; +0.007%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255426343.155op/s; 255464066.551op/s] or [-0.007%; +0.007%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [50.617µs; 50.658µs] or [-0.041%; +0.041%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [19740462.453op/s; 19756482.664op/s] or [-0.041%; +0.041%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [45.711µs; 45.735µs] or [-0.027%; +0.027%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [21865152.393op/s; 21876829.399op/s] or [-0.027%; +0.027%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.435µs; 6.436µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [155368759.412op/s; 155394445.601op/s] or [-0.008%; +0.008%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 80eadd7 1760709234 dsn/crashtracker-debug-info
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 60.688ms 61.244ms ± 1.802ms 60.995ms ± 0.052ms 61.055ms 61.272ms 69.020ms 79.380ms 30.14% 8.706 77.725 2.94% 0.127ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [60.994ms; 61.493ms] or [-0.408%; +0.408%] None None None

Group 15

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 80eadd7 1760709234 dsn/crashtracker-debug-info
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.322µs 2.381µs ± 0.017µs 2.380µs ± 0.006µs 2.387µs 2.417µs 2.425µs 2.429µs 2.02% -0.387 2.634 0.73% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.379µs; 2.384µs] or [-0.101%; +0.101%] None None None

Baseline

Omitted due to size.

@danielsn danielsn force-pushed the dsn/crashtracker-debug-info branch from b357056 to a89a4a8 Compare October 17, 2025 13:33
@danielsn danielsn force-pushed the dsn/crashtracker-debug-info branch from cd74b3c to 80eadd7 Compare October 17, 2025 13:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants