Skip to content

Prevent checking for a specific version since crates version can change. #1280

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 2 commits into
base: main
Choose a base branch
from
Open

Prevent checking for a specific version since crates version can change. #1280

wants to merge 2 commits into from

Conversation

@hoolioh
Copy link
Contributor

@hoolioh hoolioh commented Oct 24, 2025 •
edited
Loading

What does this PR do?

Prevent tests from checking for a specific version in libdatadog_version field.

Motivation

Since we're going to versioning individual crates the ffi crate's version doesn't have to match the implementation one.

@github-actions github-actions bot added the profiling Relates to the profiling* modules. label Oct 24, 2025
@hoolioh hoolioh force-pushed the julio/fix-version-profiling-tests branch from 2096a26 to 48fdcda Compare October 24, 2025 09:15
@pr-commenter
Copy link

pr-commenter bot commented Oct 24, 2025 •
edited
Loading

Benchmarks

Comparison

Benchmark execution time: 2025-10-27 19:09:23

Comparing candidate commit 7380a63 in PR branch julio/fix-version-profiling-tests with baseline commit c4cdaa2 in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 55 metrics, 2 unstable metrics.

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 7380a63 1761591329 julio/fix-version-profiling-tests
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sdk_test_data/rules-based execution_time 120.756µs 122.575µs ± 1.171µs 122.377µs ± 0.434µs 122.863µs 123.772µs 127.264µs 133.719µs 9.27% 5.256 42.428 0.95% 0.083µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sdk_test_data/rules-based execution_time [122.413µs; 122.737µs] or [-0.132%; +0.132%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 7380a63 1761591329 julio/fix-version-profiling-tests
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 495.955µs 496.847µs ± 0.531µs 496.774µs ± 0.258µs 497.060µs 497.527µs 497.979µs 500.731µs 0.80% 3.642 23.013 0.11% 0.038µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1997080.933op/s 2012695.455op/s ± 2142.278op/s 2012989.148op/s ± 1044.189op/s 2013976.268op/s 2014957.670op/s 2015514.926op/s 2016313.545op/s 0.17% -3.605 22.665 0.11% 151.482op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 370.130µs 370.845µs ± 0.258µs 370.825µs ± 0.158µs 371.020µs 371.312µs 371.365µs 371.671µs 0.23% 0.149 0.053 0.07% 0.018µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2690552.534op/s 2696542.818op/s ± 1876.337op/s 2696689.023op/s ± 1152.335op/s 2697760.349op/s 2699297.069op/s 2700799.744op/s 2701751.216op/s 0.19% -0.145 0.051 0.07% 132.677op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 168.477µs 168.828µs ± 0.161µs 168.819µs ± 0.088µs 168.908µs 169.078µs 169.339µs 169.597µs 0.46% 0.924 3.069 0.10% 0.011µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5896340.416op/s 5923192.363op/s ± 5646.266op/s 5923520.599op/s ± 3082.023op/s 5926459.461op/s 5931299.919op/s 5934977.576op/s 5935525.834op/s 0.20% -0.912 3.023 0.10% 399.251op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 36.662µs 36.919µs ± 0.138µs 36.925µs ± 0.111µs 37.031µs 37.138µs 37.198µs 37.217µs 0.79% 0.009 -0.901 0.37% 0.010µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26869598.519op/s 27086870.804op/s ± 101152.076op/s 27081851.632op/s ± 81270.524op/s 27167591.246op/s 27246919.632op/s 27272032.333op/s 27276006.228op/s 0.72% 0.003 -0.904 0.37% 7152.532op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 46.219µs 46.366µs ± 0.133µs 46.349µs ± 0.039µs 46.390µs 46.470µs 46.578µs 47.905µs 3.36% 8.306 90.078 0.29% 0.009µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 20874846.251op/s 21567499.689op/s ± 60386.793op/s 21575368.696op/s ± 18335.311op/s 21593091.507op/s 21613137.334op/s 21625473.505op/s 21636274.512op/s 0.28% -8.110 86.911 0.28% 4269.991op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [496.773µs; 496.920µs] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [2012398.555op/s; 2012992.354op/s] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [370.810µs; 370.881µs] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2696282.776op/s; 2696802.860op/s] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [168.806µs; 168.850µs] or [-0.013%; +0.013%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5922409.845op/s; 5923974.882op/s] or [-0.013%; +0.013%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [36.900µs; 36.938µs] or [-0.052%; +0.052%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [27072852.099op/s; 27100889.509op/s] or [-0.052%; +0.052%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [46.348µs; 46.385µs] or [-0.040%; +0.040%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [21559130.660op/s; 21575868.717op/s] or [-0.039%; +0.039%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 7380a63 1761591329 julio/fix-version-profiling-tests
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 14.559ms 14.621ms ± 0.034ms 14.619ms ± 0.016ms 14.633ms 14.668ms 14.754ms 14.804ms 1.27% 2.201 7.715 0.23% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [14.617ms; 14.626ms] or [-0.032%; +0.032%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 7380a63 1761591329 julio/fix-version-profiling-tests
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 185.463µs 185.997µs ± 0.247µs 185.981µs ± 0.191µs 186.178µs 186.450µs 186.584µs 186.815µs 0.45% 0.458 0.002 0.13% 0.017µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 5352886.357op/s 5376449.615op/s ± 7149.321op/s 5376892.977op/s ± 5520.531op/s 5382366.875op/s 5387168.638op/s 5388474.775op/s 5391903.060op/s 0.28% -0.450 -0.011 0.13% 505.533op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 17.790µs 17.854µs ± 0.030µs 17.851µs ± 0.015µs 17.868µs 17.905µs 17.946µs 18.017µs 0.93% 1.401 4.852 0.17% 0.002µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 55504559.770op/s 56010596.355op/s ± 94195.135op/s 56018347.656op/s ± 46530.294op/s 56061317.896op/s 56142533.395op/s 56178995.041op/s 56211726.427op/s 0.35% -1.376 4.731 0.17% 6660.602op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.530µs 10.578µs ± 0.022µs 10.576µs ± 0.018µs 10.596µs 10.613µs 10.620µs 10.639µs 0.59% -0.045 -0.597 0.20% 0.002µs 1 200
normalization/normalize_name/normalize_name/good throughput 93996406.774op/s 94533644.784op/s ± 193029.250op/s 94550489.538op/s ± 157690.883op/s 94665661.681op/s 94890099.991op/s 94949064.399op/s 94968333.097op/s 0.44% 0.053 -0.596 0.20% 13649.229op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [185.962µs; 186.031µs] or [-0.018%; +0.018%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [5375458.788op/s; 5377440.442op/s] or [-0.018%; +0.018%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [17.850µs; 17.858µs] or [-0.023%; +0.023%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [55997541.815op/s; 56023650.895op/s] or [-0.023%; +0.023%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.575µs; 10.581µs] or [-0.028%; +0.028%] None None None
normalization/normalize_name/normalize_name/good throughput [94506892.786op/s; 94560396.781op/s] or [-0.028%; +0.028%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 7380a63 1761591329 julio/fix-version-profiling-tests
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.220µs 3.257µs ± 1.425µs 3.045µs ± 0.029µs 3.073µs 3.704µs 13.876µs 14.910µs 389.66% 7.313 54.817 43.63% 0.101µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.059µs; 3.454µs] or [-6.062%; +6.062%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 7380a63 1761591329 julio/fix-version-profiling-tests
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 33.538µs 34.171µs ± 0.879µs 33.778µs ± 0.081µs 33.925µs 36.029µs 36.059µs 37.371µs 10.64% 1.722 1.242 2.57% 0.062µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [34.049µs; 34.292µs] or [-0.356%; +0.356%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 7380a63 1761591329 julio/fix-version-profiling-tests
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 86.162µs 86.352µs ± 0.155µs 86.329µs ± 0.048µs 86.386µs 86.495µs 86.896µs 87.975µs 1.91% 6.625 61.975 0.18% 0.011µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [86.331µs; 86.373µs] or [-0.025%; +0.025%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 7380a63 1761591329 julio/fix-version-profiling-tests
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.804µs 25.928µs ± 10.183µs 18.070µs ± 0.220µs 34.499µs 41.051µs 52.829µs 77.661µs 329.78% 1.272 2.662 39.18% 0.720µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [24.517µs; 27.339µs] or [-5.443%; +5.443%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 7380a63 1761591329 julio/fix-version-profiling-tests
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
single_flag_killswitch/rules-based execution_time 171.693ns 175.097ns ± 2.926ns 174.430ns ± 1.905ns 176.710ns 181.098ns 183.314ns 184.818ns 5.96% 1.094 0.603 1.67% 0.207ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
single_flag_killswitch/rules-based execution_time [174.691ns; 175.502ns] or [-0.232%; +0.232%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 7380a63 1761591329 julio/fix-version-profiling-tests
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.892µs 3.912µs ± 0.003µs 3.913µs ± 0.002µs 3.914µs 3.917µs 3.919µs 3.920µs 0.19% -1.483 10.396 0.08% 0.000µs 1 200
credit_card/is_card_number/ throughput 255108352.708op/s 255592520.648op/s ± 192831.656op/s 255584705.740op/s ± 127670.739op/s 255718577.959op/s 255851924.881op/s 255896113.427op/s 256942600.108op/s 0.53% 1.506 10.581 0.08% 13635.257op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 79.082µs 81.241µs ± 0.997µs 81.189µs ± 0.605µs 81.831µs 82.898µs 83.823µs 84.109µs 3.60% 0.231 -0.015 1.22% 0.071µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 11889321.437op/s 12310842.410op/s ± 150764.843op/s 12316913.087op/s ± 91744.718op/s 12401414.752op/s 12561029.877op/s 12631910.354op/s 12645031.053op/s 2.66% -0.161 -0.079 1.22% 10660.684op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 71.476µs 72.389µs ± 0.437µs 72.389µs ± 0.354µs 72.720µs 73.071µs 73.213µs 73.568µs 1.63% 0.102 -0.698 0.60% 0.031µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 13592849.058op/s 13814751.011op/s ± 83431.748op/s 13814216.902op/s ± 67449.195op/s 13883731.747op/s 13952356.030op/s 13972697.855op/s 13990752.721op/s 1.28% -0.078 -0.710 0.60% 5899.516op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.896µs 3.912µs ± 0.003µs 3.912µs ± 0.002µs 3.914µs 3.917µs 3.918µs 3.920µs 0.21% -0.644 5.419 0.07% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 255070409.708op/s 255604756.531op/s ± 177336.671op/s 255615685.167op/s ± 104972.515op/s 255716487.321op/s 255856696.881op/s 255877169.153op/s 256664596.888op/s 0.41% 0.659 5.500 0.07% 12539.596op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 68.455µs 69.312µs ± 0.341µs 69.300µs ± 0.241µs 69.523µs 69.898µs 70.189µs 70.235µs 1.35% 0.264 -0.251 0.49% 0.024µs 1 200
credit_card/is_card_number/378282246310005 throughput 14237841.473op/s 14427841.823op/s ± 70839.948op/s 14430054.708op/s ± 50452.369op/s 14481562.885op/s 14534736.390op/s 14566393.058op/s 14608091.109op/s 1.23% -0.239 -0.271 0.49% 5009.141op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 45.377µs 45.621µs ± 0.122µs 45.626µs ± 0.106µs 45.729µs 45.798µs 45.824µs 45.849µs 0.49% -0.160 -1.021 0.27% 0.009µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 21810860.579op/s 21919947.253op/s ± 58560.196op/s 21917211.047op/s ± 50971.791op/s 21969717.515op/s 22018569.478op/s 22029887.156op/s 22037395.256op/s 0.55% 0.168 -1.017 0.27% 4140.831op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.427µs 6.436µs ± 0.005µs 6.436µs ± 0.003µs 6.438µs 6.448µs 6.451µs 6.453µs 0.27% 0.983 0.965 0.08% 0.000µs 1 200
credit_card/is_card_number/x371413321323331 throughput 154963439.092op/s 155369773.175op/s ± 123531.563op/s 155384440.593op/s ± 71127.155op/s 155459529.998op/s 155529939.513op/s 155577480.554op/s 155599941.843op/s 0.14% -0.978 0.954 0.08% 8735.001op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.890µs 3.912µs ± 0.004µs 3.912µs ± 0.002µs 3.914µs 3.920µs 3.923µs 3.925µs 0.33% -0.144 5.854 0.10% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 254770010.261op/s 255597702.266op/s ± 251648.635op/s 255611515.306op/s ± 152172.399op/s 255766484.802op/s 255884228.529op/s 255948637.214op/s 257077889.370op/s 0.57% 0.168 5.961 0.10% 17794.246op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 59.902µs 62.172µs ± 1.019µs 62.103µs ± 0.760µs 62.880µs 63.789µs 64.193µs 64.806µs 4.35% 0.124 -0.655 1.63% 0.072µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15430614.148op/s 16088811.548op/s ± 263187.840op/s 16102243.189op/s ± 198118.735op/s 16292920.280op/s 16439117.461op/s 16675783.361op/s 16693907.620op/s 3.67% -0.058 -0.663 1.63% 18610.191op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 53.917µs 54.285µs ± 0.135µs 54.312µs ± 0.075µs 54.380µs 54.459µs 54.497µs 54.504µs 0.35% -0.877 0.036 0.25% 0.010µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 18347308.197op/s 18421549.066op/s ± 45822.903op/s 18412288.462op/s ± 25486.944op/s 18442256.394op/s 18514871.253op/s 18540417.703op/s 18547105.940op/s 0.73% 0.886 0.052 0.25% 3240.169op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.895µs 3.913µs ± 0.003µs 3.913µs ± 0.002µs 3.914µs 3.917µs 3.918µs 3.919µs 0.16% -1.224 7.688 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 255153104.835op/s 255581330.131op/s ± 178376.684op/s 255557667.158op/s ± 109415.705op/s 255709736.151op/s 255818438.821op/s 255949976.363op/s 256746524.509op/s 0.47% 1.241 7.811 0.07% 12613.136op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 50.196µs 50.613µs ± 0.122µs 50.616µs ± 0.050µs 50.665µs 50.764µs 50.986µs 51.111µs 0.98% 0.152 3.618 0.24% 0.009µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 19565129.120op/s 19757797.402op/s ± 47477.250op/s 19756454.540op/s ± 19632.457op/s 19775960.236op/s 19830222.787op/s 19899186.189op/s 19922035.764op/s 0.84% -0.112 3.582 0.24% 3357.149op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 45.343µs 45.649µs ± 0.159µs 45.646µs ± 0.132µs 45.779µs 45.892µs 45.919µs 45.956µs 0.68% -0.089 -1.041 0.35% 0.011µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 21759754.033op/s 21906768.975op/s ± 76257.286op/s 21907583.356op/s ± 62973.634op/s 21968339.679op/s 22035390.397op/s 22043915.694op/s 22054138.580op/s 0.67% 0.099 -1.039 0.35% 5392.204op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.427µs 6.436µs ± 0.005µs 6.436µs ± 0.003µs 6.439µs 6.443µs 6.447µs 6.451µs 0.23% 0.244 -0.031 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 155011695.702op/s 155371859.707op/s ± 108929.425op/s 155367427.219op/s ± 77364.199op/s 155447776.883op/s 155545803.194op/s 155582229.422op/s 155588121.598op/s 0.14% -0.240 -0.038 0.07% 7702.474op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.912µs; 3.913µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ throughput [255565796.035op/s; 255619245.261op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [81.103µs; 81.380µs] or [-0.170%; +0.170%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12289947.853op/s; 12331736.967op/s] or [-0.170%; +0.170%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [72.328µs; 72.450µs] or [-0.084%; +0.084%] None None None
credit_card/is_card_number/ 378282246310005 throughput [13803188.173op/s; 13826313.849op/s] or [-0.084%; +0.084%] None None None
credit_card/is_card_number/37828224631 execution_time [3.912µs; 3.913µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/37828224631 throughput [255580179.374op/s; 255629333.688op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/378282246310005 execution_time [69.265µs; 69.359µs] or [-0.068%; +0.068%] None None None
credit_card/is_card_number/378282246310005 throughput [14418024.087op/s; 14437659.558op/s] or [-0.068%; +0.068%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [45.604µs; 45.638µs] or [-0.037%; +0.037%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [21911831.373op/s; 21928063.133op/s] or [-0.037%; +0.037%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.436µs; 6.437µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/x371413321323331 throughput [155352652.888op/s; 155386893.462op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.912µs; 3.913µs] or [-0.014%; +0.014%] None None None
credit_card/is_card_number_no_luhn/ throughput [255562826.185op/s; 255632578.347op/s] or [-0.014%; +0.014%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [62.030µs; 62.313µs] or [-0.227%; +0.227%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [16052336.245op/s; 16125286.852op/s] or [-0.227%; +0.227%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [54.266µs; 54.303µs] or [-0.034%; +0.034%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [18415198.452op/s; 18427899.679op/s] or [-0.034%; +0.034%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.912µs; 3.913µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255556608.838op/s; 255606051.424op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [50.596µs; 50.630µs] or [-0.033%; +0.033%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [19751217.512op/s; 19764377.292op/s] or [-0.033%; +0.033%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [45.627µs; 45.671µs] or [-0.048%; +0.048%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [21896200.449op/s; 21917337.502op/s] or [-0.048%; +0.048%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.436µs; 6.437µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [155356763.137op/s; 155386956.278op/s] or [-0.010%; +0.010%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 7380a63 1761591329 julio/fix-version-profiling-tests
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 10.692ms 10.717ms ± 0.016ms 10.716ms ± 0.008ms 10.723ms 10.735ms 10.753ms 10.835ms 1.11% 3.552 22.678 0.15% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [10.715ms; 10.719ms] or [-0.020%; +0.020%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 7380a63 1761591329 julio/fix-version-profiling-tests
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 161.607µs 162.636µs ± 0.356µs 162.585µs ± 0.158µs 162.753µs 163.114µs 163.967µs 165.143µs 1.57% 3.141 18.424 0.22% 0.025µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [162.586µs; 162.685µs] or [-0.030%; +0.030%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 7380a63 1761591329 julio/fix-version-profiling-tests
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 5.007µs 5.084µs ± 0.034µs 5.073µs ± 0.028µs 5.119µs 5.130µs 5.138µs 5.168µs 1.87% 0.083 -1.250 0.66% 0.002µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.079µs; 5.088µs] or [-0.092%; +0.092%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 7380a63 1761591329 julio/fix-version-profiling-tests
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2597 execution_time 6.042ms 6.313ms ± 0.131ms 6.385ms ± 0.027ms 6.401ms 6.427ms 6.477ms 6.542ms 2.46% -0.890 -0.839 2.06% 0.009ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2597 execution_time [6.295ms; 6.331ms] or [-0.287%; +0.287%] None None None

Group 15

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 7380a63 1761591329 julio/fix-version-profiling-tests
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 239.817ns 252.314ns ± 14.945ns 246.431ns ± 3.810ns 254.823ns 288.159ns 302.457ns 302.971ns 22.94% 1.871 2.800 5.91% 1.057ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [250.243ns; 254.385ns] or [-0.821%; +0.821%] None None None

Group 16

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 7380a63 1761591329 julio/fix-version-profiling-tests
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 63.103ms 63.650ms ± 2.464ms 63.330ms ± 0.069ms 63.392ms 63.732ms 82.577ms 84.806ms 33.91% 7.940 61.557 3.86% 0.174ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [63.309ms; 63.992ms] or [-0.537%; +0.537%] None None None

Group 17

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 7380a63 1761591329 julio/fix-version-profiling-tests
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.415µs 2.437µs ± 0.016µs 2.437µs ± 0.010µs 2.443µs 2.481µs 2.485µs 2.491µs 2.22% 1.283 1.893 0.67% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.435µs; 2.439µs] or [-0.093%; +0.093%] None None None

Baseline

Omitted due to size.

@hoolioh hoolioh marked this pull request as ready for review October 24, 2025 09:18
@hoolioh hoolioh requested a review from a team as a code owner October 24, 2025 09:18
@codecov-commenter
Copy link

codecov-commenter commented Oct 24, 2025 •
edited
Loading

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 71.92%. Comparing base (636b792) to head (7380a63).
⚠️ Report is 2 commits behind head on main.

Additional details and impacted files 
@@            Coverage Diff             @@
##             main    #1280      +/-   ##
==========================================
+ Coverage   71.80%   71.92%   +0.11%     
==========================================
  Files         368      368              
  Lines       57967    58150     +183     
==========================================
+ Hits        41626    41824     +198     
+ Misses      16341    16326      -15
Components Coverage Δ
datadog-crashtracker 50.65% <ø> (+1.62%) ⬆️
datadog-crashtracker-ffi 5.86% <ø> (ø)
datadog-alloc 98.73% <ø> (ø)
data-pipeline 87.86% <ø> (ø)
data-pipeline-ffi 88.19% <ø> (ø)
ddcommon 84.31% <ø> (ø)
ddcommon-ffi 73.84% <ø> (ø)
ddtelemetry 59.98% <ø> (-0.04%) ⬇️
ddtelemetry-ffi 21.24% <ø> (ø)
dogstatsd-client 83.26% <ø> (ø)
datadog-ipc 82.39% <ø> (ø)
datadog-profiling 76.91% <100.00%> (+0.01%) ⬆️
datadog-profiling-ffi 62.22% <100.00%> (+0.10%) ⬆️
datadog-sidecar 37.24% <ø> (ø)
datdog-sidecar-ffi 13.71% <ø> (ø)
spawn-worker 55.18% <ø> (ø)
tinybytes 92.44% <ø> (+0.21%) ⬆️
datadog-trace-normalization 98.24% <ø> (ø)
datadog-trace-obfuscation 94.17% <ø> (ø)
datadog-trace-protobuf 59.65% <ø> (ø)
datadog-trace-utils 90.00% <ø> (-0.01%) ⬇️
datadog-tracer-flare 61.03% <ø> (ø)
datadog-log 75.57% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@dd-octo-sts
Copy link

dd-octo-sts bot commented Oct 24, 2025 •
edited
Loading

Artifact Size Benchmark Report

aarch64-alpine-linux-musl
Artifact Baseline Commit Change
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so 7.25 MB 7.25 MB 0% (0 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.a 71.35 MB 71.35 MB 0% (0 B) 👌
aarch64-unknown-linux-gnu
Artifact Baseline Commit Change
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a 83.70 MB 83.70 MB 0% (0 B) 👌
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so 9.20 MB 9.20 MB 0% (0 B) 👌
libdatadog-x64-windows
Artifact Baseline Commit Change
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll 18.55 MB 18.55 MB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib 65.77 KB 65.77 KB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb 129.26 MB 129.24 MB --.01% (-16.00 KB) 💪
/libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib 677.95 MB 677.95 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll 5.93 MB 5.93 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib 65.77 KB 65.77 KB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb 17.51 MB 17.51 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib 32.46 MB 32.46 MB 0% (0 B) 👌
libdatadog-x86-windows
Artifact Baseline Commit Change
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll 15.81 MB 15.81 MB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib 66.79 KB 66.79 KB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb 131.42 MB 131.42 MB 0% (0 B) 👌
/libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib 666.48 MB 666.48 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll 4.54 MB 4.54 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib 66.79 KB 66.79 KB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb 18.66 MB 18.66 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib 30.52 MB 30.52 MB 0% (0 B) 👌
x86_64-alpine-linux-musl
Artifact Baseline Commit Change
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.a 63.95 MB 63.95 MB 0% (0 B) 👌
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so 8.56 MB 8.56 MB 0% (0 B) 👌
x86_64-unknown-linux-gnu
Artifact Baseline Commit Change
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a 78.42 MB 78.42 MB 0% (0 B) 👌
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so 9.91 MB 9.91 MB 0% (0 B) 👌

@hoolioh hoolioh requested a review from a team as a code owner October 27, 2025 18:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

profiling Relates to the profiling* modules.

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@hoolioh @codecov-commenter