Skip to content

chore(release): proposal for libdd-telemetry#1797

Closed
dd-octo-sts[bot] wants to merge 2 commits intorelease-testing/libdd-telemetry/20260325-164719from
release-proposal-testing/libdd-telemetry/20260325-164719
Closed

chore(release): proposal for libdd-telemetry#1797
dd-octo-sts[bot] wants to merge 2 commits intorelease-testing/libdd-telemetry/20260325-164719from
release-proposal-testing/libdd-telemetry/20260325-164719

Conversation

@dd-octo-sts
Copy link
Copy Markdown
Contributor

@dd-octo-sts dd-octo-sts Bot commented Mar 25, 2026

Release proposal for libdd-telemetry and its dependencies

This PR contains version bumps based on public API changes and commits since last release.

Cut from non-default ref

This proposal was generated from 5ff99ff6c465a95a740a494f42cce258c0e80be8 instead of the default latest origin/main.### Non-default workflow options

bypass_standard_checks was enabled: the ongoing-proposal branch guard was skipped; branches use proposal prefix release-proposal-testing and release prefix release-testing. Crates whose resolved git tag is not the latest SemVer tag for that crate are still included (normally skipped).## libdd-common
Next version: 3.0.1
Semver bump: patch
Tag: libdd-common-v3.0.1

Commits

libdd-telemetry

Next version: 3.1.0
Semver bump: minor
Tag: libdd-telemetry-v3.1.0

Commits

github-actions Bot and others added 2 commits March 25, 2026 16:52
Co-authored-by: iunanua <18325288+iunanua@users.noreply.github.com>
Co-authored-by: iunanua <18325288+iunanua@users.noreply.github.com>
@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Mar 25, 2026

Benchmarks

Comparison

Benchmark execution time: 2026-03-25 17:09:21

Comparing candidate commit 11783ad in PR branch release-proposal-testing/libdd-telemetry/20260325-164719 with baseline commit db9b9f4 in branch release-testing/libdd-telemetry/20260325-164719.

Found 5 performance improvements and 12 performance regressions! Performance is the same for 44 metrics, 0 unstable metrics.

Explanation

This is an A/B test comparing a candidate commit's performance against that of a baseline commit. Performance changes are noted in the tables below as:

  • 🟩 = significantly better candidate vs. baseline
  • 🟥 = significantly worse candidate vs. baseline

We compute a confidence interval (CI) over the relative difference of means between metrics from the candidate and baseline commits, considering the baseline as the reference.

If the CI is entirely outside the configured SIGNIFICANT_IMPACT_THRESHOLD (or the deprecated UNCONFIDENCE_THRESHOLD), the change is considered significant.

Feel free to reach out to #apm-benchmarking-platform on Slack if you have any questions.

More details about the CI and significant changes

You can imagine this CI as a range of values that is likely to contain the true difference of means between the candidate and baseline commits.

CIs of the difference of means are often centered around 0%, because often changes are not that big:

---------------------------------(------|---^--------)-------------------------------->
                              -0.6%    0%  0.3%     +1.2%
                                 |          |        |
         lower bound of the CI --'          |        |
sample mean (center of the CI) -------------'        |
         upper bound of the CI ----------------------'

As described above, a change is considered significant if the CI is entirely outside the configured SIGNIFICANT_IMPACT_THRESHOLD (or the deprecated UNCONFIDENCE_THRESHOLD).

For instance, for an execution time metric, this confidence interval indicates a significantly worse performance:

----------------------------------------|---------|---(---------^---------)---------->
                                       0%        1%  1.3%      2.2%      3.1%
                                                  |   |         |         |
       significant impact threshold --------------'   |         |         |
                      lower bound of CI --------------'         |         |
       sample mean (center of the CI) --------------------------'         |
                      upper bound of CI ----------------------------------'

scenario:credit_card/is_card_number/ 378282246310005

  • 🟥 execution_time [+4.968µs; +5.067µs] or [+7.309%; +7.455%]
  • 🟥 throughput [-1020574.080op/s; -1001770.197op/s] or [-6.936%; -6.809%]

scenario:credit_card/is_card_number/378282246310005

  • 🟥 execution_time [+4.796µs; +4.875µs] or [+7.388%; +7.511%]
  • 🟥 throughput [-1076132.561op/s; -1059648.982op/s] or [-6.985%; -6.878%]

scenario:credit_card/is_card_number/37828224631000521389798

  • 🟥 execution_time [+6.540µs; +6.562µs] or [+14.322%; +14.370%]
  • 🟥 throughput [-2752506.093op/s; -2742563.106op/s] or [-12.569%; -12.524%]

scenario:credit_card/is_card_number/x371413321323331

  • 🟩 execution_time [-800.728ns; -797.793ns] or [-11.711%; -11.668%]
  • 🟩 throughput [+19321430.854op/s; +19397677.183op/s] or [+13.211%; +13.263%]

scenario:credit_card/is_card_number_no_luhn/ 378282246310005

  • 🟥 execution_time [+4.819µs; +4.855µs] or [+9.019%; +9.087%]
  • 🟥 throughput [-1559242.779op/s; -1548151.600op/s] or [-8.331%; -8.272%]

scenario:credit_card/is_card_number_no_luhn/378282246310005

  • 🟥 execution_time [+4.508µs; +4.565µs] or [+8.977%; +9.090%]
  • 🟥 throughput [-1659015.998op/s; -1639963.186op/s] or [-8.332%; -8.236%]

scenario:credit_card/is_card_number_no_luhn/37828224631000521389798

  • 🟥 execution_time [+6.546µs; +6.568µs] or [+14.333%; +14.381%]
  • 🟥 throughput [-2754044.283op/s; -2744061.869op/s] or [-12.577%; -12.532%]

scenario:credit_card/is_card_number_no_luhn/x371413321323331

  • 🟩 execution_time [-797.139ns; -793.525ns] or [-11.659%; -11.606%]
  • 🟩 throughput [+19205021.595op/s; +19301235.649op/s] or [+13.131%; +13.197%]

scenario:sql/obfuscate_sql_string

  • 🟩 execution_time [-202.302µs; -202.140µs] or [-70.392%; -70.335%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 11783ad 1774457560 release-proposal-testing/libdd-telemetry/20260325-164719
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 185.555µs 186.003µs ± 0.250µs 185.979µs ± 0.174µs 186.153µs 186.490µs 186.708µs 186.741µs 0.41% 0.693 0.221 0.13% 0.018µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 5354998.228op/s 5376272.952op/s ± 7219.231op/s 5376955.137op/s ± 5032.441op/s 5381969.655op/s 5385822.446op/s 5388035.966op/s 5389234.788op/s 0.23% -0.686 0.207 0.13% 510.477op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 17.899µs 17.998µs ± 0.045µs 17.990µs ± 0.025µs 18.022µs 18.068µs 18.129µs 18.260µs 1.50% 1.447 5.341 0.25% 0.003µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 54763554.900op/s 55561315.611op/s ± 138695.912op/s 55584917.990op/s ± 78573.286op/s 55656318.958op/s 55745588.939op/s 55777109.314op/s 55867521.674op/s 0.51% -1.408 5.100 0.25% 9807.282op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.110µs 10.220µs ± 0.091µs 10.187µs ± 0.026µs 10.226µs 10.437µs 10.511µs 10.517µs 3.23% 1.756 2.247 0.89% 0.006µs 1 200
normalization/normalize_name/normalize_name/good throughput 95087985.201op/s 97856284.330op/s ± 859788.351op/s 98160677.137op/s ± 245959.279op/s 98379990.878op/s 98578660.069op/s 98800145.754op/s 98916045.007op/s 0.77% -1.725 2.134 0.88% 60796.217op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [185.968µs; 186.037µs] or [-0.019%; +0.019%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [5375272.436op/s; 5377273.468op/s] or [-0.019%; +0.019%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [17.992µs; 18.004µs] or [-0.035%; +0.035%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [55542093.691op/s; 55580537.530op/s] or [-0.035%; +0.035%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.207µs; 10.233µs] or [-0.124%; +0.124%] None None None
normalization/normalize_name/normalize_name/good throughput [97737125.934op/s; 97975442.727op/s] or [-0.122%; +0.122%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 11783ad 1774457560 release-proposal-testing/libdd-telemetry/20260325-164719
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 495.262µs 496.343µs ± 0.547µs 496.273µs ± 0.277µs 496.556µs 497.095µs 497.301µs 501.302µs 1.01% 3.790 32.080 0.11% 0.039µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1994805.969op/s 2014739.790op/s ± 2210.531op/s 2015018.493op/s ± 1125.427op/s 2016024.765op/s 2017224.384op/s 2018471.168op/s 2019134.440op/s 0.20% -3.725 31.324 0.11% 156.308op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 371.286µs 372.298µs ± 0.372µs 372.276µs ± 0.274µs 372.576µs 372.915µs 373.160µs 373.247µs 0.26% 0.063 -0.209 0.10% 0.026µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2679188.495op/s 2686022.129op/s ± 2686.934op/s 2686182.210op/s ± 1973.468op/s 2687687.264op/s 2690428.642op/s 2692171.513op/s 2693344.360op/s 0.27% -0.057 -0.208 0.10% 189.995op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 167.741µs 168.069µs ± 0.156µs 168.056µs ± 0.091µs 168.153µs 168.358µs 168.471µs 168.719µs 0.39% 0.778 1.240 0.09% 0.011µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5927018.008op/s 5949948.675op/s ± 5517.783op/s 5950384.312op/s ± 3215.047op/s 5953486.518op/s 5957453.075op/s 5959835.616op/s 5961578.321op/s 0.19% -0.771 1.218 0.09% 390.166op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 38.277µs 38.378µs ± 0.044µs 38.373µs ± 0.028µs 38.402µs 38.462µs 38.497µs 38.533µs 0.41% 0.594 0.676 0.12% 0.003µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 25952110.227op/s 26056395.937op/s ± 30167.757op/s 26059773.273op/s ± 18704.250op/s 26076093.447op/s 26101653.093op/s 26112534.486op/s 26125176.738op/s 0.25% -0.586 0.660 0.12% 2133.183op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 46.222µs 46.330µs ± 0.129µs 46.315µs ± 0.036µs 46.350µs 46.437µs 46.503µs 47.940µs 3.51% 9.943 120.975 0.28% 0.009µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 20859223.879op/s 21584459.862op/s ± 58377.412op/s 21591391.081op/s ± 16777.673op/s 21608074.074op/s 21624520.219op/s 21632979.339op/s 21634813.010op/s 0.20% -9.743 117.562 0.27% 4127.906op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [496.267µs; 496.418µs] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [2014433.432op/s; 2015046.149op/s] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [372.247µs; 372.350µs] or [-0.014%; +0.014%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2685649.745op/s; 2686394.512op/s] or [-0.014%; +0.014%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [168.047µs; 168.090µs] or [-0.013%; +0.013%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5949183.963op/s; 5950713.387op/s] or [-0.013%; +0.013%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [38.372µs; 38.385µs] or [-0.016%; +0.016%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [26052214.976op/s; 26060576.898op/s] or [-0.016%; +0.016%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [46.312µs; 46.348µs] or [-0.039%; +0.039%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [21576369.315op/s; 21592550.410op/s] or [-0.037%; +0.037%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 11783ad 1774457560 release-proposal-testing/libdd-telemetry/20260325-164719
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.276µs 2.364µs ± 0.023µs 2.361µs ± 0.009µs 2.375µs 2.414µs 2.421µs 2.427µs 2.79% -0.350 2.606 0.99% 0.002µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.360µs; 2.367µs] or [-0.137%; +0.137%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 11783ad 1774457560 release-proposal-testing/libdd-telemetry/20260325-164719
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 13.822µs 13.941µs ± 0.057µs 13.935µs ± 0.040µs 13.980µs 14.018µs 14.039µs 14.324µs 2.80% 1.505 8.782 0.41% 0.004µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [13.933µs; 13.949µs] or [-0.057%; +0.057%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 11783ad 1774457560 release-proposal-testing/libdd-telemetry/20260325-164719
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 240.214ns 251.020ns ± 14.548ns 244.718ns ± 2.735ns 252.464ns 285.147ns 300.312ns 303.349ns 23.96% 1.948 2.924 5.78% 1.029ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [249.003ns; 253.036ns] or [-0.803%; +0.803%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 11783ad 1774457560 release-proposal-testing/libdd-telemetry/20260325-164719
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 160.021µs 160.854µs ± 0.285µs 160.815µs ± 0.118µs 160.937µs 161.311µs 161.871µs 162.457µs 1.02% 1.574 6.369 0.18% 0.020µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [160.814µs; 160.893µs] or [-0.025%; +0.025%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 11783ad 1774457560 release-proposal-testing/libdd-telemetry/20260325-164719
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
single_flag_killswitch/rules-based execution_time 191.128ns 193.853ns ± 2.730ns 193.360ns ± 1.574ns 194.951ns 197.404ns 202.779ns 215.102ns 11.24% 3.172 18.388 1.40% 0.193ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
single_flag_killswitch/rules-based execution_time [193.475ns; 194.231ns] or [-0.195%; +0.195%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 11783ad 1774457560 release-proposal-testing/libdd-telemetry/20260325-164719
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sdk_test_data/rules-based execution_time 144.817µs 146.624µs ± 1.691µs 146.303µs ± 0.516µs 146.927µs 148.121µs 153.384µs 162.253µs 10.90% 5.531 41.890 1.15% 0.120µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sdk_test_data/rules-based execution_time [146.389µs; 146.858µs] or [-0.160%; +0.160%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 11783ad 1774457560 release-proposal-testing/libdd-telemetry/20260325-164719
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2598 execution_time 3.439ms 3.472ms ± 0.026ms 3.462ms ± 0.010ms 3.480ms 3.531ms 3.546ms 3.563ms 2.90% 1.420 1.321 0.76% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2598 execution_time [3.468ms; 3.475ms] or [-0.105%; +0.105%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 11783ad 1774457560 release-proposal-testing/libdd-telemetry/20260325-164719
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 13.226ms 13.271ms ± 0.022ms 13.269ms ± 0.011ms 13.282ms 13.299ms 13.322ms 13.452ms 1.38% 2.739 20.036 0.17% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [13.268ms; 13.274ms] or [-0.023%; +0.023%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 11783ad 1774457560 release-proposal-testing/libdd-telemetry/20260325-164719
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 5.510µs 5.540µs ± 0.021µs 5.533µs ± 0.009µs 5.547µs 5.574µs 5.631µs 5.668µs 2.44% 2.315 8.607 0.38% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [5.537µs; 5.543µs] or [-0.053%; +0.053%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 11783ad 1774457560 release-proposal-testing/libdd-telemetry/20260325-164719
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.894µs 3.914µs ± 0.003µs 3.913µs ± 0.002µs 3.915µs 3.919µs 3.920µs 3.923µs 0.25% -0.947 6.182 0.08% 0.000µs 1 200
credit_card/is_card_number/ throughput 254894477.576op/s 255523010.916op/s ± 208236.902op/s 255531773.020op/s ± 120534.695op/s 255630336.930op/s 255833065.216op/s 255917123.286op/s 256808360.378op/s 0.50% 0.965 6.290 0.08% 14724.573op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 78.781µs 79.579µs ± 0.369µs 79.525µs ± 0.271µs 79.864µs 80.229µs 80.516µs 80.771µs 1.57% 0.467 -0.278 0.46% 0.026µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12380723.763op/s 12566420.068op/s ± 58183.779op/s 12574632.565op/s ± 42854.227op/s 12613209.506op/s 12644873.454op/s 12666551.355op/s 12693401.859op/s 0.94% -0.446 -0.312 0.46% 4114.214op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 72.400µs 72.984µs ± 0.344µs 72.945µs ± 0.247µs 73.210µs 73.618µs 73.900µs 74.065µs 1.54% 0.712 0.060 0.47% 0.024µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 13501609.040op/s 13701993.141op/s ± 64352.101op/s 13709024.866op/s ± 46404.105op/s 13752968.630op/s 13784303.140op/s 13802682.531op/s 13812175.433op/s 0.75% -0.691 0.014 0.47% 4550.381op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.899µs 3.914µs ± 0.003µs 3.914µs ± 0.002µs 3.916µs 3.918µs 3.921µs 3.929µs 0.38% -0.025 5.242 0.08% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 254507196.998op/s 255488049.426op/s ± 197243.828op/s 255478711.482op/s ± 102140.442op/s 255594638.903op/s 255796843.371op/s 255923830.411op/s 256463486.914op/s 0.39% 0.042 5.236 0.08% 13947.245op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 69.174µs 69.745µs ± 0.283µs 69.752µs ± 0.222µs 69.960µs 70.250µs 70.344µs 70.397µs 0.93% 0.153 -0.806 0.41% 0.020µs 1 200
credit_card/is_card_number/378282246310005 throughput 14205055.500op/s 14338230.990op/s ± 58226.427op/s 14336567.191op/s ± 45611.168op/s 14386237.104op/s 14425695.555op/s 14441374.336op/s 14456314.573op/s 0.84% -0.139 -0.814 0.41% 4117.230op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 52.135µs 52.216µs ± 0.035µs 52.217µs ± 0.021µs 52.237µs 52.273µs 52.292µs 52.321µs 0.20% -0.004 -0.168 0.07% 0.002µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 19112828.301op/s 19151383.083op/s ± 12703.831op/s 19150902.831op/s ± 7643.451op/s 19159078.603op/s 19173427.930op/s 19179312.005op/s 19180966.727op/s 0.16% 0.008 -0.170 0.07% 898.296op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.027µs 6.038µs ± 0.009µs 6.037µs ± 0.003µs 6.039µs 6.049µs 6.077µs 6.080µs 0.72% 2.992 9.812 0.15% 0.001µs 1 200
credit_card/is_card_number/x371413321323331 throughput 164479385.499op/s 165613206.247op/s ± 251345.303op/s 165656082.870op/s ± 79447.360op/s 165736015.405op/s 165855492.093op/s 165897655.897op/s 165908606.599op/s 0.15% -2.978 9.747 0.15% 17772.797op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.895µs 3.913µs ± 0.003µs 3.913µs ± 0.002µs 3.914µs 3.917µs 3.919µs 3.919µs 0.18% -1.018 6.972 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 255137257.556op/s 255587421.346op/s ± 183282.675op/s 255585367.738op/s ± 111827.141op/s 255699236.882op/s 255838164.877op/s 255950149.028op/s 256750008.965op/s 0.46% 1.035 7.082 0.07% 12960.042op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 63.792µs 64.335µs ± 0.195µs 64.300µs ± 0.092µs 64.417µs 64.749µs 64.864µs 64.967µs 1.04% 0.593 1.112 0.30% 0.014µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15392426.965op/s 15543717.767op/s ± 47086.699op/s 15552023.563op/s ± 22329.715op/s 15570029.640op/s 15610572.579op/s 15663614.044op/s 15675855.465op/s 0.80% -0.568 1.098 0.30% 3329.532op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 58.097µs 58.266µs ± 0.121µs 58.222µs ± 0.056µs 58.321µs 58.544µs 58.611µs 58.712µs 0.84% 1.310 1.273 0.21% 0.009µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 17032365.753op/s 17162796.473op/s ± 35534.362op/s 17175512.014op/s ± 16411.789op/s 17186173.723op/s 17200432.592op/s 17212261.723op/s 17212653.021op/s 0.22% -1.300 1.241 0.21% 2512.659op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.897µs 3.913µs ± 0.003µs 3.913µs ± 0.002µs 3.915µs 3.918µs 3.920µs 3.920µs 0.19% -0.537 3.856 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 255076124.655op/s 255561750.705op/s ± 185743.064op/s 255550934.223op/s ± 105220.651op/s 255684574.066op/s 255855932.694op/s 255899203.022op/s 256582814.814op/s 0.40% 0.549 3.911 0.07% 13134.018op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 54.544µs 54.757µs ± 0.203µs 54.683µs ± 0.073µs 54.819µs 55.179µs 55.590µs 55.635µs 1.74% 2.060 4.707 0.37% 0.014µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 17974360.312op/s 18262668.458op/s ± 67253.656op/s 18287360.691op/s ± 24272.479op/s 18305581.374op/s 18321675.184op/s 18331008.589op/s 18333763.459op/s 0.25% -2.033 4.563 0.37% 4755.552op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 52.132µs 52.226µs ± 0.034µs 52.226µs ± 0.022µs 52.248µs 52.278µs 52.309µs 52.326µs 0.19% 0.061 0.143 0.07% 0.002µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 19111110.403op/s 19147582.796op/s ± 12513.350op/s 19147551.030op/s ± 7994.695op/s 19155517.058op/s 19166757.465op/s 19176090.188op/s 19181922.956op/s 0.18% -0.056 0.141 0.07% 884.827op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.028µs 6.042µs ± 0.012µs 6.039µs ± 0.003µs 6.042µs 6.075µs 6.085µs 6.119µs 1.32% 3.288 12.621 0.20% 0.001µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 163423364.212op/s 165510038.675op/s ± 334363.724op/s 165587887.249op/s ± 76064.303op/s 165663395.250op/s 165769203.947op/s 165819385.034op/s 165878775.871op/s 0.18% -3.265 12.417 0.20% 23643.086op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.913µs; 3.914µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/ throughput [255494151.284op/s; 255551870.548op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [79.528µs; 79.630µs] or [-0.064%; +0.064%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12558356.356op/s; 12574483.781op/s] or [-0.064%; +0.064%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [72.936µs; 73.031µs] or [-0.065%; +0.065%] None None None
credit_card/is_card_number/ 378282246310005 throughput [13693074.559op/s; 13710911.723op/s] or [-0.065%; +0.065%] None None None
credit_card/is_card_number/37828224631 execution_time [3.914µs; 3.914µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/37828224631 throughput [255460713.329op/s; 255515385.524op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/378282246310005 execution_time [69.705µs; 69.784µs] or [-0.056%; +0.056%] None None None
credit_card/is_card_number/378282246310005 throughput [14330161.367op/s; 14346300.612op/s] or [-0.056%; +0.056%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [52.211µs; 52.220µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [19149622.454op/s; 19153143.711op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.037µs; 6.039µs] or [-0.021%; +0.021%] None None None
credit_card/is_card_number/x371413321323331 throughput [165578372.205op/s; 165648040.288op/s] or [-0.021%; +0.021%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.912µs; 3.913µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ throughput [255562020.130op/s; 255612822.562op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [64.308µs; 64.362µs] or [-0.042%; +0.042%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15537192.004op/s; 15550243.531op/s] or [-0.042%; +0.042%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [58.249µs; 58.283µs] or [-0.029%; +0.029%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [17157871.752op/s; 17167721.194op/s] or [-0.029%; +0.029%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.913µs; 3.913µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255536008.502op/s; 255587492.907op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [54.729µs; 54.785µs] or [-0.051%; +0.051%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [18253347.748op/s; 18271989.168op/s] or [-0.051%; +0.051%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [52.221µs; 52.231µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [19145848.566op/s; 19149317.026op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.040µs; 6.044µs] or [-0.028%; +0.028%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [165463699.079op/s; 165556378.271op/s] or [-0.028%; +0.028%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 11783ad 1774457560 release-proposal-testing/libdd-telemetry/20260325-164719
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 84.907µs 85.174µs ± 0.272µs 85.138µs ± 0.058µs 85.220µs 85.337µs 85.450µs 88.723µs 4.21% 11.267 144.306 0.32% 0.019µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [85.137µs; 85.212µs] or [-0.044%; +0.044%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 11783ad 1774457560 release-proposal-testing/libdd-telemetry/20260325-164719
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 14.073ms 14.115ms ± 0.030ms 14.111ms ± 0.010ms 14.121ms 14.156ms 14.243ms 14.306ms 1.39% 3.202 14.068 0.21% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [14.111ms; 14.119ms] or [-0.030%; +0.030%] None None None

Group 15

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 11783ad 1774457560 release-proposal-testing/libdd-telemetry/20260325-164719
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 34.938µs 35.287µs ± 0.529µs 35.067µs ± 0.054µs 35.196µs 36.218µs 36.251µs 39.634µs 13.03% 3.581 21.558 1.50% 0.037µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [35.214µs; 35.360µs] or [-0.208%; +0.208%] None None None

Group 16

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 11783ad 1774457560 release-proposal-testing/libdd-telemetry/20260325-164719
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 4.971µs 5.052µs ± 0.046µs 5.056µs ± 0.044µs 5.091µs 5.123µs 5.125µs 5.128µs 1.41% 0.043 -1.399 0.90% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.046µs; 5.059µs] or [-0.125%; +0.125%] None None None

Group 17

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 11783ad 1774457560 release-proposal-testing/libdd-telemetry/20260325-164719
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 49.778ms 50.021ms ± 0.651ms 49.917ms ± 0.065ms 49.991ms 50.250ms 52.835ms 57.349ms 14.89% 8.754 86.472 1.30% 0.046ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [49.930ms; 50.111ms] or [-0.180%; +0.180%] None None None

Group 18

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 11783ad 1774457560 release-proposal-testing/libdd-telemetry/20260325-164719
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample2_frames_x1000 execution_time 737.592µs 738.628µs ± 0.486µs 738.553µs ± 0.338µs 738.960µs 739.539µs 739.827µs 740.352µs 0.24% 0.571 0.137 0.07% 0.034µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample2_frames_x1000 execution_time [738.561µs; 738.695µs] or [-0.009%; +0.009%] None None None

Group 19

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 11783ad 1774457560 release-proposal-testing/libdd-telemetry/20260325-164719
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample_frames_x1000 execution_time 4.224ms 4.227ms ± 0.002ms 4.227ms ± 0.001ms 4.228ms 4.231ms 4.233ms 4.236ms 0.21% 0.983 1.390 0.05% 0.000ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample_frames_x1000 execution_time [4.227ms; 4.228ms] or [-0.007%; +0.007%] None None None

Group 20

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 11783ad 1774457560 release-proposal-testing/libdd-telemetry/20260325-164719
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample_timestamped_x1000 execution_time 4.190ms 4.196ms ± 0.009ms 4.194ms ± 0.002ms 4.196ms 4.201ms 4.229ms 4.296ms 2.42% 7.283 67.219 0.22% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample_timestamped_x1000 execution_time [4.195ms; 4.198ms] or [-0.031%; +0.031%] None None None

Baseline

Omitted due to size.

@dd-octo-sts
Copy link
Copy Markdown
Contributor Author

dd-octo-sts Bot commented Mar 25, 2026

Artifact Size Benchmark Report

aarch64-alpine-linux-musl
Artifact Baseline Commit Change
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so 8.70 MB 8.70 MB 0% (0 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.a 101.43 MB 101.43 MB -0% (-944 B) 👌
aarch64-unknown-linux-gnu
Artifact Baseline Commit Change
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so 11.29 MB 11.29 MB 0% (0 B) 👌
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a 118.20 MB 118.20 MB -0% (-2.28 KB) 👌
libdatadog-x64-windows
Artifact Baseline Commit Change
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll 27.24 MB 27.25 MB +.04% (+13.50 KB) 🔍
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib 80.34 KB 80.34 KB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb 186.42 MB 186.51 MB +.05% (+96.00 KB) 🔍
/libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib 922.07 MB 921.92 MB --.01% (-150.07 KB) 💪
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll 8.99 MB 8.99 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib 80.34 KB 80.34 KB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb 26.83 MB 26.83 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib 61.00 MB 61.00 MB -0% (-322 B) 👌
libdatadog-x86-windows
Artifact Baseline Commit Change
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll 23.07 MB 23.07 MB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib 81.59 KB 81.59 KB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb 190.58 MB 190.60 MB +.01% (+24.00 KB) 🔍
/libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib 905.12 MB 905.43 MB +.03% (+320.05 KB) 🔍
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll 6.86 MB 6.86 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib 81.59 KB 81.59 KB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb 28.94 MB 28.94 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib 57.38 MB 57.38 MB -0% (-1.38 KB) 👌
x86_64-alpine-linux-musl
Artifact Baseline Commit Change
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.a 88.28 MB 88.29 MB +0% (+1.92 KB) 👌
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so 10.28 MB 10.28 MB 0% (0 B) 👌
x86_64-unknown-linux-gnu
Artifact Baseline Commit Change
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a 110.95 MB 110.95 MB +0% (+1.42 KB) 👌
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so 12.02 MB 12.02 MB +0% (+168 B) 👌

@iunanua iunanua closed this Mar 26, 2026
@iunanua iunanua deleted the release-proposal-testing/libdd-telemetry/20260325-164719 branch March 30, 2026 08:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant