chore(release): proposal for libdd-telemetry#1797
Conversation
Co-authored-by: iunanua <18325288+iunanua@users.noreply.github.com>
Co-authored-by: iunanua <18325288+iunanua@users.noreply.github.com>
BenchmarksComparisonBenchmark execution time: 2026-03-25 17:09:21 Comparing candidate commit 11783ad in PR branch Found 5 performance improvements and 12 performance regressions! Performance is the same for 44 metrics, 0 unstable metrics.
|
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 11783ad | 1774457560 | release-proposal-testing/libdd-telemetry/20260325-164719 |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | execution_time | 185.555µs | 186.003µs ± 0.250µs | 185.979µs ± 0.174µs | 186.153µs | 186.490µs | 186.708µs | 186.741µs | 0.41% | 0.693 | 0.221 | 0.13% | 0.018µs | 1 | 200 |
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | throughput | 5354998.228op/s | 5376272.952op/s ± 7219.231op/s | 5376955.137op/s ± 5032.441op/s | 5381969.655op/s | 5385822.446op/s | 5388035.966op/s | 5389234.788op/s | 0.23% | -0.686 | 0.207 | 0.13% | 510.477op/s | 1 | 200 |
| normalization/normalize_name/normalize_name/bad-name | execution_time | 17.899µs | 17.998µs ± 0.045µs | 17.990µs ± 0.025µs | 18.022µs | 18.068µs | 18.129µs | 18.260µs | 1.50% | 1.447 | 5.341 | 0.25% | 0.003µs | 1 | 200 |
| normalization/normalize_name/normalize_name/bad-name | throughput | 54763554.900op/s | 55561315.611op/s ± 138695.912op/s | 55584917.990op/s ± 78573.286op/s | 55656318.958op/s | 55745588.939op/s | 55777109.314op/s | 55867521.674op/s | 0.51% | -1.408 | 5.100 | 0.25% | 9807.282op/s | 1 | 200 |
| normalization/normalize_name/normalize_name/good | execution_time | 10.110µs | 10.220µs ± 0.091µs | 10.187µs ± 0.026µs | 10.226µs | 10.437µs | 10.511µs | 10.517µs | 3.23% | 1.756 | 2.247 | 0.89% | 0.006µs | 1 | 200 |
| normalization/normalize_name/normalize_name/good | throughput | 95087985.201op/s | 97856284.330op/s ± 859788.351op/s | 98160677.137op/s ± 245959.279op/s | 98379990.878op/s | 98578660.069op/s | 98800145.754op/s | 98916045.007op/s | 0.77% | -1.725 | 2.134 | 0.88% | 60796.217op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | execution_time | [185.968µs; 186.037µs] or [-0.019%; +0.019%] | None | None | None |
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | throughput | [5375272.436op/s; 5377273.468op/s] or [-0.019%; +0.019%] | None | None | None |
| normalization/normalize_name/normalize_name/bad-name | execution_time | [17.992µs; 18.004µs] or [-0.035%; +0.035%] | None | None | None |
| normalization/normalize_name/normalize_name/bad-name | throughput | [55542093.691op/s; 55580537.530op/s] or [-0.035%; +0.035%] | None | None | None |
| normalization/normalize_name/normalize_name/good | execution_time | [10.207µs; 10.233µs] or [-0.124%; +0.124%] | None | None | None |
| normalization/normalize_name/normalize_name/good | throughput | [97737125.934op/s; 97975442.727op/s] or [-0.122%; +0.122%] | None | None | None |
Group 2
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 11783ad | 1774457560 | release-proposal-testing/libdd-telemetry/20260325-164719 |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | execution_time | 495.262µs | 496.343µs ± 0.547µs | 496.273µs ± 0.277µs | 496.556µs | 497.095µs | 497.301µs | 501.302µs | 1.01% | 3.790 | 32.080 | 0.11% | 0.039µs | 1 | 200 |
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | throughput | 1994805.969op/s | 2014739.790op/s ± 2210.531op/s | 2015018.493op/s ± 1125.427op/s | 2016024.765op/s | 2017224.384op/s | 2018471.168op/s | 2019134.440op/s | 0.20% | -3.725 | 31.324 | 0.11% | 156.308op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | execution_time | 371.286µs | 372.298µs ± 0.372µs | 372.276µs ± 0.274µs | 372.576µs | 372.915µs | 373.160µs | 373.247µs | 0.26% | 0.063 | -0.209 | 0.10% | 0.026µs | 1 | 200 |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | throughput | 2679188.495op/s | 2686022.129op/s ± 2686.934op/s | 2686182.210op/s ± 1973.468op/s | 2687687.264op/s | 2690428.642op/s | 2692171.513op/s | 2693344.360op/s | 0.27% | -0.057 | -0.208 | 0.10% | 189.995op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | execution_time | 167.741µs | 168.069µs ± 0.156µs | 168.056µs ± 0.091µs | 168.153µs | 168.358µs | 168.471µs | 168.719µs | 0.39% | 0.778 | 1.240 | 0.09% | 0.011µs | 1 | 200 |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | throughput | 5927018.008op/s | 5949948.675op/s ± 5517.783op/s | 5950384.312op/s ± 3215.047op/s | 5953486.518op/s | 5957453.075op/s | 5959835.616op/s | 5961578.321op/s | 0.19% | -0.771 | 1.218 | 0.09% | 390.166op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/[empty string] | execution_time | 38.277µs | 38.378µs ± 0.044µs | 38.373µs ± 0.028µs | 38.402µs | 38.462µs | 38.497µs | 38.533µs | 0.41% | 0.594 | 0.676 | 0.12% | 0.003µs | 1 | 200 |
| normalization/normalize_service/normalize_service/[empty string] | throughput | 25952110.227op/s | 26056395.937op/s ± 30167.757op/s | 26059773.273op/s ± 18704.250op/s | 26076093.447op/s | 26101653.093op/s | 26112534.486op/s | 26125176.738op/s | 0.25% | -0.586 | 0.660 | 0.12% | 2133.183op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/test_ASCII | execution_time | 46.222µs | 46.330µs ± 0.129µs | 46.315µs ± 0.036µs | 46.350µs | 46.437µs | 46.503µs | 47.940µs | 3.51% | 9.943 | 120.975 | 0.28% | 0.009µs | 1 | 200 |
| normalization/normalize_service/normalize_service/test_ASCII | throughput | 20859223.879op/s | 21584459.862op/s ± 58377.412op/s | 21591391.081op/s ± 16777.673op/s | 21608074.074op/s | 21624520.219op/s | 21632979.339op/s | 21634813.010op/s | 0.20% | -9.743 | 117.562 | 0.27% | 4127.906op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | execution_time | [496.267µs; 496.418µs] or [-0.015%; +0.015%] | None | None | None |
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | throughput | [2014433.432op/s; 2015046.149op/s] or [-0.015%; +0.015%] | None | None | None |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | execution_time | [372.247µs; 372.350µs] or [-0.014%; +0.014%] | None | None | None |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | throughput | [2685649.745op/s; 2686394.512op/s] or [-0.014%; +0.014%] | None | None | None |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | execution_time | [168.047µs; 168.090µs] or [-0.013%; +0.013%] | None | None | None |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | throughput | [5949183.963op/s; 5950713.387op/s] or [-0.013%; +0.013%] | None | None | None |
| normalization/normalize_service/normalize_service/[empty string] | execution_time | [38.372µs; 38.385µs] or [-0.016%; +0.016%] | None | None | None |
| normalization/normalize_service/normalize_service/[empty string] | throughput | [26052214.976op/s; 26060576.898op/s] or [-0.016%; +0.016%] | None | None | None |
| normalization/normalize_service/normalize_service/test_ASCII | execution_time | [46.312µs; 46.348µs] or [-0.039%; +0.039%] | None | None | None |
| normalization/normalize_service/normalize_service/test_ASCII | throughput | [21576369.315op/s; 21592550.410op/s] or [-0.037%; +0.037%] | None | None | None |
Group 3
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 11783ad | 1774457560 | release-proposal-testing/libdd-telemetry/20260325-164719 |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| tags/replace_trace_tags | execution_time | 2.276µs | 2.364µs ± 0.023µs | 2.361µs ± 0.009µs | 2.375µs | 2.414µs | 2.421µs | 2.427µs | 2.79% | -0.350 | 2.606 | 0.99% | 0.002µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| tags/replace_trace_tags | execution_time | [2.360µs; 2.367µs] or [-0.137%; +0.137%] | None | None | None |
Group 4
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 11783ad | 1774457560 | release-proposal-testing/libdd-telemetry/20260325-164719 |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| two way interface | execution_time | 13.822µs | 13.941µs ± 0.057µs | 13.935µs ± 0.040µs | 13.980µs | 14.018µs | 14.039µs | 14.324µs | 2.80% | 1.505 | 8.782 | 0.41% | 0.004µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| two way interface | execution_time | [13.933µs; 13.949µs] or [-0.057%; +0.057%] | None | None | None |
Group 5
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 11783ad | 1774457560 | release-proposal-testing/libdd-telemetry/20260325-164719 |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_trace/test_trace | execution_time | 240.214ns | 251.020ns ± 14.548ns | 244.718ns ± 2.735ns | 252.464ns | 285.147ns | 300.312ns | 303.349ns | 23.96% | 1.948 | 2.924 | 5.78% | 1.029ns | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_trace/test_trace | execution_time | [249.003ns; 253.036ns] or [-0.803%; +0.803%] | None | None | None |
Group 6
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 11783ad | 1774457560 | release-proposal-testing/libdd-telemetry/20260325-164719 |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching string interning on wordpress profile | execution_time | 160.021µs | 160.854µs ± 0.285µs | 160.815µs ± 0.118µs | 160.937µs | 161.311µs | 161.871µs | 162.457µs | 1.02% | 1.574 | 6.369 | 0.18% | 0.020µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching string interning on wordpress profile | execution_time | [160.814µs; 160.893µs] or [-0.025%; +0.025%] | None | None | None |
Group 7
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 11783ad | 1774457560 | release-proposal-testing/libdd-telemetry/20260325-164719 |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| single_flag_killswitch/rules-based | execution_time | 191.128ns | 193.853ns ± 2.730ns | 193.360ns ± 1.574ns | 194.951ns | 197.404ns | 202.779ns | 215.102ns | 11.24% | 3.172 | 18.388 | 1.40% | 0.193ns | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| single_flag_killswitch/rules-based | execution_time | [193.475ns; 194.231ns] or [-0.195%; +0.195%] | None | None | None |
Group 8
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 11783ad | 1774457560 | release-proposal-testing/libdd-telemetry/20260325-164719 |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| sdk_test_data/rules-based | execution_time | 144.817µs | 146.624µs ± 1.691µs | 146.303µs ± 0.516µs | 146.927µs | 148.121µs | 153.384µs | 162.253µs | 10.90% | 5.531 | 41.890 | 1.15% | 0.120µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| sdk_test_data/rules-based | execution_time | [146.389µs; 146.858µs] or [-0.160%; +0.160%] | None | None | None |
Group 9
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 11783ad | 1774457560 | release-proposal-testing/libdd-telemetry/20260325-164719 |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| receiver_entry_point/report/2598 | execution_time | 3.439ms | 3.472ms ± 0.026ms | 3.462ms ± 0.010ms | 3.480ms | 3.531ms | 3.546ms | 3.563ms | 2.90% | 1.420 | 1.321 | 0.76% | 0.002ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| receiver_entry_point/report/2598 | execution_time | [3.468ms; 3.475ms] or [-0.105%; +0.105%] | None | None | None |
Group 10
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 11783ad | 1774457560 | release-proposal-testing/libdd-telemetry/20260325-164719 |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| concentrator/add_spans_to_concentrator | execution_time | 13.226ms | 13.271ms ± 0.022ms | 13.269ms ± 0.011ms | 13.282ms | 13.299ms | 13.322ms | 13.452ms | 1.38% | 2.739 | 20.036 | 0.17% | 0.002ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| concentrator/add_spans_to_concentrator | execution_time | [13.268ms; 13.274ms] or [-0.023%; +0.023%] | None | None | None |
Group 11
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 11783ad | 1774457560 | release-proposal-testing/libdd-telemetry/20260325-164719 |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| write only interface | execution_time | 5.510µs | 5.540µs ± 0.021µs | 5.533µs ± 0.009µs | 5.547µs | 5.574µs | 5.631µs | 5.668µs | 2.44% | 2.315 | 8.607 | 0.38% | 0.001µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| write only interface | execution_time | [5.537µs; 5.543µs] or [-0.053%; +0.053%] | None | None | None |
Group 12
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 11783ad | 1774457560 | release-proposal-testing/libdd-telemetry/20260325-164719 |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| credit_card/is_card_number/ | execution_time | 3.894µs | 3.914µs ± 0.003µs | 3.913µs ± 0.002µs | 3.915µs | 3.919µs | 3.920µs | 3.923µs | 0.25% | -0.947 | 6.182 | 0.08% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/ | throughput | 254894477.576op/s | 255523010.916op/s ± 208236.902op/s | 255531773.020op/s ± 120534.695op/s | 255630336.930op/s | 255833065.216op/s | 255917123.286op/s | 256808360.378op/s | 0.50% | 0.965 | 6.290 | 0.08% | 14724.573op/s | 1 | 200 |
| credit_card/is_card_number/ 3782-8224-6310-005 | execution_time | 78.781µs | 79.579µs ± 0.369µs | 79.525µs ± 0.271µs | 79.864µs | 80.229µs | 80.516µs | 80.771µs | 1.57% | 0.467 | -0.278 | 0.46% | 0.026µs | 1 | 200 |
| credit_card/is_card_number/ 3782-8224-6310-005 | throughput | 12380723.763op/s | 12566420.068op/s ± 58183.779op/s | 12574632.565op/s ± 42854.227op/s | 12613209.506op/s | 12644873.454op/s | 12666551.355op/s | 12693401.859op/s | 0.94% | -0.446 | -0.312 | 0.46% | 4114.214op/s | 1 | 200 |
| credit_card/is_card_number/ 378282246310005 | execution_time | 72.400µs | 72.984µs ± 0.344µs | 72.945µs ± 0.247µs | 73.210µs | 73.618µs | 73.900µs | 74.065µs | 1.54% | 0.712 | 0.060 | 0.47% | 0.024µs | 1 | 200 |
| credit_card/is_card_number/ 378282246310005 | throughput | 13501609.040op/s | 13701993.141op/s ± 64352.101op/s | 13709024.866op/s ± 46404.105op/s | 13752968.630op/s | 13784303.140op/s | 13802682.531op/s | 13812175.433op/s | 0.75% | -0.691 | 0.014 | 0.47% | 4550.381op/s | 1 | 200 |
| credit_card/is_card_number/37828224631 | execution_time | 3.899µs | 3.914µs ± 0.003µs | 3.914µs ± 0.002µs | 3.916µs | 3.918µs | 3.921µs | 3.929µs | 0.38% | -0.025 | 5.242 | 0.08% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/37828224631 | throughput | 254507196.998op/s | 255488049.426op/s ± 197243.828op/s | 255478711.482op/s ± 102140.442op/s | 255594638.903op/s | 255796843.371op/s | 255923830.411op/s | 256463486.914op/s | 0.39% | 0.042 | 5.236 | 0.08% | 13947.245op/s | 1 | 200 |
| credit_card/is_card_number/378282246310005 | execution_time | 69.174µs | 69.745µs ± 0.283µs | 69.752µs ± 0.222µs | 69.960µs | 70.250µs | 70.344µs | 70.397µs | 0.93% | 0.153 | -0.806 | 0.41% | 0.020µs | 1 | 200 |
| credit_card/is_card_number/378282246310005 | throughput | 14205055.500op/s | 14338230.990op/s ± 58226.427op/s | 14336567.191op/s ± 45611.168op/s | 14386237.104op/s | 14425695.555op/s | 14441374.336op/s | 14456314.573op/s | 0.84% | -0.139 | -0.814 | 0.41% | 4117.230op/s | 1 | 200 |
| credit_card/is_card_number/37828224631000521389798 | execution_time | 52.135µs | 52.216µs ± 0.035µs | 52.217µs ± 0.021µs | 52.237µs | 52.273µs | 52.292µs | 52.321µs | 0.20% | -0.004 | -0.168 | 0.07% | 0.002µs | 1 | 200 |
| credit_card/is_card_number/37828224631000521389798 | throughput | 19112828.301op/s | 19151383.083op/s ± 12703.831op/s | 19150902.831op/s ± 7643.451op/s | 19159078.603op/s | 19173427.930op/s | 19179312.005op/s | 19180966.727op/s | 0.16% | 0.008 | -0.170 | 0.07% | 898.296op/s | 1 | 200 |
| credit_card/is_card_number/x371413321323331 | execution_time | 6.027µs | 6.038µs ± 0.009µs | 6.037µs ± 0.003µs | 6.039µs | 6.049µs | 6.077µs | 6.080µs | 0.72% | 2.992 | 9.812 | 0.15% | 0.001µs | 1 | 200 |
| credit_card/is_card_number/x371413321323331 | throughput | 164479385.499op/s | 165613206.247op/s ± 251345.303op/s | 165656082.870op/s ± 79447.360op/s | 165736015.405op/s | 165855492.093op/s | 165897655.897op/s | 165908606.599op/s | 0.15% | -2.978 | 9.747 | 0.15% | 17772.797op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ | execution_time | 3.895µs | 3.913µs ± 0.003µs | 3.913µs ± 0.002µs | 3.914µs | 3.917µs | 3.919µs | 3.919µs | 0.18% | -1.018 | 6.972 | 0.07% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ | throughput | 255137257.556op/s | 255587421.346op/s ± 183282.675op/s | 255585367.738op/s ± 111827.141op/s | 255699236.882op/s | 255838164.877op/s | 255950149.028op/s | 256750008.965op/s | 0.46% | 1.035 | 7.082 | 0.07% | 12960.042op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | execution_time | 63.792µs | 64.335µs ± 0.195µs | 64.300µs ± 0.092µs | 64.417µs | 64.749µs | 64.864µs | 64.967µs | 1.04% | 0.593 | 1.112 | 0.30% | 0.014µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | throughput | 15392426.965op/s | 15543717.767op/s ± 47086.699op/s | 15552023.563op/s ± 22329.715op/s | 15570029.640op/s | 15610572.579op/s | 15663614.044op/s | 15675855.465op/s | 0.80% | -0.568 | 1.098 | 0.30% | 3329.532op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 378282246310005 | execution_time | 58.097µs | 58.266µs ± 0.121µs | 58.222µs ± 0.056µs | 58.321µs | 58.544µs | 58.611µs | 58.712µs | 0.84% | 1.310 | 1.273 | 0.21% | 0.009µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 378282246310005 | throughput | 17032365.753op/s | 17162796.473op/s ± 35534.362op/s | 17175512.014op/s ± 16411.789op/s | 17186173.723op/s | 17200432.592op/s | 17212261.723op/s | 17212653.021op/s | 0.22% | -1.300 | 1.241 | 0.21% | 2512.659op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631 | execution_time | 3.897µs | 3.913µs ± 0.003µs | 3.913µs ± 0.002µs | 3.915µs | 3.918µs | 3.920µs | 3.920µs | 0.19% | -0.537 | 3.856 | 0.07% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631 | throughput | 255076124.655op/s | 255561750.705op/s ± 185743.064op/s | 255550934.223op/s ± 105220.651op/s | 255684574.066op/s | 255855932.694op/s | 255899203.022op/s | 256582814.814op/s | 0.40% | 0.549 | 3.911 | 0.07% | 13134.018op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/378282246310005 | execution_time | 54.544µs | 54.757µs ± 0.203µs | 54.683µs ± 0.073µs | 54.819µs | 55.179µs | 55.590µs | 55.635µs | 1.74% | 2.060 | 4.707 | 0.37% | 0.014µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/378282246310005 | throughput | 17974360.312op/s | 18262668.458op/s ± 67253.656op/s | 18287360.691op/s ± 24272.479op/s | 18305581.374op/s | 18321675.184op/s | 18331008.589op/s | 18333763.459op/s | 0.25% | -2.033 | 4.563 | 0.37% | 4755.552op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | execution_time | 52.132µs | 52.226µs ± 0.034µs | 52.226µs ± 0.022µs | 52.248µs | 52.278µs | 52.309µs | 52.326µs | 0.19% | 0.061 | 0.143 | 0.07% | 0.002µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | throughput | 19111110.403op/s | 19147582.796op/s ± 12513.350op/s | 19147551.030op/s ± 7994.695op/s | 19155517.058op/s | 19166757.465op/s | 19176090.188op/s | 19181922.956op/s | 0.18% | -0.056 | 0.141 | 0.07% | 884.827op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/x371413321323331 | execution_time | 6.028µs | 6.042µs ± 0.012µs | 6.039µs ± 0.003µs | 6.042µs | 6.075µs | 6.085µs | 6.119µs | 1.32% | 3.288 | 12.621 | 0.20% | 0.001µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/x371413321323331 | throughput | 163423364.212op/s | 165510038.675op/s ± 334363.724op/s | 165587887.249op/s ± 76064.303op/s | 165663395.250op/s | 165769203.947op/s | 165819385.034op/s | 165878775.871op/s | 0.18% | -3.265 | 12.417 | 0.20% | 23643.086op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| credit_card/is_card_number/ | execution_time | [3.913µs; 3.914µs] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number/ | throughput | [255494151.284op/s; 255551870.548op/s] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number/ 3782-8224-6310-005 | execution_time | [79.528µs; 79.630µs] or [-0.064%; +0.064%] | None | None | None |
| credit_card/is_card_number/ 3782-8224-6310-005 | throughput | [12558356.356op/s; 12574483.781op/s] or [-0.064%; +0.064%] | None | None | None |
| credit_card/is_card_number/ 378282246310005 | execution_time | [72.936µs; 73.031µs] or [-0.065%; +0.065%] | None | None | None |
| credit_card/is_card_number/ 378282246310005 | throughput | [13693074.559op/s; 13710911.723op/s] or [-0.065%; +0.065%] | None | None | None |
| credit_card/is_card_number/37828224631 | execution_time | [3.914µs; 3.914µs] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number/37828224631 | throughput | [255460713.329op/s; 255515385.524op/s] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number/378282246310005 | execution_time | [69.705µs; 69.784µs] or [-0.056%; +0.056%] | None | None | None |
| credit_card/is_card_number/378282246310005 | throughput | [14330161.367op/s; 14346300.612op/s] or [-0.056%; +0.056%] | None | None | None |
| credit_card/is_card_number/37828224631000521389798 | execution_time | [52.211µs; 52.220µs] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number/37828224631000521389798 | throughput | [19149622.454op/s; 19153143.711op/s] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number/x371413321323331 | execution_time | [6.037µs; 6.039µs] or [-0.021%; +0.021%] | None | None | None |
| credit_card/is_card_number/x371413321323331 | throughput | [165578372.205op/s; 165648040.288op/s] or [-0.021%; +0.021%] | None | None | None |
| credit_card/is_card_number_no_luhn/ | execution_time | [3.912µs; 3.913µs] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/ | throughput | [255562020.130op/s; 255612822.562op/s] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | execution_time | [64.308µs; 64.362µs] or [-0.042%; +0.042%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | throughput | [15537192.004op/s; 15550243.531op/s] or [-0.042%; +0.042%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 378282246310005 | execution_time | [58.249µs; 58.283µs] or [-0.029%; +0.029%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 378282246310005 | throughput | [17157871.752op/s; 17167721.194op/s] or [-0.029%; +0.029%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631 | execution_time | [3.913µs; 3.913µs] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631 | throughput | [255536008.502op/s; 255587492.907op/s] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/378282246310005 | execution_time | [54.729µs; 54.785µs] or [-0.051%; +0.051%] | None | None | None |
| credit_card/is_card_number_no_luhn/378282246310005 | throughput | [18253347.748op/s; 18271989.168op/s] or [-0.051%; +0.051%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | execution_time | [52.221µs; 52.231µs] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | throughput | [19145848.566op/s; 19149317.026op/s] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number_no_luhn/x371413321323331 | execution_time | [6.040µs; 6.044µs] or [-0.028%; +0.028%] | None | None | None |
| credit_card/is_card_number_no_luhn/x371413321323331 | throughput | [165463699.079op/s; 165556378.271op/s] or [-0.028%; +0.028%] | None | None | None |
Group 13
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 11783ad | 1774457560 | release-proposal-testing/libdd-telemetry/20260325-164719 |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| sql/obfuscate_sql_string | execution_time | 84.907µs | 85.174µs ± 0.272µs | 85.138µs ± 0.058µs | 85.220µs | 85.337µs | 85.450µs | 88.723µs | 4.21% | 11.267 | 144.306 | 0.32% | 0.019µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| sql/obfuscate_sql_string | execution_time | [85.137µs; 85.212µs] or [-0.044%; +0.044%] | None | None | None |
Group 14
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 11783ad | 1774457560 | release-proposal-testing/libdd-telemetry/20260325-164719 |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching serializing traces from their internal representation to msgpack | execution_time | 14.073ms | 14.115ms ± 0.030ms | 14.111ms ± 0.010ms | 14.121ms | 14.156ms | 14.243ms | 14.306ms | 1.39% | 3.202 | 14.068 | 0.21% | 0.002ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching serializing traces from their internal representation to msgpack | execution_time | [14.111ms; 14.119ms] or [-0.030%; +0.030%] | None | None | None |
Group 15
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 11783ad | 1774457560 | release-proposal-testing/libdd-telemetry/20260325-164719 |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| redis/obfuscate_redis_string | execution_time | 34.938µs | 35.287µs ± 0.529µs | 35.067µs ± 0.054µs | 35.196µs | 36.218µs | 36.251µs | 39.634µs | 13.03% | 3.581 | 21.558 | 1.50% | 0.037µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| redis/obfuscate_redis_string | execution_time | [35.214µs; 35.360µs] or [-0.208%; +0.208%] | None | None | None |
Group 16
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 11783ad | 1774457560 | release-proposal-testing/libdd-telemetry/20260325-164719 |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ip_address/quantize_peer_ip_address_benchmark | execution_time | 4.971µs | 5.052µs ± 0.046µs | 5.056µs ± 0.044µs | 5.091µs | 5.123µs | 5.125µs | 5.128µs | 1.41% | 0.043 | -1.399 | 0.90% | 0.003µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| ip_address/quantize_peer_ip_address_benchmark | execution_time | [5.046µs; 5.059µs] or [-0.125%; +0.125%] | None | None | None |
Group 17
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 11783ad | 1774457560 | release-proposal-testing/libdd-telemetry/20260325-164719 |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching deserializing traces from msgpack to their internal representation | execution_time | 49.778ms | 50.021ms ± 0.651ms | 49.917ms ± 0.065ms | 49.991ms | 50.250ms | 52.835ms | 57.349ms | 14.89% | 8.754 | 86.472 | 1.30% | 0.046ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching deserializing traces from msgpack to their internal representation | execution_time | [49.930ms; 50.111ms] or [-0.180%; +0.180%] | None | None | None |
Group 18
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 11783ad | 1774457560 | release-proposal-testing/libdd-telemetry/20260325-164719 |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| profile_add_sample2_frames_x1000 | execution_time | 737.592µs | 738.628µs ± 0.486µs | 738.553µs ± 0.338µs | 738.960µs | 739.539µs | 739.827µs | 740.352µs | 0.24% | 0.571 | 0.137 | 0.07% | 0.034µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| profile_add_sample2_frames_x1000 | execution_time | [738.561µs; 738.695µs] or [-0.009%; +0.009%] | None | None | None |
Group 19
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 11783ad | 1774457560 | release-proposal-testing/libdd-telemetry/20260325-164719 |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| profile_add_sample_frames_x1000 | execution_time | 4.224ms | 4.227ms ± 0.002ms | 4.227ms ± 0.001ms | 4.228ms | 4.231ms | 4.233ms | 4.236ms | 0.21% | 0.983 | 1.390 | 0.05% | 0.000ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| profile_add_sample_frames_x1000 | execution_time | [4.227ms; 4.228ms] or [-0.007%; +0.007%] | None | None | None |
Group 20
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 11783ad | 1774457560 | release-proposal-testing/libdd-telemetry/20260325-164719 |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| profile_add_sample_timestamped_x1000 | execution_time | 4.190ms | 4.196ms ± 0.009ms | 4.194ms ± 0.002ms | 4.196ms | 4.201ms | 4.229ms | 4.296ms | 2.42% | 7.283 | 67.219 | 0.22% | 0.001ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| profile_add_sample_timestamped_x1000 | execution_time | [4.195ms; 4.198ms] or [-0.031%; +0.031%] | None | None | None |
Baseline
Omitted due to size.
Artifact Size Benchmark Reportaarch64-alpine-linux-musl
aarch64-unknown-linux-gnu
libdatadog-x64-windows
libdatadog-x86-windows
x86_64-alpine-linux-musl
x86_64-unknown-linux-gnu
|
Release proposal for libdd-telemetry and its dependencies
This PR contains version bumps based on public API changes and commits since last release.
Cut from non-default ref
This proposal was generated from
5ff99ff6c465a95a740a494f42cce258c0e80be8instead of the default latestorigin/main.### Non-default workflow optionsbypass_standard_checks was enabled: the ongoing-proposal branch guard was skipped; branches use proposal prefix
release-proposal-testingand release prefixrelease-testing. Crates whose resolved git tag is not the latest SemVer tag for that crate are still included (normally skipped).## libdd-commonNext version:
3.0.1Semver bump:
patchTag:
libdd-common-v3.0.1Commits
libdd-telemetry
Next version:
3.1.0Semver bump:
minorTag:
libdd-telemetry-v3.1.0Commits