Skip to content

chore(release): proposal for libdd-telemetry#1717

Closed
dd-octo-sts[bot] wants to merge 1 commit intoreleasefrom
release-proposal/libdd-telemetry/20260312-135011
Closed

chore(release): proposal for libdd-telemetry#1717
dd-octo-sts[bot] wants to merge 1 commit intoreleasefrom
release-proposal/libdd-telemetry/20260312-135011

Conversation

@dd-octo-sts
Copy link
Copy Markdown
Contributor

@dd-octo-sts dd-octo-sts Bot commented Mar 12, 2026

Release proposal for libdd-telemetry and its dependencies

This PR contains version bumps based on public API changes and commits since last release.

libdd-common

Next version: 2.0.1

Semver bump: patch
Tag: libdd-common-v2.0.1

Commits

Co-authored-by: iunanua <18325288+iunanua@users.noreply.github.com>
@dd-octo-sts dd-octo-sts Bot added the release-proposal This is a release proposal PR label Mar 12, 2026
@dd-octo-sts dd-octo-sts Bot requested review from a team as code owners March 12, 2026 13:53
@dd-octo-sts dd-octo-sts Bot added the release-proposal This is a release proposal PR label Mar 12, 2026
@codecov-commenter
Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
⚠️ Please upload report for BASE (release@c534612). Learn more about missing BASE report.

Additional details and impacted files
@@            Coverage Diff             @@
##             release    #1717   +/-   ##
==========================================
  Coverage           ?   71.30%           
==========================================
  Files              ?      429           
  Lines              ?    63585           
  Branches           ?        0           
==========================================
  Hits               ?    45340           
  Misses             ?    18245           
  Partials           ?        0           
Components Coverage Δ
libdd-crashtracker 62.32% <0.00%> (?)
libdd-crashtracker-ffi 16.56% <0.00%> (?)
libdd-alloc 98.77% <0.00%> (?)
libdd-data-pipeline 88.28% <0.00%> (?)
libdd-data-pipeline-ffi 77.41% <0.00%> (?)
libdd-common 79.73% <0.00%> (?)
libdd-common-ffi 73.40% <0.00%> (?)
libdd-telemetry 62.48% <0.00%> (?)
libdd-telemetry-ffi 16.75% <0.00%> (?)
libdd-dogstatsd-client 82.64% <0.00%> (?)
datadog-ipc 80.35% <0.00%> (?)
libdd-profiling 81.60% <0.00%> (?)
libdd-profiling-ffi 63.65% <0.00%> (?)
datadog-sidecar 33.98% <0.00%> (?)
datdog-sidecar-ffi 14.32% <0.00%> (?)
spawn-worker 54.69% <0.00%> (?)
libdd-tinybytes 93.16% <0.00%> (?)
libdd-trace-normalization 81.71% <0.00%> (?)
libdd-trace-obfuscation 91.80% <0.00%> (?)
libdd-trace-protobuf 68.25% <0.00%> (?)
libdd-trace-utils 88.98% <0.00%> (?)
datadog-tracer-flare 86.86% <0.00%> (?)
libdd-log 74.69% <0.00%> (?)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Mar 12, 2026

Benchmarks

Comparison

Benchmark execution time: 2026-03-12 14:09:04

Comparing candidate commit 2153413 in PR branch release-proposal/libdd-telemetry/20260312-135011 with baseline commit c534612 in branch release.

Found 4 performance improvements and 14 performance regressions! Performance is the same for 40 metrics, 2 unstable metrics.

Explanation

This is an A/B test comparing a candidate commit's performance against that of a baseline commit. Performance changes are noted in the tables below as:

  • 🟩 = significantly better candidate vs. baseline
  • 🟥 = significantly worse candidate vs. baseline

We compute a confidence interval (CI) over the relative difference of means between metrics from the candidate and baseline commits, considering the baseline as the reference.

If the CI is entirely outside the configured SIGNIFICANT_IMPACT_THRESHOLD (or the deprecated UNCONFIDENCE_THRESHOLD), the change is considered significant.

Feel free to reach out to #apm-benchmarking-platform on Slack if you have any questions.

More details about the CI and significant changes

You can imagine this CI as a range of values that is likely to contain the true difference of means between the candidate and baseline commits.

CIs of the difference of means are often centered around 0%, because often changes are not that big:

---------------------------------(------|---^--------)-------------------------------->
                              -0.6%    0%  0.3%     +1.2%
                                 |          |        |
         lower bound of the CI --'          |        |
sample mean (center of the CI) -------------'        |
         upper bound of the CI ----------------------'

As described above, a change is considered significant if the CI is entirely outside the configured SIGNIFICANT_IMPACT_THRESHOLD (or the deprecated UNCONFIDENCE_THRESHOLD).

For instance, for an execution time metric, this confidence interval indicates a significantly worse performance:

----------------------------------------|---------|---(---------^---------)---------->
                                       0%        1%  1.3%      2.2%      3.1%
                                                  |   |         |         |
       significant impact threshold --------------'   |         |         |
                      lower bound of CI --------------'         |         |
       sample mean (center of the CI) --------------------------'         |
                      upper bound of CI ----------------------------------'

scenario:benching serializing traces from their internal representation to msgpack

  • 🟥 execution_time [+947.031µs; +959.665µs] or [+6.786%; +6.876%]

scenario:credit_card/is_card_number/ 378282246310005

  • 🟥 execution_time [+4.988µs; +5.081µs] or [+7.345%; +7.482%]
  • 🟥 throughput [-1024839.537op/s; -1007338.269op/s] or [-6.960%; -6.841%]

scenario:credit_card/is_card_number/378282246310005

  • 🟥 execution_time [+4.988µs; +5.081µs] or [+7.708%; +7.852%]
  • 🟥 throughput [-1124858.371op/s; -1105695.250op/s] or [-7.279%; -7.155%]

scenario:credit_card/is_card_number/37828224631000521389798

  • 🟥 execution_time [+6.492µs; +6.521µs] or [+14.204%; +14.268%]
  • 🟥 throughput [-2733733.393op/s; -2719819.213op/s] or [-12.494%; -12.431%]

scenario:credit_card/is_card_number/x371413321323331

  • 🟩 execution_time [-590.783ns; -585.952ns] or [-8.914%; -8.841%]
  • 🟩 throughput [+14638663.460op/s; +14758402.727op/s] or [+9.702%; +9.782%]

scenario:credit_card/is_card_number_no_luhn/ 378282246310005

  • 🟥 execution_time [+4.830µs; +4.864µs] or [+9.039%; +9.104%]
  • 🟥 throughput [-1561789.303op/s; -1551447.058op/s] or [-8.344%; -8.289%]

scenario:credit_card/is_card_number_no_luhn/378282246310005

  • 🟥 execution_time [+4.513µs; +4.580µs] or [+8.987%; +9.119%]
  • 🟥 throughput [-1663683.941op/s; -1641635.391op/s] or [-8.355%; -8.245%]

scenario:credit_card/is_card_number_no_luhn/37828224631000521389798

  • 🟥 execution_time [+6.455µs; +6.485µs] or [+14.110%; +14.176%]
  • 🟥 throughput [-2715604.046op/s; -2701426.612op/s] or [-12.423%; -12.358%]

scenario:credit_card/is_card_number_no_luhn/x371413321323331

  • 🟩 execution_time [-595.150ns; -590.647ns] or [-8.974%; -8.906%]
  • 🟩 throughput [+14747709.184op/s; +14861806.031op/s] or [+9.780%; +9.856%]

scenario:receiver_entry_point/report/2598

  • 🟥 execution_time [+167.242µs; +174.803µs] or [+4.872%; +5.092%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2153413 1773323602 release-proposal/libdd-telemetry/20260312-135011
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 14.862ms 14.910ms ± 0.030ms 14.905ms ± 0.011ms 14.916ms 14.956ms 15.014ms 15.110ms 1.37% 2.769 12.040 0.20% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [14.906ms; 14.914ms] or [-0.028%; +0.028%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2153413 1773323602 release-proposal/libdd-telemetry/20260312-135011
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 87.166µs 87.591µs ± 0.177µs 87.569µs ± 0.074µs 87.658µs 87.806µs 87.942µs 89.415µs 2.11% 5.626 54.981 0.20% 0.013µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [87.567µs; 87.616µs] or [-0.028%; +0.028%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2153413 1773323602 release-proposal/libdd-telemetry/20260312-135011
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 33.641µs 34.064µs ± 0.713µs 33.746µs ± 0.060µs 33.869µs 35.482µs 35.538µs 38.087µs 12.86% 2.155 4.820 2.09% 0.050µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [33.965µs; 34.163µs] or [-0.290%; +0.290%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2153413 1773323602 release-proposal/libdd-telemetry/20260312-135011
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 49.128ms 49.476ms ± 1.014ms 49.338ms ± 0.074ms 49.414ms 49.562ms 54.398ms 58.816ms 19.21% 8.295 70.544 2.04% 0.072ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [49.336ms; 49.617ms] or [-0.284%; +0.284%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2153413 1773323602 release-proposal/libdd-telemetry/20260312-135011
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 4.952µs 5.038µs ± 0.046µs 5.023µs ± 0.037µs 5.085µs 5.112µs 5.114µs 5.115µs 1.82% 0.320 -1.232 0.91% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.031µs; 5.044µs] or [-0.126%; +0.126%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2153413 1773323602 release-proposal/libdd-telemetry/20260312-135011
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.305µs 2.383µs ± 0.020µs 2.384µs ± 0.003µs 2.388µs 2.423µs 2.430µs 2.431µs 1.98% -1.112 4.273 0.82% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.381µs; 2.386µs] or [-0.114%; +0.114%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2153413 1773323602 release-proposal/libdd-telemetry/20260312-135011
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 493.190µs 494.149µs ± 0.632µs 494.090µs ± 0.336µs 494.427µs 494.839µs 495.173µs 500.726µs 1.34% 5.663 56.545 0.13% 0.045µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1997102.205op/s 2023685.786op/s ± 2571.812op/s 2023923.564op/s ± 1377.028op/s 2025282.103op/s 2026460.611op/s 2027052.596op/s 2027615.447op/s 0.18% -5.562 55.168 0.13% 181.855op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 370.098µs 370.745µs ± 0.300µs 370.737µs ± 0.199µs 370.917µs 371.296µs 371.550µs 371.830µs 0.29% 0.535 0.453 0.08% 0.021µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2689402.014op/s 2697274.839op/s ± 2181.616op/s 2697331.337op/s ± 1447.521op/s 2698852.794op/s 2700442.819op/s 2701660.148op/s 2701986.724op/s 0.17% -0.530 0.443 0.08% 154.264op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 167.357µs 167.620µs ± 0.142µs 167.605µs ± 0.094µs 167.705µs 167.891µs 168.038µs 168.088µs 0.29% 0.685 0.437 0.08% 0.010µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5949267.140op/s 5965876.238op/s ± 5049.779op/s 5966408.703op/s ± 3358.217op/s 5969427.785op/s 5973278.332op/s 5973942.171op/s 5975267.949op/s 0.15% -0.680 0.425 0.08% 357.073op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 37.021µs 37.242µs ± 0.067µs 37.237µs ± 0.034µs 37.274µs 37.320µs 37.364µs 37.852µs 1.65% 3.752 34.004 0.18% 0.005µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26418629.921op/s 26851834.435op/s ± 47749.722op/s 26855132.831op/s ± 24701.015op/s 26878020.673op/s 26905981.764op/s 26932055.528op/s 27011975.044op/s 0.58% -3.636 32.730 0.18% 3376.415op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 45.438µs 45.605µs ± 0.062µs 45.609µs ± 0.045µs 45.654µs 45.694µs 45.717µs 45.745µs 0.30% -0.364 -0.546 0.14% 0.004µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 21860105.526op/s 21927339.989op/s ± 30064.434op/s 21925259.471op/s ± 21797.809op/s 21947872.554op/s 21975861.441op/s 21999338.935op/s 22008183.132op/s 0.38% 0.370 -0.541 0.14% 2125.877op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [494.061µs; 494.236µs] or [-0.018%; +0.018%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [2023329.358op/s; 2024042.215op/s] or [-0.018%; +0.018%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [370.703µs; 370.786µs] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2696972.488op/s; 2697577.190op/s] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [167.600µs; 167.640µs] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5965176.387op/s; 5966576.089op/s] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [37.232µs; 37.251µs] or [-0.025%; +0.025%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [26845216.783op/s; 26858452.088op/s] or [-0.025%; +0.025%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [45.597µs; 45.614µs] or [-0.019%; +0.019%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [21923173.348op/s; 21931506.631op/s] or [-0.019%; +0.019%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2153413 1773323602 release-proposal/libdd-telemetry/20260312-135011
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.895µs 3.913µs ± 0.003µs 3.912µs ± 0.002µs 3.914µs 3.917µs 3.919µs 3.929µs 0.42% 0.028 10.861 0.07% 0.000µs 1 200
credit_card/is_card_number/ throughput 254538295.316op/s 255587955.290op/s ± 186180.365op/s 255606607.440op/s ± 102695.503op/s 255698501.456op/s 255801508.918op/s 255847442.855op/s 256744309.387op/s 0.45% 0.000 10.907 0.07% 13164.940op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 78.703µs 79.494µs ± 0.336µs 79.438µs ± 0.200µs 79.672µs 80.188µs 80.398µs 80.743µs 1.64% 0.873 1.097 0.42% 0.024µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12384934.376op/s 12579821.324op/s ± 53020.375op/s 12588449.469op/s ± 31737.738op/s 12616218.149op/s 12650587.615op/s 12684452.638op/s 12705920.364op/s 0.93% -0.843 1.034 0.42% 3749.107op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 72.412µs 72.946µs ± 0.329µs 72.888µs ± 0.224µs 73.148µs 73.541µs 73.870µs 74.087µs 1.64% 0.734 0.159 0.45% 0.023µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 13497726.513op/s 13709127.168op/s ± 61557.328op/s 13719721.913op/s ± 42328.567op/s 13757460.899op/s 13792357.793op/s 13802969.005op/s 13809845.039op/s 0.66% -0.712 0.106 0.45% 4352.760op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.891µs 3.912µs ± 0.003µs 3.912µs ± 0.002µs 3.914µs 3.916µs 3.919µs 3.920µs 0.20% -1.843 16.509 0.07% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 255083354.174op/s 255599846.330op/s ± 178803.984op/s 255596690.025op/s ± 101176.959op/s 255699332.811op/s 255812777.419op/s 255882857.055op/s 256979543.282op/s 0.54% 1.875 16.776 0.07% 12643.351op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 68.889µs 69.742µs ± 0.330µs 69.700µs ± 0.196µs 69.902µs 70.359µs 70.606µs 71.118µs 2.03% 0.814 1.306 0.47% 0.023µs 1 200
credit_card/is_card_number/378282246310005 throughput 14061082.906op/s 14338860.455op/s ± 67507.675op/s 14347102.235op/s ± 40453.969op/s 14385023.393op/s 14430037.525op/s 14460061.939op/s 14516074.890op/s 1.18% -0.777 1.215 0.47% 4773.513op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 52.143µs 52.210µs ± 0.028µs 52.209µs ± 0.018µs 52.226µs 52.258µs 52.276µs 52.294µs 0.16% 0.292 0.143 0.05% 0.002µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 19122553.658op/s 19153347.405op/s ± 10136.928op/s 19153823.006op/s ± 6644.723op/s 19160547.953op/s 19167587.611op/s 19177156.574op/s 19177907.051op/s 0.13% -0.288 0.140 0.05% 716.789op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.029µs 6.039µs ± 0.011µs 6.036µs ± 0.003µs 6.040µs 6.069µs 6.080µs 6.116µs 1.33% 3.269 13.316 0.19% 0.001µs 1 200
credit_card/is_card_number/x371413321323331 throughput 163494937.284op/s 165577311.792op/s ± 309077.744op/s 165666531.679op/s ± 87046.977op/s 165727187.333op/s 165810325.425op/s 165856653.555op/s 165868624.237op/s 0.12% -3.244 13.067 0.19% 21855.097op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.895µs 3.913µs ± 0.003µs 3.913µs ± 0.002µs 3.915µs 3.917µs 3.919µs 3.921µs 0.20% -1.305 9.115 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 255044077.641op/s 255554920.060op/s ± 179455.753op/s 255557743.784op/s ± 104809.879op/s 255661548.505op/s 255802643.484op/s 255903540.582op/s 256765602.929op/s 0.47% 1.324 9.259 0.07% 12689.438op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 63.958µs 64.343µs ± 0.163µs 64.325µs ± 0.097µs 64.418µs 64.632µs 64.878µs 64.928µs 0.94% 0.908 1.243 0.25% 0.012µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15401728.923op/s 15541876.715op/s ± 39326.392op/s 15546143.501op/s ± 23454.524op/s 15569858.708op/s 15591860.738op/s 15610842.176op/s 15635381.304op/s 0.57% -0.890 1.196 0.25% 2780.796op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 58.082µs 58.276µs ± 0.121µs 58.248µs ± 0.079µs 58.344µs 58.478µs 58.603µs 58.743µs 0.85% 0.990 1.070 0.21% 0.009µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 17023309.959op/s 17159903.832op/s ± 35548.878op/s 17167977.431op/s ± 23180.883op/s 17187943.522op/s 17204691.381op/s 17209483.093op/s 17217037.981op/s 0.29% -0.977 1.026 0.21% 2513.685op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.892µs 3.912µs ± 0.003µs 3.912µs ± 0.001µs 3.913µs 3.916µs 3.918µs 3.919µs 0.18% -1.753 15.756 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 255181456.987op/s 255621154.381op/s ± 168902.369op/s 255628517.245op/s ± 85553.791op/s 255714781.238op/s 255813204.914op/s 255893810.891op/s 256912918.285op/s 0.50% 1.782 16.002 0.07% 11943.201op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 54.390µs 54.768µs ± 0.237µs 54.689µs ± 0.093µs 54.841µs 55.260µs 55.487µs 55.887µs 2.19% 1.605 2.986 0.43% 0.017µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 17893287.367op/s 18259190.529op/s ± 78537.687op/s 18285346.124op/s ± 31224.762op/s 18309713.772op/s 18344327.692op/s 18366272.988op/s 18385769.615op/s 0.55% -1.574 2.836 0.43% 5553.453op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 52.140µs 52.218µs ± 0.036µs 52.215µs ± 0.022µs 52.238µs 52.273µs 52.315µs 52.430µs 0.41% 1.307 5.436 0.07% 0.003µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 19073030.834op/s 19150657.210op/s ± 13110.313op/s 19151729.980op/s ± 7899.722op/s 19158986.358op/s 19169755.686op/s 19175912.831op/s 19179046.891op/s 0.14% -1.296 5.363 0.07% 927.039op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.027µs 6.039µs ± 0.012µs 6.036µs ± 0.002µs 6.039µs 6.072µs 6.079µs 6.111µs 1.24% 3.402 13.114 0.20% 0.001µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 163645609.384op/s 165594303.701op/s ± 328407.248op/s 165671396.836op/s ± 66207.814op/s 165732437.982op/s 165853927.379op/s 165893054.404op/s 165909078.621op/s 0.14% -3.381 12.932 0.20% 23221.899op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.912µs; 3.913µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ throughput [255562152.482op/s; 255613758.098op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [79.447µs; 79.540µs] or [-0.059%; +0.059%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12572473.210op/s; 12587169.438op/s] or [-0.058%; +0.058%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [72.900µs; 72.991µs] or [-0.062%; +0.062%] None None None
credit_card/is_card_number/ 378282246310005 throughput [13700595.914op/s; 13717658.421op/s] or [-0.062%; +0.062%] None None None
credit_card/is_card_number/37828224631 execution_time [3.912µs; 3.913µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/37828224631 throughput [255575065.817op/s; 255624626.842op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/378282246310005 execution_time [69.696µs; 69.788µs] or [-0.065%; +0.065%] None None None
credit_card/is_card_number/378282246310005 throughput [14329504.540op/s; 14348216.369op/s] or [-0.065%; +0.065%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [52.206µs; 52.214µs] or [-0.007%; +0.007%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [19151942.524op/s; 19154752.286op/s] or [-0.007%; +0.007%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.038µs; 6.041µs] or [-0.026%; +0.026%] None None None
credit_card/is_card_number/x371413321323331 throughput [165534476.589op/s; 165620146.994op/s] or [-0.026%; +0.026%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.913µs; 3.913µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ throughput [255530049.218op/s; 255579790.901op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [64.320µs; 64.365µs] or [-0.035%; +0.035%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15536426.455op/s; 15547326.975op/s] or [-0.035%; +0.035%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [58.259µs; 58.292µs] or [-0.029%; +0.029%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [17154977.099op/s; 17164830.564op/s] or [-0.029%; +0.029%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.912µs; 3.912µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255597746.137op/s; 255644562.625op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [54.735µs; 54.801µs] or [-0.060%; +0.060%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [18248305.961op/s; 18270075.097op/s] or [-0.060%; +0.060%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [52.213µs; 52.223µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [19148840.247op/s; 19152474.173op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.037µs; 6.041µs] or [-0.028%; +0.028%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [165548789.615op/s; 165639817.787op/s] or [-0.027%; +0.027%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2153413 1773323602 release-proposal/libdd-telemetry/20260312-135011
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample_frames_x1000 execution_time 4.165ms 4.170ms ± 0.007ms 4.169ms ± 0.002ms 4.171ms 4.174ms 4.189ms 4.262ms 2.23% 9.998 118.528 0.18% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample_frames_x1000 execution_time [4.169ms; 4.171ms] or [-0.025%; +0.025%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2153413 1773323602 release-proposal/libdd-telemetry/20260312-135011
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
single_flag_killswitch/rules-based execution_time 190.208ns 192.590ns ± 1.878ns 192.339ns ± 1.330ns 193.637ns 195.842ns 198.140ns 200.177ns 4.08% 1.005 1.234 0.97% 0.133ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
single_flag_killswitch/rules-based execution_time [192.329ns; 192.850ns] or [-0.135%; +0.135%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2153413 1773323602 release-proposal/libdd-telemetry/20260312-135011
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 161.379µs 162.163µs ± 0.335µs 162.119µs ± 0.149µs 162.289µs 162.597µs 162.822µs 165.350µs 1.99% 4.359 39.259 0.21% 0.024µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [162.116µs; 162.209µs] or [-0.029%; +0.029%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2153413 1773323602 release-proposal/libdd-telemetry/20260312-135011
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample2_frames_x1000 execution_time 731.963µs 733.074µs ± 0.530µs 733.060µs ± 0.327µs 733.374µs 733.955µs 734.478µs 735.393µs 0.32% 0.890 1.635 0.07% 0.037µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample2_frames_x1000 execution_time [733.001µs; 733.147µs] or [-0.010%; +0.010%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2153413 1773323602 release-proposal/libdd-telemetry/20260312-135011
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sdk_test_data/rules-based execution_time 144.501µs 146.828µs ± 1.620µs 146.655µs ± 0.560µs 147.124µs 148.551µs 153.548µs 162.615µs 10.88% 5.694 47.488 1.10% 0.115µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sdk_test_data/rules-based execution_time [146.604µs; 147.053µs] or [-0.153%; +0.153%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2153413 1773323602 release-proposal/libdd-telemetry/20260312-135011
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.914µs 25.854µs ± 9.976µs 18.264µs ± 0.226µs 34.153µs 43.390µs 49.494µs 73.887µs 304.55% 1.291 2.460 38.49% 0.705µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [24.472µs; 27.237µs] or [-5.347%; +5.347%] None None None

Group 15

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2153413 1773323602 release-proposal/libdd-telemetry/20260312-135011
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 243.410ns 254.114ns ± 12.106ns 249.175ns ± 3.802ns 256.460ns 284.483ns 290.794ns 292.207ns 17.27% 1.798 2.189 4.75% 0.856ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [252.436ns; 255.792ns] or [-0.660%; +0.660%] None None None

Group 16

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2153413 1773323602 release-proposal/libdd-telemetry/20260312-135011
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 10.714ms 10.744ms ± 0.018ms 10.739ms ± 0.009ms 10.753ms 10.779ms 10.790ms 10.858ms 1.10% 2.133 8.830 0.17% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [10.741ms; 10.746ms] or [-0.023%; +0.023%] None None None

Group 17

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2153413 1773323602 release-proposal/libdd-telemetry/20260312-135011
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.243µs 3.210µs ± 1.403µs 3.003µs ± 0.025µs 3.027µs 3.689µs 13.798µs 14.740µs 390.83% 7.336 55.087 43.62% 0.099µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.015µs; 3.404µs] or [-6.060%; +6.060%] None None None

Group 18

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2153413 1773323602 release-proposal/libdd-telemetry/20260312-135011
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2598 execution_time 3.575ms 3.604ms ± 0.018ms 3.601ms ± 0.008ms 3.610ms 3.641ms 3.655ms 3.723ms 3.41% 2.247 9.630 0.51% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2598 execution_time [3.601ms; 3.606ms] or [-0.071%; +0.071%] None None None

Group 19

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2153413 1773323602 release-proposal/libdd-telemetry/20260312-135011
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 205.725µs 206.591µs ± 0.467µs 206.530µs ± 0.246µs 206.834µs 207.244µs 207.896µs 209.390µs 1.39% 2.173 10.359 0.23% 0.033µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4775766.778op/s 4840503.659op/s ± 10899.977op/s 4841919.826op/s ± 5776.302op/s 4847069.711op/s 4854616.854op/s 4858334.511op/s 4860866.243op/s 0.39% -2.122 9.999 0.22% 770.745op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.572µs 18.743µs ± 0.152µs 18.678µs ± 0.073µs 18.826µs 19.038µs 19.172µs 19.320µs 3.44% 1.195 0.956 0.81% 0.011µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 51760969.597op/s 53357577.827op/s ± 429037.412op/s 53540161.824op/s ± 210201.489op/s 53692789.909op/s 53809310.442op/s 53837160.344op/s 53844398.814op/s 0.57% -1.159 0.820 0.80% 30337.526op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.714µs 10.818µs ± 0.046µs 10.816µs ± 0.027µs 10.841µs 10.899µs 10.933µs 11.043µs 2.10% 0.758 2.271 0.42% 0.003µs 1 200
normalization/normalize_name/normalize_name/good throughput 90554476.813op/s 92442201.700op/s ± 391958.313op/s 92452424.075op/s ± 229265.150op/s 92692259.104op/s 93024299.792op/s 93231288.916op/s 93334558.795op/s 0.95% -0.712 2.095 0.42% 27715.638op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [206.526µs; 206.656µs] or [-0.031%; +0.031%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4838993.027op/s; 4842014.291op/s] or [-0.031%; +0.031%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.722µs; 18.764µs] or [-0.112%; +0.112%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [53298117.368op/s; 53417038.286op/s] or [-0.111%; +0.111%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.811µs; 10.824µs] or [-0.059%; +0.059%] None None None
normalization/normalize_name/normalize_name/good throughput [92387880.048op/s; 92496523.353op/s] or [-0.059%; +0.059%] None None None

Baseline

Omitted due to size.

@iunanua iunanua marked this pull request as draft March 12, 2026 14:34
@iunanua iunanua closed this Mar 12, 2026
@iunanua iunanua deleted the release-proposal/libdd-telemetry/20260312-135011 branch March 12, 2026 14:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants