Skip to content

chore(release): proposal for libdd-common#1794

Closed
dd-octo-sts[bot] wants to merge 1 commit intorelease-testing/libdd-common/20260325-160632from
release-proposal-testing/libdd-common/20260325-160632
Closed

chore(release): proposal for libdd-common#1794
dd-octo-sts[bot] wants to merge 1 commit intorelease-testing/libdd-common/20260325-160632from
release-proposal-testing/libdd-common/20260325-160632

Conversation

@dd-octo-sts
Copy link
Copy Markdown
Contributor

@dd-octo-sts dd-octo-sts Bot commented Mar 25, 2026

Release proposal for libdd-common and its dependencies

This PR contains version bumps based on public API changes and commits since last release.

libdd-common

Next version: 3.0.1
Semver bump: patch
Tag: libdd-common-v3.0.1

Commits

Co-authored-by: iunanua <18325288+iunanua@users.noreply.github.com>
@iunanua iunanua closed this Mar 25, 2026
@iunanua iunanua deleted the release-proposal-testing/libdd-common/20260325-160632 branch March 25, 2026 16:11
@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Mar 25, 2026

Benchmarks

Comparison

Benchmark execution time: 2026-03-25 16:27:11

Comparing candidate commit 8294fde in PR branch release-proposal-testing/libdd-common/20260325-160632 with baseline commit 5ff99ff in branch release-testing/libdd-common/20260325-160632.

Found 7 performance improvements and 14 performance regressions! Performance is the same for 40 metrics, 0 unstable metrics.

Explanation

This is an A/B test comparing a candidate commit's performance against that of a baseline commit. Performance changes are noted in the tables below as:

  • 🟩 = significantly better candidate vs. baseline
  • 🟥 = significantly worse candidate vs. baseline

We compute a confidence interval (CI) over the relative difference of means between metrics from the candidate and baseline commits, considering the baseline as the reference.

If the CI is entirely outside the configured SIGNIFICANT_IMPACT_THRESHOLD (or the deprecated UNCONFIDENCE_THRESHOLD), the change is considered significant.

Feel free to reach out to #apm-benchmarking-platform on Slack if you have any questions.

More details about the CI and significant changes

You can imagine this CI as a range of values that is likely to contain the true difference of means between the candidate and baseline commits.

CIs of the difference of means are often centered around 0%, because often changes are not that big:

---------------------------------(------|---^--------)-------------------------------->
                              -0.6%    0%  0.3%     +1.2%
                                 |          |        |
         lower bound of the CI --'          |        |
sample mean (center of the CI) -------------'        |
         upper bound of the CI ----------------------'

As described above, a change is considered significant if the CI is entirely outside the configured SIGNIFICANT_IMPACT_THRESHOLD (or the deprecated UNCONFIDENCE_THRESHOLD).

For instance, for an execution time metric, this confidence interval indicates a significantly worse performance:

----------------------------------------|---------|---(---------^---------)---------->
                                       0%        1%  1.3%      2.2%      3.1%
                                                  |   |         |         |
       significant impact threshold --------------'   |         |         |
                      lower bound of CI --------------'         |         |
       sample mean (center of the CI) --------------------------'         |
                      upper bound of CI ----------------------------------'

scenario:benching serializing traces from their internal representation to msgpack

  • 🟩 execution_time [-697.611µs; -685.497µs] or [-4.709%; -4.627%]

scenario:credit_card/is_card_number/ 3782-8224-6310-005

  • 🟥 execution_time [+3.265µs; +3.474µs] or [+4.290%; +4.564%]
  • 🟥 throughput [-575539.264op/s; -540130.323op/s] or [-4.380%; -4.111%]

scenario:credit_card/is_card_number/ 378282246310005

  • 🟥 execution_time [+4.323µs; +4.416µs] or [+6.303%; +6.438%]
  • 🟥 throughput [-881672.719op/s; -864158.303op/s] or [-6.047%; -5.927%]

scenario:credit_card/is_card_number/378282246310005

  • 🟥 execution_time [+4.875µs; +4.959µs] or [+7.523%; +7.653%]
  • 🟥 throughput [-1097071.766op/s; -1079379.859op/s] or [-7.109%; -6.994%]

scenario:credit_card/is_card_number/37828224631000521389798

  • 🟥 execution_time [+6.447µs; +6.472µs] or [+14.095%; +14.148%]
  • 🟥 throughput [-2710742.797op/s; -2699532.664op/s] or [-12.400%; -12.349%]

scenario:credit_card/is_card_number/x371413321323331

  • 🟩 execution_time [-401.026ns; -397.892ns] or [-6.230%; -6.181%]
  • 🟩 throughput [+10236506.604op/s; +10320509.448op/s] or [+6.589%; +6.643%]

scenario:credit_card/is_card_number_no_luhn/ 378282246310005

  • 🟥 execution_time [+3.920µs; +3.967µs] or [+7.217%; +7.304%]
  • 🟥 throughput [-1253921.160op/s; -1238693.571op/s] or [-6.810%; -6.728%]

scenario:credit_card/is_card_number_no_luhn/378282246310005

  • 🟥 execution_time [+4.271µs; +4.344µs] or [+8.468%; +8.613%]
  • 🟥 throughput [-1573510.638op/s; -1546826.853op/s] or [-7.936%; -7.802%]

scenario:credit_card/is_card_number_no_luhn/37828224631000521389798

  • 🟥 execution_time [+6.536µs; +6.557µs] or [+14.312%; +14.359%]
  • 🟥 throughput [-2750662.482op/s; -2740928.071op/s] or [-12.560%; -12.516%]

scenario:credit_card/is_card_number_no_luhn/x371413321323331

  • 🟩 execution_time [-401.457ns; -397.599ns] or [-6.236%; -6.176%]
  • 🟩 throughput [+10227543.034op/s; +10331655.014op/s] or [+6.584%; +6.651%]

scenario:two way interface

  • 🟩 execution_time [-2.238µs; -2.070µs] or [-13.974%; -12.927%]

scenario:write only interface

  • 🟩 execution_time [-312.890ns; -301.667ns] or [-5.508%; -5.311%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8294fde 1774454995 release-proposal-testing/libdd-common/20260325-160632
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 13.719µs 13.861µs ± 0.155µs 13.801µs ± 0.036µs 13.846µs 14.146µs 14.403µs 14.821µs 7.40% 2.387 7.817 1.12% 0.011µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [13.840µs; 13.883µs] or [-0.155%; +0.155%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8294fde 1774454995 release-proposal-testing/libdd-common/20260325-160632
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 34.164µs 34.729µs ± 1.011µs 34.272µs ± 0.044µs 34.329µs 36.889µs 36.934µs 37.834µs 10.39% 1.712 1.015 2.90% 0.071µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [34.589µs; 34.869µs] or [-0.403%; +0.403%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8294fde 1774454995 release-proposal-testing/libdd-common/20260325-160632
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 13.006ms 13.033ms ± 0.014ms 13.032ms ± 0.009ms 13.042ms 13.059ms 13.068ms 13.078ms 0.35% 0.541 0.085 0.11% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [13.031ms; 13.035ms] or [-0.015%; +0.015%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8294fde 1774454995 release-proposal-testing/libdd-common/20260325-160632
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.893µs 3.913µs ± 0.003µs 3.912µs ± 0.002µs 3.914µs 3.916µs 3.920µs 3.921µs 0.22% -1.250 11.867 0.07% 0.000µs 1 200
credit_card/is_card_number/ throughput 255027950.345op/s 255589793.766op/s ± 180312.859op/s 255599779.353op/s ± 108006.950op/s 255704295.835op/s 255799523.924op/s 255845696.746op/s 256874610.532op/s 0.50% 1.276 12.058 0.07% 12750.045op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 78.611µs 79.479µs ± 0.322µs 79.437µs ± 0.240µs 79.707µs 80.039µs 80.205µs 80.418µs 1.24% 0.286 -0.294 0.40% 0.023µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12434965.623op/s 12582174.681op/s ± 50926.733op/s 12588593.478op/s ± 38067.004op/s 12618775.479op/s 12657793.460op/s 12679885.189op/s 12720893.007op/s 1.05% -0.266 -0.305 0.40% 3601.064op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 72.413µs 72.960µs ± 0.319µs 72.904µs ± 0.217µs 73.182µs 73.511µs 73.806µs 74.133µs 1.69% 0.718 0.361 0.44% 0.023µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 13489236.082op/s 13706436.659op/s ± 59787.708op/s 13716680.293op/s ± 40919.033op/s 13749824.927op/s 13789432.891op/s 13805385.982op/s 13809604.066op/s 0.68% -0.694 0.298 0.44% 4227.629op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.893µs 3.912µs ± 0.002µs 3.912µs ± 0.001µs 3.913µs 3.916µs 3.918µs 3.919µs 0.18% -1.995 17.155 0.06% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 255184247.118op/s 255633806.889op/s ± 157277.002op/s 255635963.191op/s ± 86919.941op/s 255721851.432op/s 255824357.566op/s 255918066.018op/s 256858947.571op/s 0.48% 2.023 17.397 0.06% 11121.163op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 69.186µs 69.716µs ± 0.277µs 69.653µs ± 0.177µs 69.928µs 70.165µs 70.518µs 70.639µs 1.42% 0.615 0.091 0.40% 0.020µs 1 200
credit_card/is_card_number/378282246310005 throughput 14156438.476op/s 14344229.641op/s ± 56937.523op/s 14356841.185op/s ± 36386.977op/s 14384605.599op/s 14426041.990op/s 14440239.395op/s 14453821.696op/s 0.68% -0.595 0.051 0.40% 4026.091op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 52.149µs 52.203µs ± 0.034µs 52.200µs ± 0.021µs 52.221µs 52.269µs 52.296µs 52.356µs 0.30% 0.994 1.850 0.07% 0.002µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 19100131.144op/s 19155986.095op/s ± 12485.810op/s 19156913.229op/s ± 7783.192op/s 19164856.923op/s 19173608.104op/s 19175391.051op/s 19175773.328op/s 0.10% -0.988 1.828 0.07% 882.880op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.029µs 6.038µs ± 0.010µs 6.035µs ± 0.002µs 6.038µs 6.050µs 6.084µs 6.108µs 1.21% 4.192 21.140 0.17% 0.001µs 1 200
credit_card/is_card_number/x371413321323331 throughput 163711721.147op/s 165627667.751op/s ± 284419.232op/s 165696967.747op/s ± 68224.674op/s 165753774.669op/s 165827417.642op/s 165854491.983op/s 165875081.148op/s 0.11% -4.163 20.863 0.17% 20111.477op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.893µs 3.912µs ± 0.003µs 3.912µs ± 0.001µs 3.913µs 3.919µs 3.921µs 3.925µs 0.33% -0.098 8.257 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 254778517.059op/s 255601800.104op/s ± 203849.942op/s 255628679.599op/s ± 86936.600op/s 255709768.114op/s 255824543.089op/s 255901706.843op/s 256868417.370op/s 0.48% 0.122 8.367 0.08% 14414.368op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 63.771µs 64.361µs ± 0.171µs 64.354µs ± 0.106µs 64.479µs 64.623µs 64.768µs 64.919µs 0.88% -0.091 1.154 0.26% 0.012µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15403800.256op/s 15537384.439op/s ± 41243.698op/s 15538973.789op/s ± 25667.056op/s 15562812.273op/s 15597514.070op/s 15653728.616op/s 15681224.036op/s 0.92% 0.116 1.173 0.26% 2916.370op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 58.086µs 58.256µs ± 0.112µs 58.228µs ± 0.059µs 58.296µs 58.471µs 58.620µs 58.720µs 0.84% 1.356 2.010 0.19% 0.008µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 17030084.040op/s 17165629.387op/s ± 32830.714op/s 17173730.206op/s ± 17296.631op/s 17189757.058op/s 17202409.631op/s 17208422.612op/s 17215843.741op/s 0.25% -1.343 1.960 0.19% 2321.482op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.894µs 3.912µs ± 0.003µs 3.912µs ± 0.002µs 3.914µs 3.916µs 3.920µs 3.925µs 0.34% -0.458 10.097 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 254763103.206op/s 255622600.955op/s ± 184180.091op/s 255638358.556op/s ± 100533.237op/s 255723265.011op/s 255859103.440op/s 255892621.411op/s 256815894.854op/s 0.46% 0.484 10.199 0.07% 13023.499op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 54.568µs 54.745µs ± 0.177µs 54.670µs ± 0.052µs 54.831µs 55.105µs 55.342µs 55.477µs 1.48% 1.657 2.520 0.32% 0.012µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 18025347.776op/s 18266736.086op/s ± 58582.240op/s 18291446.006op/s ± 17567.522op/s 18305469.677op/s 18319685.785op/s 18325047.426op/s 18325859.621op/s 0.19% -1.640 2.438 0.32% 4142.390op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 52.149µs 52.210µs ± 0.033µs 52.206µs ± 0.020µs 52.228µs 52.269µs 52.302µs 52.320µs 0.22% 0.794 0.618 0.06% 0.002µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 19113284.938op/s 19153568.224op/s ± 12215.568op/s 19155008.716op/s ± 7469.184op/s 19161902.784op/s 19170314.002op/s 19174774.090op/s 19176001.234op/s 0.11% -0.790 0.609 0.06% 863.771op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.026µs 6.038µs ± 0.013µs 6.035µs ± 0.002µs 6.037µs 6.072µs 6.104µs 6.111µs 1.27% 3.364 11.988 0.22% 0.001µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 163631739.261op/s 165620478.251op/s ± 362836.426op/s 165707560.778op/s ± 64062.584op/s 165772137.788op/s 165867052.599op/s 165910697.834op/s 165937051.339op/s 0.14% -3.346 11.842 0.22% 25656.410op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.912µs; 3.913µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ throughput [255564804.138op/s; 255614783.394op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [79.434µs; 79.523µs] or [-0.056%; +0.056%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12575116.726op/s; 12589232.637op/s] or [-0.056%; +0.056%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [72.916µs; 73.004µs] or [-0.061%; +0.061%] None None None
credit_card/is_card_number/ 378282246310005 throughput [13698150.658op/s; 13714722.660op/s] or [-0.060%; +0.060%] None None None
credit_card/is_card_number/37828224631 execution_time [3.912µs; 3.912µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/37828224631 throughput [255612009.809op/s; 255655603.969op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/378282246310005 execution_time [69.677µs; 69.754µs] or [-0.055%; +0.055%] None None None
credit_card/is_card_number/378282246310005 throughput [14336338.648op/s; 14352120.634op/s] or [-0.055%; +0.055%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [52.198µs; 52.208µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [19154255.681op/s; 19157716.508op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.036µs; 6.039µs] or [-0.024%; +0.024%] None None None
credit_card/is_card_number/x371413321323331 throughput [165588249.981op/s; 165667085.521op/s] or [-0.024%; +0.024%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.912µs; 3.913µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ throughput [255573548.462op/s; 255630051.745op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [64.338µs; 64.385µs] or [-0.037%; +0.037%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15531668.459op/s; 15543100.419op/s] or [-0.037%; +0.037%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [58.241µs; 58.272µs] or [-0.027%; +0.027%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [17161079.366op/s; 17170179.408op/s] or [-0.027%; +0.027%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.912µs; 3.912µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255597075.366op/s; 255648126.545op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [54.720µs; 54.769µs] or [-0.045%; +0.045%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [18258617.151op/s; 18274855.021op/s] or [-0.044%; +0.044%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [52.205µs; 52.214µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [19151875.264op/s; 19155261.185op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.036µs; 6.040µs] or [-0.031%; +0.031%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [165570192.612op/s; 165670763.890op/s] or [-0.030%; +0.030%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8294fde 1774454995 release-proposal-testing/libdd-common/20260325-160632
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 239.864ns 250.722ns ± 12.749ns 245.126ns ± 3.281ns 252.519ns 282.828ns 293.503ns 294.733ns 20.24% 1.954 3.082 5.07% 0.901ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [248.955ns; 252.489ns] or [-0.705%; +0.705%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8294fde 1774454995 release-proposal-testing/libdd-common/20260325-160632
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample_frames_x1000 execution_time 4.187ms 4.192ms ± 0.002ms 4.191ms ± 0.001ms 4.193ms 4.195ms 4.197ms 4.198ms 0.15% 0.308 -0.094 0.05% 0.000ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample_frames_x1000 execution_time [4.191ms; 4.192ms] or [-0.007%; +0.007%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8294fde 1774454995 release-proposal-testing/libdd-common/20260325-160632
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 185.185µs 185.679µs ± 0.232µs 185.681µs ± 0.184µs 185.859µs 186.056µs 186.203µs 186.319µs 0.34% 0.158 -0.599 0.12% 0.016µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 5367132.672op/s 5385655.089op/s ± 6740.148op/s 5385587.535op/s ± 5349.760op/s 5390974.895op/s 5396553.344op/s 5398924.901op/s 5400011.961op/s 0.27% -0.153 -0.603 0.12% 476.600op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 17.922µs 17.986µs ± 0.035µs 17.980µs ± 0.020µs 18.010µs 18.052µs 18.085µs 18.141µs 0.90% 1.056 1.868 0.20% 0.003µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 55123523.014op/s 55598092.963op/s ± 109266.681op/s 55618496.375op/s ± 61179.003op/s 55662925.004op/s 55749557.370op/s 55786622.606op/s 55798652.205op/s 0.32% -1.040 1.813 0.20% 7726.321op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.120µs 10.211µs ± 0.031µs 10.210µs ± 0.019µs 10.229µs 10.264µs 10.287µs 10.302µs 0.90% 0.137 0.264 0.30% 0.002µs 1 200
normalization/normalize_name/normalize_name/good throughput 97072527.886op/s 97933619.028op/s ± 296985.992op/s 97946063.655op/s ± 185423.624op/s 98129079.892op/s 98407912.804op/s 98592657.515op/s 98813045.718op/s 0.89% -0.117 0.259 0.30% 21000.081op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [185.647µs; 185.711µs] or [-0.017%; +0.017%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [5384720.969op/s; 5386589.208op/s] or [-0.017%; +0.017%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [17.981µs; 17.991µs] or [-0.027%; +0.027%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [55582949.652op/s; 55613236.274op/s] or [-0.027%; +0.027%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.207µs; 10.215µs] or [-0.042%; +0.042%] None None None
normalization/normalize_name/normalize_name/good throughput [97892459.626op/s; 97974778.430op/s] or [-0.042%; +0.042%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8294fde 1774454995 release-proposal-testing/libdd-common/20260325-160632
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.351µs 2.401µs ± 0.021µs 2.396µs ± 0.009µs 2.410µs 2.457µs 2.468µs 2.483µs 3.61% 1.434 2.761 0.88% 0.002µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.398µs; 2.404µs] or [-0.123%; +0.123%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8294fde 1774454995 release-proposal-testing/libdd-common/20260325-160632
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sdk_test_data/rules-based execution_time 144.415µs 146.250µs ± 1.648µs 145.987µs ± 0.517µs 146.533µs 147.729µs 153.520µs 161.598µs 10.69% 5.491 42.013 1.12% 0.117µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sdk_test_data/rules-based execution_time [146.022µs; 146.478µs] or [-0.156%; +0.156%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8294fde 1774454995 release-proposal-testing/libdd-common/20260325-160632
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2598 execution_time 3.416ms 3.451ms ± 0.021ms 3.446ms ± 0.011ms 3.460ms 3.495ms 3.516ms 3.518ms 2.09% 1.109 1.041 0.62% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2598 execution_time [3.448ms; 3.454ms] or [-0.086%; +0.086%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8294fde 1774454995 release-proposal-testing/libdd-common/20260325-160632
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 159.988µs 161.082µs ± 0.536µs 161.027µs ± 0.121µs 161.166µs 161.421µs 161.786µs 167.934µs 4.29% 10.499 132.282 0.33% 0.038µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [161.008µs; 161.157µs] or [-0.046%; +0.046%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8294fde 1774454995 release-proposal-testing/libdd-common/20260325-160632
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
single_flag_killswitch/rules-based execution_time 190.725ns 193.054ns ± 1.901ns 192.842ns ± 1.280ns 193.966ns 196.679ns 198.800ns 199.790ns 3.60% 1.061 1.095 0.98% 0.134ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
single_flag_killswitch/rules-based execution_time [192.790ns; 193.317ns] or [-0.137%; +0.137%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8294fde 1774454995 release-proposal-testing/libdd-common/20260325-160632
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample2_frames_x1000 execution_time 723.415µs 725.012µs ± 0.532µs 725.015µs ± 0.303µs 725.294µs 725.915µs 726.297µs 726.869µs 0.26% 0.131 0.735 0.07% 0.038µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample2_frames_x1000 execution_time [724.939µs; 725.086µs] or [-0.010%; +0.010%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8294fde 1774454995 release-proposal-testing/libdd-common/20260325-160632
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 49.566ms 49.881ms ± 1.222ms 49.724ms ± 0.059ms 49.782ms 49.905ms 57.814ms 61.146ms 22.97% 8.130 65.645 2.44% 0.086ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [49.712ms; 50.050ms] or [-0.340%; +0.340%] None None None

Group 15

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8294fde 1774454995 release-proposal-testing/libdd-common/20260325-160632
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample_timestamped_x1000 execution_time 4.167ms 4.173ms ± 0.007ms 4.172ms ± 0.002ms 4.174ms 4.177ms 4.188ms 4.269ms 2.33% 11.178 142.076 0.18% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample_timestamped_x1000 execution_time [4.172ms; 4.174ms] or [-0.025%; +0.025%] None None None

Group 16

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8294fde 1774454995 release-proposal-testing/libdd-common/20260325-160632
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 5.208µs 5.373µs ± 0.035µs 5.373µs ± 0.025µs 5.405µs 5.423µs 5.430µs 5.432µs 1.11% -0.656 1.441 0.66% 0.002µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [5.368µs; 5.378µs] or [-0.091%; +0.091%] None None None

Group 17

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8294fde 1774454995 release-proposal-testing/libdd-common/20260325-160632
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 14.075ms 14.122ms ± 0.028ms 14.117ms ± 0.010ms 14.128ms 14.188ms 14.222ms 14.301ms 1.30% 2.737 10.589 0.20% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [14.119ms; 14.126ms] or [-0.028%; +0.028%] None None None

Group 18

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8294fde 1774454995 release-proposal-testing/libdd-common/20260325-160632
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 85.311µs 85.568µs ± 0.176µs 85.545µs ± 0.043µs 85.588µs 85.702µs 86.043µs 87.669µs 2.48% 8.863 101.323 0.20% 0.012µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [85.543µs; 85.592µs] or [-0.028%; +0.028%] None None None

Group 19

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8294fde 1774454995 release-proposal-testing/libdd-common/20260325-160632
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 495.245µs 496.130µs ± 0.633µs 496.052µs ± 0.275µs 496.315µs 496.920µs 499.183µs 499.572µs 0.71% 2.881 11.798 0.13% 0.045µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 2001715.470op/s 2015604.864op/s ± 2560.691op/s 2015918.702op/s ± 1118.765op/s 2017118.613op/s 2018233.405op/s 2018913.256op/s 2019203.976op/s 0.16% -2.860 11.669 0.13% 181.068op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 370.441µs 371.201µs ± 0.286µs 371.209µs ± 0.213µs 371.415µs 371.660µs 371.826µs 372.077µs 0.23% 0.061 -0.202 0.08% 0.020µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2687612.909op/s 2693960.617op/s ± 2074.823op/s 2693898.940op/s ± 1543.394op/s 2695539.963op/s 2697278.131op/s 2697946.872op/s 2699483.307op/s 0.21% -0.057 -0.205 0.08% 146.712op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 168.632µs 169.403µs ± 0.295µs 169.425µs ± 0.220µs 169.611µs 169.860µs 170.002µs 170.034µs 0.36% -0.100 -0.552 0.17% 0.021µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5881190.380op/s 5903108.154op/s ± 10286.037op/s 5902323.547op/s ± 7661.567op/s 5910568.427op/s 5919882.000op/s 5924356.785op/s 5930084.851op/s 0.47% 0.108 -0.549 0.17% 727.333op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 38.311µs 38.431µs ± 0.047µs 38.432µs ± 0.030µs 38.457µs 38.509µs 38.547µs 38.563µs 0.34% 0.163 0.010 0.12% 0.003µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 25931876.024op/s 26020451.147op/s ± 32038.547op/s 26020128.141op/s ± 20627.801op/s 26042525.650op/s 26069293.722op/s 26092257.079op/s 26102110.513op/s 0.32% -0.155 0.008 0.12% 2265.467op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 46.176µs 46.286µs ± 0.056µs 46.275µs ± 0.030µs 46.317µs 46.387µs 46.455µs 46.505µs 0.50% 0.999 1.466 0.12% 0.004µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 21503295.380op/s 21604626.913op/s ± 25920.762op/s 21610047.385op/s ± 13798.657op/s 21621399.067op/s 21640077.540op/s 21648811.042op/s 21656097.032op/s 0.21% -0.990 1.439 0.12% 1832.875op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [496.042µs; 496.217µs] or [-0.018%; +0.018%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [2015249.977op/s; 2015959.751op/s] or [-0.018%; +0.018%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [371.161µs; 371.241µs] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2693673.066op/s; 2694248.167op/s] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [169.362µs; 169.444µs] or [-0.024%; +0.024%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5901682.608op/s; 5904533.700op/s] or [-0.024%; +0.024%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [38.425µs; 38.438µs] or [-0.017%; +0.017%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [26016010.912op/s; 26024891.381op/s] or [-0.017%; +0.017%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [46.279µs; 46.294µs] or [-0.017%; +0.017%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [21601034.545op/s; 21608219.282op/s] or [-0.017%; +0.017%] None None None

Group 20

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8294fde 1774454995 release-proposal-testing/libdd-common/20260325-160632
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 4.983µs 5.073µs ± 0.045µs 5.079µs ± 0.047µs 5.101µs 5.133µs 5.134µs 5.148µs 1.35% -0.223 -1.267 0.89% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.066µs; 5.079µs] or [-0.123%; +0.123%] None None None

Baseline

Omitted due to size.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant