chore(release): proposal for libdd-telemetry by dd-octo-sts[bot] · Pull Request #1795 · DataDog/libdatadog

dd-octo-sts · 2026-03-25T16:19:23Z

Release proposal for libdd-telemetry and its dependencies

This PR contains version bumps based on public API changes and commits since last release.

libdd-common

Next version: 3.0.1
Semver bump: patch
Tag: libdd-common-v3.0.1

Commits

chore(build): update reqwest and quinn-proto dependency for dependabot alert (chore(build): update reqwest and quinn-proto dependency for dependabot alert #1774)
chore(build): ekump/APMSP-2718 update aws-lc dependencies (chore(build): ekump/APMSP-2718 update aws-lc dependencies #1751)

libdd-telemetry

Next version: 3.1.0
Semver bump: minor
Tag: libdd-telemetry-v3.1.0

Commits

refactor(sidecar)!: Refactor tarpc away (refactor(sidecar)!: Refactor tarpc away #1742)

Co-authored-by: iunanua <18325288+iunanua@users.noreply.github.com>

pr-commenter · 2026-03-25T16:37:07Z

Benchmarks

Comparison

Benchmark execution time: 2026-03-25 16:36:31

Comparing candidate commit a47e4b0 in PR branch release-proposal-testing/libdd-telemetry/20260325-161437 with baseline commit 5ff99ff in branch release-testing/libdd-telemetry/20260325-161437.

Found 5 performance improvements and 14 performance regressions! Performance is the same for 42 metrics, 0 unstable metrics.

Explanation

This is an A/B test comparing a candidate commit's performance against that of a baseline commit. Performance changes are noted in the tables below as:

🟩 = significantly better candidate vs. baseline
🟥 = significantly worse candidate vs. baseline

We compute a confidence interval (CI) over the relative difference of means between metrics from the candidate and baseline commits, considering the baseline as the reference.

If the CI is entirely outside the configured SIGNIFICANT_IMPACT_THRESHOLD (or the deprecated UNCONFIDENCE_THRESHOLD), the change is considered significant.

Feel free to reach out to #apm-benchmarking-platform on Slack if you have any questions.

More details about the CI and significant changes

You can imagine this CI as a range of values that is likely to contain the true difference of means between the candidate and baseline commits.

CIs of the difference of means are often centered around 0%, because often changes are not that big:

---------------------------------(------|---^--------)-------------------------------->
                              -0.6%    0%  0.3%     +1.2%
                                 |          |        |
         lower bound of the CI --'          |        |
sample mean (center of the CI) -------------'        |
         upper bound of the CI ----------------------'

As described above, a change is considered significant if the CI is entirely outside the configured SIGNIFICANT_IMPACT_THRESHOLD (or the deprecated UNCONFIDENCE_THRESHOLD).

For instance, for an execution time metric, this confidence interval indicates a significantly worse performance:

----------------------------------------|---------|---(---------^---------)---------->
                                       0%        1%  1.3%      2.2%      3.1%
                                                  |   |         |         |
       significant impact threshold --------------'   |         |         |
                      lower bound of CI --------------'         |         |
       sample mean (center of the CI) --------------------------'         |
                      upper bound of CI ----------------------------------'

scenario:benching serializing traces from their internal representation to msgpack

🟩 execution_time [-623.211µs; -611.300µs] or [-4.230%; -4.149%]

scenario:credit_card/is_card_number/ 3782-8224-6310-005

🟥 execution_time [+3.598µs; +3.849µs] or [+4.744%; +5.075%]
🟥 throughput [-639656.514op/s; -596892.036op/s] or [-4.850%; -4.526%]

scenario:credit_card/is_card_number/ 378282246310005

🟥 execution_time [+4.363µs; +4.464µs] or [+6.369%; +6.517%]
🟥 throughput [-892842.326op/s; -873706.646op/s] or [-6.116%; -5.985%]

scenario:credit_card/is_card_number/378282246310005

🟥 execution_time [+4.995µs; +5.075µs] or [+7.718%; +7.843%]
🟥 throughput [-1123676.891op/s; -1106859.263op/s] or [-7.272%; -7.163%]

scenario:credit_card/is_card_number/37828224631000521389798

🟥 execution_time [+6.788µs; +6.804µs] or [+14.944%; +14.979%]
🟥 throughput [-2868758.314op/s; -2861581.650op/s] or [-13.030%; -12.998%]

scenario:credit_card/is_card_number/x371413321323331

🟩 execution_time [-392.644ns; -389.609ns] or [-6.101%; -6.054%]
🟩 throughput [+10014415.550op/s; +10096276.772op/s] or [+6.445%; +6.498%]

scenario:credit_card/is_card_number_no_luhn/ 378282246310005

🟥 execution_time [+4.000µs; +4.052µs] or [+7.372%; +7.468%]
🟥 throughput [-1281015.421op/s; -1264748.575op/s] or [-6.951%; -6.863%]

scenario:credit_card/is_card_number_no_luhn/378282246310005

🟥 execution_time [+4.275µs; +4.342µs] or [+8.478%; +8.611%]
🟥 throughput [-1573682.936op/s; -1549078.241op/s] or [-7.934%; -7.810%]

scenario:credit_card/is_card_number_no_luhn/37828224631000521389798

🟥 execution_time [+6.749µs; +6.767µs] or [+14.851%; +14.891%]
🟥 throughput [-2852972.278op/s; -2844538.199op/s] or [-12.965%; -12.927%]

scenario:credit_card/is_card_number_no_luhn/x371413321323331

🟩 execution_time [-395.760ns; -392.867ns] or [-6.148%; -6.103%]
🟩 throughput [+10096574.832op/s; +10174365.820op/s] or [+6.500%; +6.550%]

Candidate

Candidate benchmark details

Group 1

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	`a47e4b0`	1774455545	release-proposal-testing/libdd-telemetry/20260325-161437

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
ip_address/quantize_peer_ip_address_benchmark	execution_time	4.958µs	5.027µs ± 0.042µs	5.027µs ± 0.040µs	5.059µs	5.092µs	5.096µs	5.097µs	1.40%	0.047	-1.355	0.83%	0.003µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark	execution_time	[5.022µs; 5.033µs] or [-0.115%; +0.115%]	None	None	None

Group 2

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	`a47e4b0`	1774455545	release-proposal-testing/libdd-telemetry/20260325-161437

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
profile_add_sample_timestamped_x1000	execution_time	4.211ms	4.217ms ± 0.008ms	4.216ms ± 0.001ms	4.217ms	4.220ms	4.225ms	4.328ms	2.65%	12.002	156.391	0.20%	0.001ms	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
profile_add_sample_timestamped_x1000	execution_time	[4.216ms; 4.218ms] or [-0.027%; +0.027%]	None	None	None

Group 3

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	`a47e4b0`	1774455545	release-proposal-testing/libdd-telemetry/20260325-161437

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
tags/replace_trace_tags	execution_time	2.330µs	2.401µs ± 0.023µs	2.397µs ± 0.007µs	2.411µs	2.454µs	2.465µs	2.467µs	2.90%	0.273	2.228	0.94%	0.002µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
tags/replace_trace_tags	execution_time	[2.398µs; 2.404µs] or [-0.131%; +0.131%]	None	None	None

Group 4

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	`a47e4b0`	1774455545	release-proposal-testing/libdd-telemetry/20260325-161437

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
profile_add_sample_frames_x1000	execution_time	4.249ms	4.253ms ± 0.003ms	4.252ms ± 0.001ms	4.253ms	4.256ms	4.261ms	4.279ms	0.64%	5.492	49.275	0.06%	0.000ms	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
profile_add_sample_frames_x1000	execution_time	[4.252ms; 4.253ms] or [-0.009%; +0.009%]	None	None	None

Group 5

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	`a47e4b0`	1774455545	release-proposal-testing/libdd-telemetry/20260325-161437

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_trace/test_trace	execution_time	241.114ns	252.637ns ± 12.516ns	246.946ns ± 3.103ns	256.725ns	282.038ns	286.133ns	290.674ns	17.71%	1.526	1.144	4.94%	0.885ns	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_trace/test_trace	execution_time	[250.902ns; 254.371ns] or [-0.687%; +0.687%]	None	None	None

Group 6

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	`a47e4b0`	1774455545	release-proposal-testing/libdd-telemetry/20260325-161437

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
sql/obfuscate_sql_string	execution_time	84.198µs	84.563µs ± 0.148µs	84.550µs ± 0.067µs	84.607µs	84.767µs	84.964µs	85.942µs	1.65%	4.484	36.996	0.17%	0.010µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
sql/obfuscate_sql_string	execution_time	[84.543µs; 84.584µs] or [-0.024%; +0.024%]	None	None	None

Group 7

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	`a47e4b0`	1774455545	release-proposal-testing/libdd-telemetry/20260325-161437

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
redis/obfuscate_redis_string	execution_time	34.007µs	34.626µs ± 1.008µs	34.154µs ± 0.072µs	34.295µs	36.782µs	36.845µs	37.648µs	10.23%	1.690	0.962	2.90%	0.071µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
redis/obfuscate_redis_string	execution_time	[34.486µs; 34.765µs] or [-0.403%; +0.403%]	None	None	None

Group 8

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	`a47e4b0`	1774455545	release-proposal-testing/libdd-telemetry/20260325-161437

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
benching serializing traces from their internal representation to msgpack	execution_time	14.076ms	14.115ms ± 0.027ms	14.110ms ± 0.010ms	14.120ms	14.159ms	14.225ms	14.301ms	1.35%	3.175	15.213	0.19%	0.002ms	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
benching serializing traces from their internal representation to msgpack	execution_time	[14.111ms; 14.119ms] or [-0.026%; +0.026%]	None	None	None

Group 9

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	`a47e4b0`	1774455545	release-proposal-testing/libdd-telemetry/20260325-161437

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	execution_time	185.258µs	185.705µs ± 0.281µs	185.693µs ± 0.194µs	185.880µs	186.145µs	186.255µs	187.514µs	0.98%	1.562	7.437	0.15%	0.020µs	1	200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	throughput	5332923.765op/s	5384907.101op/s ± 8142.707op/s	5385241.315op/s ± 5617.537op/s	5391368.540op/s	5395971.570op/s	5397384.921op/s	5397882.654op/s	0.23%	-1.531	7.198	0.15%	575.776op/s	1	200
normalization/normalize_name/normalize_name/bad-name	execution_time	17.904µs	18.021µs ± 0.056µs	18.010µs ± 0.032µs	18.050µs	18.125µs	18.191µs	18.237µs	1.26%	1.160	1.733	0.31%	0.004µs	1	200
normalization/normalize_name/normalize_name/bad-name	throughput	54834186.489op/s	55492176.486op/s ± 171618.401op/s	55524216.262op/s ± 100181.628op/s	55618086.961op/s	55699289.397op/s	55744447.579op/s	55854069.743op/s	0.59%	-1.138	1.661	0.31%	12135.253op/s	1	200
normalization/normalize_name/normalize_name/good	execution_time	10.163µs	10.276µs ± 0.045µs	10.277µs ± 0.028µs	10.304µs	10.351µs	10.383µs	10.447µs	1.66%	0.158	0.621	0.44%	0.003µs	1	200
normalization/normalize_name/normalize_name/good	throughput	95721889.185op/s	97319761.537op/s ± 428052.280op/s	97306613.343op/s ± 266348.915op/s	97577599.425op/s	98089042.013op/s	98262328.995op/s	98400873.139op/s	1.12%	-0.124	0.571	0.44%	30267.867op/s	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	execution_time	[185.666µs; 185.744µs] or [-0.021%; +0.021%]	None	None	None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	throughput	[5383778.600op/s; 5386035.602op/s] or [-0.021%; +0.021%]	None	None	None
normalization/normalize_name/normalize_name/bad-name	execution_time	[18.013µs; 18.028µs] or [-0.043%; +0.043%]	None	None	None
normalization/normalize_name/normalize_name/bad-name	throughput	[55468391.826op/s; 55515961.146op/s] or [-0.043%; +0.043%]	None	None	None
normalization/normalize_name/normalize_name/good	execution_time	[10.269µs; 10.282µs] or [-0.061%; +0.061%]	None	None	None
normalization/normalize_name/normalize_name/good	throughput	[97260437.608op/s; 97379085.466op/s] or [-0.061%; +0.061%]	None	None	None

Group 10

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	`a47e4b0`	1774455545	release-proposal-testing/libdd-telemetry/20260325-161437

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
benching string interning on wordpress profile	execution_time	160.769µs	161.450µs ± 0.255µs	161.397µs ± 0.102µs	161.539µs	161.965µs	162.285µs	162.294µs	0.56%	1.107	1.879	0.16%	0.018µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
benching string interning on wordpress profile	execution_time	[161.415µs; 161.486µs] or [-0.022%; +0.022%]	None	None	None

Group 11

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	`a47e4b0`	1774455545	release-proposal-testing/libdd-telemetry/20260325-161437

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
two way interface	execution_time	13.596µs	13.830µs ± 0.247µs	13.759µs ± 0.037µs	13.796µs	14.561µs	14.686µs	14.737µs	7.11%	2.644	5.506	1.78%	0.017µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
two way interface	execution_time	[13.796µs; 13.864µs] or [-0.247%; +0.247%]	None	None	None

Group 12

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	`a47e4b0`	1774455545	release-proposal-testing/libdd-telemetry/20260325-161437

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
sdk_test_data/rules-based	execution_time	144.668µs	146.792µs ± 1.741µs	146.618µs ± 0.512µs	147.076µs	148.171µs	153.686µs	163.882µs	11.77%	6.260	52.173	1.18%	0.123µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
sdk_test_data/rules-based	execution_time	[146.551µs; 147.034µs] or [-0.164%; +0.164%]	None	None	None

Group 13

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	`a47e4b0`	1774455545	release-proposal-testing/libdd-telemetry/20260325-161437

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
concentrator/add_spans_to_concentrator	execution_time	12.996ms	13.033ms ± 0.015ms	13.031ms ± 0.009ms	13.041ms	13.059ms	13.070ms	13.092ms	0.47%	0.620	0.797	0.11%	0.001ms	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
concentrator/add_spans_to_concentrator	execution_time	[13.031ms; 13.035ms] or [-0.016%; +0.016%]	None	None	None

Group 14

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	`a47e4b0`	1774455545	release-proposal-testing/libdd-telemetry/20260325-161437

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
write only interface	execution_time	5.405µs	5.497µs ± 0.031µs	5.499µs ± 0.019µs	5.515µs	5.556µs	5.577µs	5.609µs	2.01%	0.397	0.976	0.56%	0.002µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
write only interface	execution_time	[5.493µs; 5.502µs] or [-0.078%; +0.078%]	None	None	None

Group 15

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	`a47e4b0`	1774455545	release-proposal-testing/libdd-telemetry/20260325-161437

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
credit_card/is_card_number/	execution_time	3.893µs	3.913µs ± 0.003µs	3.912µs ± 0.002µs	3.914µs	3.917µs	3.918µs	3.919µs	0.17%	-1.650	12.887	0.07%	0.000µs	1	200
credit_card/is_card_number/	throughput	255177625.882op/s	255589059.178op/s ± 178074.582op/s	255611928.913op/s ± 111214.032op/s	255698989.990op/s	255808775.007op/s	255884874.535op/s	256897037.436op/s	0.50%	1.675	13.103	0.07%	12591.774op/s	1	200
credit_card/is_card_number/ 3782-8224-6310-005	execution_time	78.874µs	79.560µs ± 0.404µs	79.505µs ± 0.274µs	79.779µs	80.235µs	80.625µs	81.292µs	2.25%	0.844	1.197	0.51%	0.029µs	1	200
credit_card/is_card_number/ 3782-8224-6310-005	throughput	12301311.847op/s	12569405.378op/s ± 63562.693op/s	12577788.256op/s ± 43468.467op/s	12621172.650op/s	12659593.645op/s	12671024.374op/s	12678431.312op/s	0.80%	-0.807	1.063	0.50%	4494.561op/s	1	200
credit_card/is_card_number/ 378282246310005	execution_time	72.309µs	72.917µs ± 0.353µs	72.867µs ± 0.190µs	73.048µs	73.650µs	74.085µs	74.682µs	2.49%	1.453	3.442	0.48%	0.025µs	1	200
credit_card/is_card_number/ 378282246310005	throughput	13390077.506op/s	13714611.390op/s ± 65956.294op/s	13723555.678op/s ± 35672.441op/s	13760191.445op/s	13794863.704op/s	13813241.095op/s	13829614.737op/s	0.77%	-1.405	3.214	0.48%	4663.814op/s	1	200
credit_card/is_card_number/37828224631	execution_time	3.892µs	3.913µs ± 0.003µs	3.912µs ± 0.001µs	3.913µs	3.919µs	3.921µs	3.923µs	0.28%	-0.517	9.901	0.08%	0.000µs	1	200
credit_card/is_card_number/37828224631	throughput	254877535.680op/s	255587203.313op/s ± 206229.367op/s	255603024.217op/s ± 90193.317op/s	255696541.705op/s	255816658.794op/s	255888221.145op/s	256961294.514op/s	0.53%	0.545	10.065	0.08%	14582.618op/s	1	200
credit_card/is_card_number/378282246310005	execution_time	69.266µs	69.750µs ± 0.276µs	69.708µs ± 0.210µs	69.951µs	70.249µs	70.434µs	70.600µs	1.28%	0.531	-0.144	0.39%	0.019µs	1	200
credit_card/is_card_number/378282246310005	throughput	14164276.691op/s	14337126.123op/s ± 56528.613op/s	14345565.063op/s ± 43065.202op/s	14379118.656op/s	14419011.108op/s	14435108.074op/s	14437165.595op/s	0.64%	-0.513	-0.178	0.39%	3997.177op/s	1	200
credit_card/is_card_number/37828224631000521389798	execution_time	52.138µs	52.218µs ± 0.033µs	52.216µs ± 0.024µs	52.241µs	52.270µs	52.297µs	52.298µs	0.16%	0.213	-0.497	0.06%	0.002µs	1	200
credit_card/is_card_number/37828224631000521389798	throughput	19121146.305op/s	19150662.011op/s ± 12000.317op/s	19151062.333op/s ± 8938.882op/s	19160020.701op/s	19168611.590op/s	19174680.622op/s	19179702.121op/s	0.15%	-0.210	-0.499	0.06%	848.551op/s	1	200
credit_card/is_card_number/x371413321323331	execution_time	6.030µs	6.044µs ± 0.010µs	6.043µs ± 0.004µs	6.047µs	6.057µs	6.080µs	6.122µs	1.31%	3.226	16.538	0.17%	0.001µs	1	200
credit_card/is_card_number/x371413321323331	throughput	163350049.094op/s	165442421.148op/s ± 284841.856op/s	165490916.674op/s ± 110954.629op/s	165599689.501op/s	165722391.788op/s	165816321.997op/s	165835204.070op/s	0.21%	-3.185	16.137	0.17%	20141.361op/s	1	200
credit_card/is_card_number_no_luhn/	execution_time	3.894µs	3.912µs ± 0.003µs	3.912µs ± 0.001µs	3.913µs	3.916µs	3.918µs	3.927µs	0.38%	-0.412	13.916	0.07%	0.000µs	1	200
credit_card/is_card_number_no_luhn/	throughput	254669074.121op/s	255621529.974op/s ± 170779.511op/s	255625651.280op/s ± 88664.039op/s	255713392.993op/s	255829296.127op/s	255893027.532op/s	256784297.374op/s	0.45%	0.443	14.013	0.07%	12075.935op/s	1	200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	execution_time	63.771µs	64.308µs ± 0.176µs	64.284µs ± 0.098µs	64.402µs	64.641µs	64.749µs	64.990µs	1.10%	0.445	1.332	0.27%	0.012µs	1	200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	throughput	15386968.954op/s	15550213.276op/s ± 42398.554op/s	15555930.050op/s ± 23623.816op/s	15576636.214op/s	15613403.262op/s	15640960.007op/s	15681012.817op/s	0.80%	-0.419	1.308	0.27%	2998.030op/s	1	200
credit_card/is_card_number_no_luhn/ 378282246310005	execution_time	58.086µs	58.289µs ± 0.146µs	58.247µs ± 0.073µs	58.348µs	58.614µs	58.730µs	58.985µs	1.27%	1.571	2.870	0.25%	0.010µs	1	200
credit_card/is_card_number_no_luhn/ 378282246310005	throughput	16953457.732op/s	17156140.298op/s ± 42911.661op/s	17168216.483op/s ± 21445.288op/s	17187141.870op/s	17200695.339op/s	17204170.698op/s	17215740.351op/s	0.28%	-1.554	2.780	0.25%	3034.313op/s	1	200
credit_card/is_card_number_no_luhn/37828224631	execution_time	3.897µs	3.912µs ± 0.004µs	3.911µs ± 0.001µs	3.914µs	3.917µs	3.921µs	3.939µs	0.70%	3.111	21.607	0.09%	0.000µs	1	200
credit_card/is_card_number_no_luhn/37828224631	throughput	253882657.163op/s	255613734.157op/s ± 237514.233op/s	255659465.198op/s ± 97543.040op/s	255740080.864op/s	255816941.599op/s	255900764.131op/s	256611149.207op/s	0.37%	-3.072	21.348	0.09%	16794.792op/s	1	200
credit_card/is_card_number_no_luhn/378282246310005	execution_time	54.531µs	54.727µs ± 0.164µs	54.661µs ± 0.058µs	54.801µs	55.033µs	55.207µs	55.684µs	1.87%	2.054	6.000	0.30%	0.012µs	1	200
credit_card/is_card_number_no_luhn/378282246310005	throughput	17958478.232op/s	18272515.653op/s ± 54404.625op/s	18294682.651op/s ± 19373.443op/s	18309276.395op/s	18320331.354op/s	18329214.954op/s	18338325.266op/s	0.24%	-2.021	5.751	0.30%	3846.988op/s	1	200
credit_card/is_card_number_no_luhn/37828224631000521389798	execution_time	52.138µs	52.202µs ± 0.029µs	52.197µs ± 0.016µs	52.218µs	52.260µs	52.284µs	52.324µs	0.24%	1.012	2.028	0.06%	0.002µs	1	200
credit_card/is_card_number_no_luhn/37828224631000521389798	throughput	19111850.412op/s	19156341.888op/s ± 10716.209op/s	19158025.724op/s ± 5724.390op/s	19162642.907op/s	19170908.338op/s	19175542.442op/s	19179918.625op/s	0.11%	-1.007	2.013	0.06%	757.750op/s	1	200
credit_card/is_card_number_no_luhn/x371413321323331	execution_time	6.031µs	6.043µs ± 0.010µs	6.042µs ± 0.004µs	6.047µs	6.054µs	6.090µs	6.110µs	1.12%	3.250	15.571	0.16%	0.001µs	1	200
credit_card/is_card_number_no_luhn/x371413321323331	throughput	163676554.964op/s	165469944.649op/s ± 267158.597op/s	165509061.049op/s ± 114623.139op/s	165619497.561op/s	165722951.538op/s	165806450.589op/s	165822467.422op/s	0.19%	-3.216	15.296	0.16%	18890.966op/s	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
credit_card/is_card_number/	execution_time	[3.912µs; 3.913µs] or [-0.010%; +0.010%]	None	None	None
credit_card/is_card_number/	throughput	[255564379.754op/s; 255613738.602op/s] or [-0.010%; +0.010%]	None	None	None
credit_card/is_card_number/ 3782-8224-6310-005	execution_time	[79.504µs; 79.616µs] or [-0.070%; +0.070%]	None	None	None
credit_card/is_card_number/ 3782-8224-6310-005	throughput	[12560596.200op/s; 12578214.556op/s] or [-0.070%; +0.070%]	None	None	None
credit_card/is_card_number/ 378282246310005	execution_time	[72.868µs; 72.966µs] or [-0.067%; +0.067%]	None	None	None
credit_card/is_card_number/ 378282246310005	throughput	[13705470.482op/s; 13723752.298op/s] or [-0.067%; +0.067%]	None	None	None
credit_card/is_card_number/37828224631	execution_time	[3.912µs; 3.913µs] or [-0.011%; +0.011%]	None	None	None
credit_card/is_card_number/37828224631	throughput	[255558621.907op/s; 255615784.720op/s] or [-0.011%; +0.011%]	None	None	None
credit_card/is_card_number/378282246310005	execution_time	[69.712µs; 69.788µs] or [-0.055%; +0.055%]	None	None	None
credit_card/is_card_number/378282246310005	throughput	[14329291.801op/s; 14344960.445op/s] or [-0.055%; +0.055%]	None	None	None
credit_card/is_card_number/37828224631000521389798	execution_time	[52.213µs; 52.222µs] or [-0.009%; +0.009%]	None	None	None
credit_card/is_card_number/37828224631000521389798	throughput	[19148998.882op/s; 19152325.139op/s] or [-0.009%; +0.009%]	None	None	None
credit_card/is_card_number/x371413321323331	execution_time	[6.043µs; 6.046µs] or [-0.024%; +0.024%]	None	None	None
credit_card/is_card_number/x371413321323331	throughput	[165402944.806op/s; 165481897.489op/s] or [-0.024%; +0.024%]	None	None	None
credit_card/is_card_number_no_luhn/	execution_time	[3.912µs; 3.912µs] or [-0.009%; +0.009%]	None	None	None
credit_card/is_card_number_no_luhn/	throughput	[255597861.577op/s; 255645198.372op/s] or [-0.009%; +0.009%]	None	None	None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	execution_time	[64.284µs; 64.333µs] or [-0.038%; +0.038%]	None	None	None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	throughput	[15544337.244op/s; 15556089.308op/s] or [-0.038%; +0.038%]	None	None	None
credit_card/is_card_number_no_luhn/ 378282246310005	execution_time	[58.268µs; 58.309µs] or [-0.035%; +0.035%]	None	None	None
credit_card/is_card_number_no_luhn/ 378282246310005	throughput	[17150193.154op/s; 17162087.441op/s] or [-0.035%; +0.035%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631	execution_time	[3.912µs; 3.913µs] or [-0.013%; +0.013%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631	throughput	[255580816.968op/s; 255646651.345op/s] or [-0.013%; +0.013%]	None	None	None
credit_card/is_card_number_no_luhn/378282246310005	execution_time	[54.705µs; 54.750µs] or [-0.042%; +0.042%]	None	None	None
credit_card/is_card_number_no_luhn/378282246310005	throughput	[18264975.695op/s; 18280055.610op/s] or [-0.041%; +0.041%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631000521389798	execution_time	[52.198µs; 52.206µs] or [-0.008%; +0.008%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631000521389798	throughput	[19154856.724op/s; 19157827.051op/s] or [-0.008%; +0.008%]	None	None	None
credit_card/is_card_number_no_luhn/x371413321323331	execution_time	[6.042µs; 6.045µs] or [-0.022%; +0.022%]	None	None	None
credit_card/is_card_number_no_luhn/x371413321323331	throughput	[165432919.037op/s; 165506970.261op/s] or [-0.022%; +0.022%]	None	None	None

Group 16

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	`a47e4b0`	1774455545	release-proposal-testing/libdd-telemetry/20260325-161437

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
single_flag_killswitch/rules-based	execution_time	189.996ns	192.177ns ± 1.950ns	192.036ns ± 1.425ns	193.117ns	195.864ns	199.157ns	200.784ns	4.56%	1.468	3.046	1.01%	0.138ns	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
single_flag_killswitch/rules-based	execution_time	[191.907ns; 192.448ns] or [-0.141%; +0.141%]	None	None	None

Group 17

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	`a47e4b0`	1774455545	release-proposal-testing/libdd-telemetry/20260325-161437

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
receiver_entry_point/report/2598	execution_time	3.416ms	3.448ms ± 0.022ms	3.443ms ± 0.011ms	3.455ms	3.495ms	3.521ms	3.561ms	3.44%	1.856	4.832	0.63%	0.002ms	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
receiver_entry_point/report/2598	execution_time	[3.445ms; 3.451ms] or [-0.088%; +0.088%]	None	None	None

Group 18

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	`a47e4b0`	1774455545	release-proposal-testing/libdd-telemetry/20260325-161437

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
profile_add_sample2_frames_x1000	execution_time	735.469µs	736.719µs ± 0.626µs	736.640µs ± 0.361µs	737.045µs	737.914µs	738.707µs	739.370µs	0.37%	1.073	2.220	0.08%	0.044µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
profile_add_sample2_frames_x1000	execution_time	[736.632µs; 736.806µs] or [-0.012%; +0.012%]	None	None	None

Group 19

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	`a47e4b0`	1774455545	release-proposal-testing/libdd-telemetry/20260325-161437

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
benching deserializing traces from msgpack to their internal representation	execution_time	49.241ms	49.503ms ± 0.761ms	49.370ms ± 0.071ms	49.444ms	49.728ms	53.149ms	56.895ms	15.24%	7.451	60.761	1.53%	0.054ms	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
benching deserializing traces from msgpack to their internal representation	execution_time	[49.397ms; 49.608ms] or [-0.213%; +0.213%]	None	None	None

Group 20

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	`a47e4b0`	1774455545	release-proposal-testing/libdd-telemetry/20260325-161437

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	execution_time	495.319µs	496.122µs ± 0.775µs	496.025µs ± 0.232µs	496.284µs	496.747µs	497.698µs	505.079µs	1.83%	8.274	89.231	0.16%	0.055µs	1	200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	throughput	1979888.077op/s	2015636.169op/s ± 3109.982op/s	2016027.531op/s ± 942.809op/s	2016938.982op/s	2017782.176op/s	2018651.553op/s	2018902.083op/s	0.14%	-8.168	87.501	0.15%	219.909op/s	1	200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	execution_time	370.436µs	371.138µs ± 0.305µs	371.142µs ± 0.207µs	371.349µs	371.632µs	371.853µs	371.970µs	0.22%	0.096	-0.253	0.08%	0.022µs	1	200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	throughput	2688389.791op/s	2694420.672op/s ± 2217.586op/s	2694389.987op/s ± 1505.342op/s	2695894.460op/s	2697926.565op/s	2698926.728op/s	2699523.546op/s	0.19%	-0.091	-0.255	0.08%	156.807op/s	1	200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	execution_time	167.852µs	168.175µs ± 0.176µs	168.155µs ± 0.118µs	168.278µs	168.500µs	168.645µs	168.693µs	0.32%	0.587	0.054	0.10%	0.012µs	1	200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	throughput	5927912.721op/s	5946190.237op/s ± 6231.467op/s	5946910.684op/s ± 4157.913op/s	5950905.995op/s	5955000.280op/s	5956776.624op/s	5957618.610op/s	0.18%	-0.582	0.045	0.10%	440.631op/s	1	200
normalization/normalize_service/normalize_service/[empty string]	execution_time	38.258µs	38.362µs ± 0.047µs	38.360µs ± 0.037µs	38.397µs	38.440µs	38.466µs	38.513µs	0.40%	0.281	-0.380	0.12%	0.003µs	1	200
normalization/normalize_service/normalize_service/[empty string]	throughput	25965004.150op/s	26067283.170op/s ± 31990.502op/s	26068764.719op/s ± 25409.312op/s	26094314.697op/s	26114136.980op/s	26121124.799op/s	26138536.749op/s	0.27%	-0.276	-0.388	0.12%	2262.070op/s	1	200
normalization/normalize_service/normalize_service/test_ASCII	execution_time	46.192µs	46.278µs ± 0.055µs	46.267µs ± 0.027µs	46.296µs	46.392µs	46.464µs	46.529µs	0.57%	1.644	3.624	0.12%	0.004µs	1	200
normalization/normalize_service/normalize_service/test_ASCII	throughput	21492156.518op/s	21608539.226op/s ± 25810.136op/s	21613611.838op/s ± 12439.322op/s	21625105.771op/s	21639659.577op/s	21647576.065op/s	21648790.508op/s	0.16%	-1.634	3.580	0.12%	1825.052op/s	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	execution_time	[496.015µs; 496.230µs] or [-0.022%; +0.022%]	None	None	None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	throughput	[2015205.155op/s; 2016067.182op/s] or [-0.021%; +0.021%]	None	None	None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	execution_time	[371.095µs; 371.180µs] or [-0.011%; +0.011%]	None	None	None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	throughput	[2694113.336op/s; 2694728.008op/s] or [-0.011%; +0.011%]	None	None	None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	execution_time	[168.151µs; 168.200µs] or [-0.015%; +0.015%]	None	None	None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	throughput	[5945326.615op/s; 5947053.858op/s] or [-0.015%; +0.015%]	None	None	None
normalization/normalize_service/normalize_service/[empty string]	execution_time	[38.356µs; 38.369µs] or [-0.017%; +0.017%]	None	None	None
normalization/normalize_service/normalize_service/[empty string]	throughput	[26062849.594op/s; 26071716.746op/s] or [-0.017%; +0.017%]	None	None	None
normalization/normalize_service/normalize_service/test_ASCII	execution_time	[46.270µs; 46.286µs] or [-0.017%; +0.017%]	None	None	None
normalization/normalize_service/normalize_service/test_ASCII	throughput	[21604962.189op/s; 21612116.262op/s] or [-0.017%; +0.017%]	None	None	None

Baseline

Omitted due to size.

github-actions Bot and others added 2 commits March 25, 2026 16:19

chore: Release

0d222e7

Co-authored-by: iunanua <18325288+iunanua@users.noreply.github.com>

chore: Release

a47e4b0

Co-authored-by: iunanua <18325288+iunanua@users.noreply.github.com>

dd-octo-sts Bot added skip-changelog-check skip-metadata-check release-proposal This is a release proposal PR labels Mar 25, 2026

iunanua closed this Mar 25, 2026

iunanua deleted the release-proposal-testing/libdd-telemetry/20260325-161437 branch March 30, 2026 08:13

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

chore(release): proposal for libdd-telemetry#1795

chore(release): proposal for libdd-telemetry#1795
dd-octo-sts[bot] wants to merge 2 commits intorelease-testing/libdd-telemetry/20260325-161437from
release-proposal-testing/libdd-telemetry/20260325-161437

dd-octo-sts Bot commented Mar 25, 2026

Uh oh!

pr-commenter Bot commented Mar 25, 2026 •

edited

Loading

Explanation

More details about the CI and significant changes

Group 1

Group 2

Group 3

Group 4

Group 5

Group 6

Group 7

Group 8

Group 9

Group 10

Group 11

Group 12

Group 13

Group 14

Group 15

Group 16

Group 17

Group 18

Group 19

Group 20

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Conversation

dd-octo-sts Bot commented Mar 25, 2026

Release proposal for libdd-telemetry and its dependencies

libdd-common

Commits

libdd-telemetry

Commits

Uh oh!

pr-commenter Bot commented Mar 25, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Comparison

Explanation

More details about the CI and significant changes

scenario:benching serializing traces from their internal representation to msgpack

scenario:credit_card/is_card_number/ 3782-8224-6310-005

scenario:credit_card/is_card_number/ 378282246310005

scenario:credit_card/is_card_number/378282246310005

scenario:credit_card/is_card_number/37828224631000521389798

scenario:credit_card/is_card_number/x371413321323331

scenario:credit_card/is_card_number_no_luhn/ 378282246310005

scenario:credit_card/is_card_number_no_luhn/378282246310005

scenario:credit_card/is_card_number_no_luhn/37828224631000521389798

scenario:credit_card/is_card_number_no_luhn/x371413321323331

Candidate

Group 1

Group 2

Group 3

Group 4

Group 5

Group 6

Group 7

Group 8

Group 9

Group 10

Group 11

Group 12

Group 13

Group 14

Group 15

Group 16

Group 17

Group 18

Group 19

Group 20

Baseline

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

pr-commenter Bot commented Mar 25, 2026 •

edited

Loading