Skip to content

Bump version to 14.3.0 in preperation for release#760

Merged
danielsn merged 1 commit intomainfrom
dsn/14.3.0
Nov 26, 2024
Merged

Bump version to 14.3.0 in preperation for release#760
danielsn merged 1 commit intomainfrom
dsn/14.3.0

Conversation

@danielsn
Copy link
Copy Markdown
Contributor

What does this PR do?

Bumps the version to 14.3.0 in preparation for release

Motivation

We want to get the fix in #754 out as fast as possible

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

@danielsn danielsn requested a review from a team as a code owner November 25, 2024 23:16
@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Nov 25, 2024

Benchmarks

Comparison

Benchmark execution time: 2024-11-25 23:26:14

Comparing candidate commit 0a8566a in PR branch dsn/14.3.0 with baseline commit 6fe032f in branch main.

Found 10 performance improvements and 5 performance regressions! Performance is the same for 36 metrics, 2 unstable metrics.

scenario:credit_card/is_card_number/x371413321323331

  • 🟥 execution_time [+802.850ns; +804.488ns] or [+11.735%; +11.759%]
  • 🟥 throughput [-15380359.971op/s; -15349264.898op/s] or [-10.523%; -10.501%]

scenario:credit_card/is_card_number_no_luhn/x371413321323331

  • 🟥 execution_time [+803.053ns; +804.947ns] or [+11.736%; +11.763%]
  • 🟥 throughput [-15383022.767op/s; -15347006.987op/s] or [-10.526%; -10.502%]

scenario:normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...

  • 🟩 execution_time [-40.964µs; -40.527µs] or [-13.433%; -13.290%]
  • 🟩 throughput [+503182.110op/s; +508196.125op/s] or [+15.344%; +15.497%]

scenario:normalization/normalize_name/normalize_name/bad-name

  • 🟩 execution_time [-3.950µs; -3.915µs] or [-14.029%; -13.907%]
  • 🟩 throughput [+5743142.531op/s; +5790555.054op/s] or [+16.168%; +16.302%]

scenario:normalization/normalize_name/normalize_name/good

  • 🟩 execution_time [-2.067µs; -2.028µs] or [-12.403%; -12.172%]
  • 🟩 throughput [+8325348.053op/s; +8497873.079op/s] or [+13.872%; +14.160%]

scenario:normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters

  • 🟩 execution_time [-12.393µs; -12.228µs] or [-6.462%; -6.376%]
  • 🟩 throughput [+355240.625op/s; +360216.909op/s] or [+6.813%; +6.908%]

scenario:normalization/normalize_service/normalize_service/test_ASCII

  • 🟩 throughput [+805476.622op/s; +831923.462op/s] or [+4.156%; +4.293%]

scenario:normalization/normalize_trace/test_trace

  • 🟩 execution_time [-74.653ns; -69.534ns] or [-20.511%; -19.105%]

scenario:sql/obfuscate_sql_string

  • 🟥 execution_time [+5.514µs; +5.610µs] or [+7.884%; +8.021%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0a8566a 1732576510 dsn/14.3.0
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 262.672µs 264.201µs ± 0.672µs 264.482µs ± 0.294µs 264.680µs 264.911µs 265.134µs 265.216µs 0.28% -0.880 -0.588 0.25% 0.048µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 3770505.422op/s 3785024.418op/s ± 9647.935op/s 3780979.932op/s ± 4205.195op/s 3790433.503op/s 3803702.575op/s 3805035.583op/s 3807030.265op/s 0.69% 0.885 -0.582 0.25% 682.212op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 24.120µs 24.220µs ± 0.063µs 24.212µs ± 0.034µs 24.247µs 24.327µs 24.445µs 24.546µs 1.38% 1.795 5.362 0.26% 0.004µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 40740529.494op/s 41287707.270op/s ± 106947.800op/s 41302089.686op/s ± 58469.674op/s 41360454.386op/s 41423963.820op/s 41439111.486op/s 41459197.930op/s 0.38% -1.764 5.187 0.26% 7562.351op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 14.494µs 14.616µs ± 0.127µs 14.564µs ± 0.067µs 14.722µs 14.823µs 14.873µs 15.293µs 5.01% 1.173 2.412 0.87% 0.009µs 1 200
normalization/normalize_name/normalize_name/good throughput 65388733.362op/s 68425262.349op/s ± 590787.373op/s 68661573.847op/s ± 316261.556op/s 68967528.069op/s 68981953.396op/s 68987643.186op/s 68991976.738op/s 0.48% -1.099 1.915 0.86% 41774.976op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [264.108µs; 264.294µs] or [-0.035%; +0.035%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [3783687.307op/s; 3786361.529op/s] or [-0.035%; +0.035%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [24.212µs; 24.229µs] or [-0.036%; +0.036%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [41272885.334op/s; 41302529.207op/s] or [-0.036%; +0.036%] None None None
normalization/normalize_name/normalize_name/good execution_time [14.598µs; 14.633µs] or [-0.121%; +0.121%] None None None
normalization/normalize_name/normalize_name/good throughput [68343384.901op/s; 68507139.796op/s] or [-0.120%; +0.120%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0a8566a 1732576510 dsn/14.3.0
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 38.121µs 38.804µs ± 1.156µs 38.273µs ± 0.051µs 38.369µs 41.308µs 41.369µs 41.546µs 8.55% 1.691 0.893 2.97% 0.082µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [38.643µs; 38.964µs] or [-0.413%; +0.413%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0a8566a 1732576510 dsn/14.3.0
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 59.596ms 59.855ms ± 0.160ms 59.831ms ± 0.090ms 59.928ms 60.163ms 60.424ms 60.687ms 1.43% 1.854 5.427 0.27% 0.011ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [59.832ms; 59.877ms] or [-0.037%; +0.037%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0a8566a 1732576510 dsn/14.3.0
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 75.265µs 75.501µs ± 0.284µs 75.455µs ± 0.069µs 75.537µs 75.742µs 76.082µs 78.730µs 4.34% 8.362 86.517 0.38% 0.020µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [75.462µs; 75.540µs] or [-0.052%; +0.052%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0a8566a 1732576510 dsn/14.3.0
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 277.609ns 291.874ns ± 15.275ns 282.744ns ± 4.173ns 306.366ns 322.395ns 330.808ns 337.252ns 19.28% 0.953 -0.340 5.22% 1.080ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [289.757ns; 293.991ns] or [-0.725%; +0.725%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0a8566a 1732576510 dsn/14.3.0
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 624.836µs 626.301µs ± 1.869µs 626.125µs ± 0.258µs 626.355µs 626.848µs 633.142µs 644.701µs 2.97% 8.460 75.614 0.30% 0.132µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1551107.840op/s 1596689.188op/s ± 4647.553op/s 1597125.266op/s ± 657.288op/s 1597820.938op/s 1598845.635op/s 1599556.825op/s 1600419.584op/s 0.21% -8.406 74.841 0.29% 328.632op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 469.301µs 470.461µs ± 0.438µs 470.430µs ± 0.278µs 470.737µs 471.233µs 471.722µs 471.966µs 0.33% 0.419 0.648 0.09% 0.031µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2118797.166op/s 2125574.528op/s ± 1980.150op/s 2125714.534op/s ± 1254.788op/s 2126855.752op/s 2128580.501op/s 2130011.522op/s 2130828.854op/s 0.24% -0.412 0.638 0.09% 140.018op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 178.917µs 179.464µs ± 0.532µs 179.296µs ± 0.220µs 179.611µs 180.553µs 181.495µs 181.776µs 1.38% 1.976 4.321 0.30% 0.038µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5501268.915op/s 5572199.836op/s ± 16429.688op/s 5577368.888op/s ± 6857.158op/s 5583509.989op/s 5586670.624op/s 5588294.061op/s 5589182.288op/s 0.21% -1.955 4.209 0.29% 1161.754op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 47.287µs 47.462µs ± 0.079µs 47.459µs ± 0.051µs 47.508µs 47.604µs 47.641µs 47.698µs 0.50% 0.279 -0.165 0.17% 0.006µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 20965139.167op/s 21069543.220op/s ± 35071.290op/s 21070906.242op/s ± 22749.472op/s 21093333.007op/s 21122318.562op/s 21144092.149op/s 21147397.360op/s 0.36% -0.271 -0.171 0.17% 2479.915op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 49.092µs 49.510µs ± 0.191µs 49.508µs ± 0.122µs 49.630µs 49.770µs 49.887µs 50.764µs 2.54% 1.262 8.020 0.38% 0.013µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 19698931.608op/s 20198226.469op/s ± 77400.571op/s 20198554.161op/s ± 49797.762op/s 20248126.688op/s 20316790.088op/s 20353038.228op/s 20369994.903op/s 0.85% -1.168 7.337 0.38% 5473.047op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [626.042µs; 626.560µs] or [-0.041%; +0.041%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1596045.082op/s; 1597333.294op/s] or [-0.040%; +0.040%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [470.401µs; 470.522µs] or [-0.013%; +0.013%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2125300.098op/s; 2125848.958op/s] or [-0.013%; +0.013%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [179.390µs; 179.538µs] or [-0.041%; +0.041%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5569922.839op/s; 5574476.833op/s] or [-0.041%; +0.041%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [47.451µs; 47.473µs] or [-0.023%; +0.023%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [21064682.677op/s; 21074403.763op/s] or [-0.023%; +0.023%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [49.484µs; 49.536µs] or [-0.053%; +0.053%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [20187499.495op/s; 20208953.444op/s] or [-0.053%; +0.053%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0a8566a 1732576510 dsn/14.3.0
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 4.610µs 4.629µs ± 0.006µs 4.630µs ± 0.004µs 4.633µs 4.637µs 4.639µs 4.659µs 0.65% 0.194 3.301 0.12% 0.000µs 1 200
credit_card/is_card_number/ throughput 214615792.523op/s 216006996.748op/s ± 269427.421op/s 216002106.043op/s ± 167694.200op/s 216159087.756op/s 216447105.051op/s 216681883.477op/s 216921438.888op/s 0.43% -0.174 3.235 0.12% 19051.396op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 90.455µs 90.984µs ± 0.379µs 90.912µs ± 0.161µs 91.119µs 91.425µs 91.679µs 94.934µs 4.42% 5.834 57.142 0.42% 0.027µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 10533600.906op/s 10991146.319op/s ± 44758.628op/s 10999601.144op/s ± 19395.191op/s 11013405.994op/s 11033667.083op/s 11053004.031op/s 11055260.466op/s 0.51% -5.529 52.899 0.41% 3164.913op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 83.915µs 84.676µs ± 0.397µs 84.721µs ± 0.081µs 84.772µs 84.865µs 85.050µs 89.406µs 5.53% 8.267 99.629 0.47% 0.028µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 11184984.224op/s 11810027.675op/s ± 53322.563op/s 11803496.386op/s ± 11293.628op/s 11822181.966op/s 11876498.601op/s 11912362.829op/s 11916803.885op/s 0.96% -7.803 92.963 0.45% 3770.475op/s 1 200
credit_card/is_card_number/37828224631 execution_time 4.616µs 4.630µs ± 0.007µs 4.630µs ± 0.003µs 4.634µs 4.638µs 4.644µs 4.689µs 1.28% 2.969 25.496 0.15% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 213242655.044op/s 215959895.324op/s ± 319656.615op/s 215969403.436op/s ± 162644.818op/s 216125821.633op/s 216431538.833op/s 216603774.246op/s 216632526.076op/s 0.31% -2.887 24.647 0.15% 22603.136op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 79.436µs 80.479µs ± 0.321µs 80.507µs ± 0.240µs 80.701µs 80.972µs 81.108µs 81.282µs 0.96% -0.311 0.016 0.40% 0.023µs 1 200
credit_card/is_card_number/378282246310005 throughput 12302835.981op/s 12425820.831op/s ± 49675.198op/s 12421299.269op/s ± 37127.054op/s 12460587.817op/s 12505831.720op/s 12555872.810op/s 12588740.550op/s 1.35% 0.334 0.045 0.40% 3512.567op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 59.952µs 60.196µs ± 0.093µs 60.191µs ± 0.057µs 60.248µs 60.354µs 60.400µs 60.486µs 0.49% 0.224 0.033 0.15% 0.007µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 16532674.455op/s 16612570.789op/s ± 25567.241op/s 16613792.691op/s ± 15747.841op/s 16629112.178op/s 16651571.988op/s 16670772.352op/s 16679942.369op/s 0.40% -0.215 0.029 0.15% 1807.877op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 7.632µs 7.645µs ± 0.005µs 7.645µs ± 0.002µs 7.647µs 7.653µs 7.655µs 7.661µs 0.20% 0.104 0.792 0.06% 0.000µs 1 200
credit_card/is_card_number/x371413321323331 throughput 130535613.169op/s 130799990.456op/s ± 77467.134op/s 130802969.227op/s ± 39092.748op/s 130841152.822op/s 130927211.498op/s 130994751.357op/s 131020008.799op/s 0.17% -0.099 0.790 0.06% 5477.754op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 4.614µs 4.628µs ± 0.007µs 4.627µs ± 0.005µs 4.632µs 4.638µs 4.644µs 4.654µs 0.57% 0.407 0.323 0.14% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 214886548.947op/s 216094059.141op/s ± 308460.604op/s 216101760.140op/s ± 222222.506op/s 216314646.764op/s 216579071.852op/s 216652503.049op/s 216717347.652op/s 0.28% -0.397 0.300 0.14% 21811.458op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 74.428µs 74.852µs ± 0.090µs 74.860µs ± 0.047µs 74.906µs 74.971µs 75.010µs 75.361µs 0.67% -0.158 6.962 0.12% 0.006µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 13269444.589op/s 13359627.290op/s ± 16131.414op/s 13358315.377op/s ± 8354.930op/s 13366695.875op/s 13386688.953op/s 13407134.611op/s 13435792.952op/s 0.58% 0.190 6.896 0.12% 1140.663op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 67.042µs 67.417µs ± 0.122µs 67.416µs ± 0.078µs 67.493µs 67.620µs 67.715µs 67.809µs 0.58% 0.220 0.386 0.18% 0.009µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 14747229.030op/s 14833193.018op/s ± 26865.410op/s 14833356.697op/s ± 17194.690op/s 14852843.709op/s 14872020.673op/s 14889086.282op/s 14916046.683op/s 0.56% -0.207 0.385 0.18% 1899.671op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 4.610µs 4.629µs ± 0.006µs 4.629µs ± 0.004µs 4.634µs 4.638µs 4.643µs 4.644µs 0.32% -0.350 0.444 0.12% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 215326888.148op/s 216010525.396op/s ± 268871.242op/s 216014937.454op/s ± 172380.080op/s 216175442.585op/s 216424145.822op/s 216680118.129op/s 216912768.932op/s 0.42% 0.359 0.455 0.12% 19012.068op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 62.653µs 62.830µs ± 0.104µs 62.817µs ± 0.059µs 62.882µs 63.011µs 63.117µs 63.478µs 1.05% 1.695 6.963 0.17% 0.007µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 15753582.463op/s 15915914.249op/s ± 26283.355op/s 15919369.986op/s ± 14929.871op/s 15933373.008op/s 15950951.144op/s 15956540.657op/s 15961055.026op/s 0.26% -1.665 6.750 0.16% 1858.514op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 59.997µs 60.176µs ± 0.092µs 60.163µs ± 0.068µs 60.236µs 60.350µs 60.408µs 60.420µs 0.43% 0.523 -0.345 0.15% 0.007µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 16550799.508op/s 16617996.220op/s ± 25470.848op/s 16621562.846op/s ± 18674.573op/s 16639122.444op/s 16653022.905op/s 16659705.030op/s 16667506.696op/s 0.28% -0.517 -0.353 0.15% 1801.061op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 7.641µs 7.647µs ± 0.005µs 7.646µs ± 0.003µs 7.649µs 7.656µs 7.669µs 7.673µs 0.36% 2.052 6.298 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 130322537.320op/s 130772353.809op/s ± 88264.640op/s 130790648.476op/s ± 46584.584op/s 130835862.110op/s 130861783.119op/s 130873832.997op/s 130879247.384op/s 0.07% -2.044 6.249 0.07% 6241.253op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [4.629µs; 4.630µs] or [-0.017%; +0.017%] None None None
credit_card/is_card_number/ throughput [215969656.698op/s; 216044336.797op/s] or [-0.017%; +0.017%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [90.931µs; 91.036µs] or [-0.058%; +0.058%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [10984943.203op/s; 10997349.434op/s] or [-0.056%; +0.056%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [84.621µs; 84.731µs] or [-0.065%; +0.065%] None None None
credit_card/is_card_number/ 378282246310005 throughput [11802637.681op/s; 11817417.669op/s] or [-0.063%; +0.063%] None None None
credit_card/is_card_number/37828224631 execution_time [4.630µs; 4.631µs] or [-0.021%; +0.021%] None None None
credit_card/is_card_number/37828224631 throughput [215915593.991op/s; 216004196.656op/s] or [-0.021%; +0.021%] None None None
credit_card/is_card_number/378282246310005 execution_time [80.434µs; 80.523µs] or [-0.055%; +0.055%] None None None
credit_card/is_card_number/378282246310005 throughput [12418936.326op/s; 12432705.335op/s] or [-0.055%; +0.055%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [60.183µs; 60.208µs] or [-0.021%; +0.021%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [16609027.415op/s; 16616114.163op/s] or [-0.021%; +0.021%] None None None
credit_card/is_card_number/x371413321323331 execution_time [7.645µs; 7.646µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/x371413321323331 throughput [130789254.256op/s; 130810726.656op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/ execution_time [4.627µs; 4.629µs] or [-0.020%; +0.020%] None None None
credit_card/is_card_number_no_luhn/ throughput [216051309.467op/s; 216136808.814op/s] or [-0.020%; +0.020%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [74.840µs; 74.865µs] or [-0.017%; +0.017%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [13357391.631op/s; 13361862.949op/s] or [-0.017%; +0.017%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [67.400µs; 67.434µs] or [-0.025%; +0.025%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [14829469.730op/s; 14836916.305op/s] or [-0.025%; +0.025%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [4.629µs; 4.630µs] or [-0.017%; +0.017%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [215973262.428op/s; 216047788.365op/s] or [-0.017%; +0.017%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [62.816µs; 62.845µs] or [-0.023%; +0.023%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [15912271.629op/s; 15919556.869op/s] or [-0.023%; +0.023%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [60.163µs; 60.189µs] or [-0.021%; +0.021%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [16614466.205op/s; 16621526.234op/s] or [-0.021%; +0.021%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [7.646µs; 7.648µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [130760121.179op/s; 130784586.439op/s] or [-0.009%; +0.009%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0a8566a 1732576510 dsn/14.3.0
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.673µs 2.740µs ± 0.019µs 2.739µs ± 0.004µs 2.744µs 2.770µs 2.778µs 2.781µs 1.54% -1.096 3.119 0.68% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.737µs; 2.742µs] or [-0.094%; +0.094%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0a8566a 1732576510 dsn/14.3.0
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 21.108µs 30.757µs ± 14.358µs 23.021µs ± 0.324µs 44.037µs 47.598µs 57.703µs 142.707µs 519.90% 3.392 19.858 46.57% 1.015µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [28.767µs; 32.747µs] or [-6.470%; +6.470%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0a8566a 1732576510 dsn/14.3.0
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 9.011ms 9.041ms ± 0.017ms 9.041ms ± 0.009ms 9.048ms 9.066ms 9.082ms 9.147ms 1.18% 2.142 10.639 0.18% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [9.039ms; 9.044ms] or [-0.025%; +0.025%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0a8566a 1732576510 dsn/14.3.0
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 140.388µs 142.048µs ± 0.329µs 142.003µs ± 0.139µs 142.164µs 142.594µs 143.158µs 143.916µs 1.35% 1.081 8.543 0.23% 0.023µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [142.002µs; 142.093µs] or [-0.032%; +0.032%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0a8566a 1732576510 dsn/14.3.0
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.421µs 3.246µs ± 1.439µs 3.093µs ± 0.021µs 3.110µs 3.143µs 14.263µs 15.277µs 393.95% 7.659 58.445 44.22% 0.102µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.047µs; 3.446µs] or [-6.145%; +6.145%] None None None

Baseline

Omitted due to size.

@codecov-commenter
Copy link
Copy Markdown

codecov-commenter commented Nov 25, 2024

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 70.47%. Comparing base (6fe032f) to head (0a8566a).
⚠️ Report is 885 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #760      +/-   ##
==========================================
- Coverage   70.47%   70.47%   -0.01%     
==========================================
  Files         297      297              
  Lines       43411    43403       -8     
==========================================
- Hits        30594    30587       -7     
+ Misses      12817    12816       -1     
Components Coverage Δ
crashtracker 43.45% <ø> (ø)
crashtracker-ffi 8.41% <ø> (ø)
datadog-alloc 98.73% <ø> (ø)
data-pipeline 89.36% <ø> (+0.26%) ⬆️
data-pipeline-ffi 0.00% <ø> (ø)
ddcommon 83.46% <ø> (ø)
ddcommon-ffi 69.12% <ø> (ø)
ddtelemetry 59.05% <ø> (ø)
ddtelemetry-ffi 22.13% <ø> (ø)
dogstatsd 89.45% <ø> (ø)
dogstatsd-client 79.77% <ø> (ø)
ipc 82.76% <ø> (ø)
profiling 84.30% <ø> (ø)
profiling-ffi 77.46% <ø> (ø)
serverless 0.00% <ø> (ø)
sidecar 38.01% <ø> (ø)
sidecar-ffi 0.00% <ø> (ø)
spawn-worker 50.36% <ø> (ø)
tinybytes 94.77% <ø> (ø)
trace-mini-agent 72.36% <ø> (ø)
trace-normalization 98.23% <ø> (ø)
trace-obfuscation 95.77% <ø> (ø)
trace-protobuf 77.67% <ø> (ø)
trace-utils 93.29% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@danielsn danielsn merged commit eea04c6 into main Nov 26, 2024
@danielsn danielsn deleted the dsn/14.3.0 branch November 26, 2024 04:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants