Skip to content

Remove Serverless Specific DogStatsD Server Implementation#973

Merged
duncanpharvey merged 5 commits intomainfrom
duncan-harvey/remove-dogstatsd
Mar 26, 2025
Merged

Remove Serverless Specific DogStatsD Server Implementation#973
duncanpharvey merged 5 commits intomainfrom
duncan-harvey/remove-dogstatsd

Conversation

@duncanpharvey
Copy link
Copy Markdown
Contributor

@duncanpharvey duncanpharvey commented Mar 25, 2025

What does this PR do?

Removes Serverless specific DogStatsD server implementation and updates the Serverless Mini Agent to use the crate in the serverless-components repo.

Motivation

Move Serverless specific implementations to a separate repo.

https://datadoghq.atlassian.net/browse/SVLS-6327

Additional Notes

Migrated to serverless-components in this PR: DataDog/serverless-components#2

How to test the change?

Rebuild mini agent and deploy to Azure Functions.

@r1viollet
Copy link
Copy Markdown
Contributor

r1viollet commented Mar 25, 2025

Artifact Size Benchmark Report

aarch64-alpine-linux-musl
Artifact Baseline Commit Change
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so 7.77 MB 7.77 MB 0% (0 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.a 77.45 MB 77.45 MB 0% (0 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so.debug 23.92 MB 23.92 MB 0% (0 B) 👌
aarch64-unknown-linux-gnu
Artifact Baseline Commit Change
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so 7.63 MB 7.63 MB 0% (0 B) 👌
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so.debug 22.48 MB 22.48 MB 0% (0 B) 👌
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a 71.66 MB 71.66 MB 0% (0 B) 👌
i686-alpine-linux-musl
Artifact Baseline Commit Change
/i686-alpine-linux-musl/lib/libdatadog_profiling.a 66.75 MB 66.75 MB 0% (0 B) 👌
/i686-alpine-linux-musl/lib/libdatadog_profiling.so 8.22 MB 8.22 MB 0% (0 B) 👌
/i686-alpine-linux-musl/lib/libdatadog_profiling.so.debug 23.08 MB 23.08 MB 0% (0 B) 👌
i686-unknown-linux-gnu
Artifact Baseline Commit Change
/i686-unknown-linux-gnu/lib/libdatadog_profiling.a 67.66 MB 67.66 MB 0% (0 B) 👌
/i686-unknown-linux-gnu/lib/libdatadog_profiling.so 8.10 MB 8.10 MB 0% (0 B) 👌
/i686-unknown-linux-gnu/lib/libdatadog_profiling.so.debug 20.70 MB 20.70 MB 0% (0 B) 👌
libdatadog-x64-windows
Artifact Baseline Commit Change
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll 16.83 MB 16.83 MB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib 61.18 KB 61.18 KB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb 112.74 MB 112.73 MB -0% (-8.00 KB) 👌
/libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib 628.59 MB 628.59 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll 5.03 MB 5.03 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib 61.18 KB 61.18 KB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb 16.01 MB 16.01 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib 26.62 MB 26.62 MB 0% (0 B) 👌
libdatadog-x86-windows
Artifact Baseline Commit Change
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll 14.22 MB 14.22 MB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib 62.13 KB 62.13 KB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb 114.64 MB 114.65 MB +0% (+8.00 KB) 👌
/libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib 621.24 MB 621.24 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll 3.80 MB 3.80 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib 62.13 KB 62.13 KB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb 16.63 MB 16.63 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib 24.52 MB 24.52 MB 0% (0 B) 👌
x86_64-alpine-linux-musl
Artifact Baseline Commit Change
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.a 66.75 MB 66.75 MB 0% (0 B) 👌
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so 8.22 MB 8.22 MB 0% (0 B) 👌
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so.debug 23.08 MB 23.08 MB 0% (0 B) 👌
x86_64-unknown-linux-gnu
Artifact Baseline Commit Change
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a 67.66 MB 67.66 MB 0% (0 B) 👌
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so 8.10 MB 8.10 MB 0% (0 B) 👌
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so.debug 20.70 MB 20.70 MB 0% (0 B) 👌

@duncanpharvey duncanpharvey force-pushed the duncan-harvey/remove-dogstatsd branch from 2e20bc3 to 1373619 Compare March 25, 2025 19:31
@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Mar 25, 2025

Benchmarks

Comparison

Benchmark execution time: 2025-03-26 17:36:50

Comparing candidate commit 0f2176f in PR branch duncan-harvey/remove-dogstatsd with baseline commit c947d39 in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 52 metrics, 2 unstable metrics.

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0f2176f 1743009920 duncan-harvey/remove-dogstatsd
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.559µs 25.885µs ± 11.389µs 17.748µs ± 0.125µs 35.055µs 44.895µs 46.877µs 95.706µs 439.26% 1.943 7.279 43.89% 0.805µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [24.307µs; 27.464µs] or [-6.098%; +6.098%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0f2176f 1743009920 duncan-harvey/remove-dogstatsd
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 505.045µs 506.055µs ± 0.497µs 506.051µs ± 0.223µs 506.261µs 506.555µs 506.723µs 510.898µs 0.96% 4.936 45.073 0.10% 0.035µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1957337.013op/s 1976070.502op/s ± 1930.092op/s 1976085.631op/s ± 872.255op/s 1977098.011op/s 1978552.110op/s 1979209.993op/s 1980022.018op/s 0.20% -4.870 44.251 0.10% 136.478op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 452.648µs 453.485µs ± 0.296µs 453.489µs ± 0.206µs 453.664µs 454.020µs 454.161µs 454.332µs 0.19% 0.218 -0.036 0.07% 0.021µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2201033.848op/s 2205145.558op/s ± 1438.110op/s 2205127.340op/s ± 1002.286op/s 2206274.595op/s 2207301.794op/s 2208191.055op/s 2209220.469op/s 0.19% -0.214 -0.037 0.07% 101.690op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 175.846µs 176.883µs ± 0.470µs 176.889µs ± 0.220µs 177.095µs 177.300µs 177.869µs 180.393µs 1.98% 3.584 25.838 0.26% 0.033µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5543450.103op/s 5653485.846op/s ± 14872.869op/s 5653273.305op/s ± 7022.399op/s 5660932.734op/s 5673183.681op/s 5680759.872op/s 5686808.325op/s 0.59% -3.466 24.829 0.26% 1051.671op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 37.597µs 37.687µs ± 0.040µs 37.684µs ± 0.025µs 37.706µs 37.758µs 37.802µs 37.832µs 0.39% 0.614 0.588 0.11% 0.003µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26432633.360op/s 26534670.592op/s ± 27922.553op/s 26536250.261op/s ± 17692.453op/s 26554641.076op/s 26574054.235op/s 26583272.719op/s 26597764.025op/s 0.23% -0.607 0.572 0.10% 1974.423op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 48.258µs 48.355µs ± 0.043µs 48.345µs ± 0.022µs 48.377µs 48.411µs 48.518µs 48.652µs 0.64% 2.307 12.517 0.09% 0.003µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 20554057.990op/s 20680455.472op/s ± 18201.823op/s 20684620.996op/s ± 9335.026op/s 20691224.446op/s 20701404.043op/s 20715240.098op/s 20721825.970op/s 0.18% -2.283 12.325 0.09% 1287.063op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [505.986µs; 506.124µs] or [-0.014%; +0.014%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1975803.009op/s; 1976337.994op/s] or [-0.014%; +0.014%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [453.444µs; 453.526µs] or [-0.009%; +0.009%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2204946.249op/s; 2205344.866op/s] or [-0.009%; +0.009%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [176.818µs; 176.948µs] or [-0.037%; +0.037%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5651424.609op/s; 5655547.082op/s] or [-0.036%; +0.036%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [37.681µs; 37.692µs] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [26530800.795op/s; 26538540.389op/s] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [48.349µs; 48.361µs] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [20677932.875op/s; 20682978.070op/s] or [-0.012%; +0.012%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0f2176f 1743009920 duncan-harvey/remove-dogstatsd
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 6.090ms 6.101ms ± 0.012ms 6.099ms ± 0.003ms 6.102ms 6.108ms 6.145ms 6.216ms 1.91% 7.346 61.764 0.20% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [6.099ms; 6.102ms] or [-0.028%; +0.028%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0f2176f 1743009920 duncan-harvey/remove-dogstatsd
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 244.263ns 254.323ns ± 12.492ns 248.752ns ± 2.543ns 254.664ns 285.267ns 289.681ns 291.234ns 17.08% 1.668 1.466 4.90% 0.883ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [252.592ns; 256.054ns] or [-0.681%; +0.681%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0f2176f 1743009920 duncan-harvey/remove-dogstatsd
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.199µs 3.201µs ± 1.422µs 3.011µs ± 0.028µs 3.034µs 3.647µs 13.960µs 14.899µs 394.88% 7.382 55.491 44.30% 0.101µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.004µs; 3.398µs] or [-6.155%; +6.155%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0f2176f 1743009920 duncan-harvey/remove-dogstatsd
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 54.570ms 54.779ms ± 0.116ms 54.756ms ± 0.041ms 54.798ms 54.975ms 55.270ms 55.391ms 1.16% 2.481 8.528 0.21% 0.008ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [54.763ms; 54.795ms] or [-0.029%; +0.029%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0f2176f 1743009920 duncan-harvey/remove-dogstatsd
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 208.882µs 209.209µs ± 0.140µs 209.203µs ± 0.101µs 209.298µs 209.442µs 209.551µs 209.575µs 0.18% 0.320 -0.423 0.07% 0.010µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4771572.877op/s 4779902.405op/s ± 3199.527op/s 4780054.744op/s ± 2308.399op/s 4782466.204op/s 4784513.074op/s 4785586.229op/s 4787395.108op/s 0.15% -0.317 -0.426 0.07% 226.241op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.230µs 18.324µs ± 0.046µs 18.316µs ± 0.036µs 18.358µs 18.396µs 18.422µs 18.512µs 1.07% 0.281 0.483 0.25% 0.003µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 54018769.480op/s 54573788.058op/s ± 136421.326op/s 54595846.220op/s ± 107855.522op/s 54654759.890op/s 54776654.394op/s 54852540.607op/s 54853522.656op/s 0.47% -0.263 0.439 0.25% 9646.444op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.651µs 10.719µs ± 0.032µs 10.720µs ± 0.022µs 10.740µs 10.770µs 10.781µs 10.814µs 0.87% -0.008 -0.314 0.29% 0.002µs 1 200
normalization/normalize_name/normalize_name/good throughput 92475812.240op/s 93293003.709op/s ± 275768.528op/s 93281473.618op/s ± 191027.851op/s 93487818.358op/s 93773561.842op/s 93859791.372op/s 93890135.541op/s 0.65% 0.023 -0.322 0.29% 19499.780op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [209.190µs; 209.229µs] or [-0.009%; +0.009%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4779458.982op/s; 4780345.829op/s] or [-0.009%; +0.009%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.318µs; 18.330µs] or [-0.035%; +0.035%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [54554881.374op/s; 54592694.742op/s] or [-0.035%; +0.035%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.715µs; 10.723µs] or [-0.041%; +0.041%] None None None
normalization/normalize_name/normalize_name/good throughput [93254784.843op/s; 93331222.575op/s] or [-0.041%; +0.041%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0f2176f 1743009920 duncan-harvey/remove-dogstatsd
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 32.172µs 33.159µs ± 1.367µs 32.292µs ± 0.074µs 34.864µs 35.671µs 36.163µs 36.410µs 12.75% 1.003 -0.794 4.11% 0.097µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [32.970µs; 33.349µs] or [-0.571%; +0.571%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0f2176f 1743009920 duncan-harvey/remove-dogstatsd
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.898µs 3.917µs ± 0.002µs 3.917µs ± 0.001µs 3.918µs 3.920µs 3.921µs 3.922µs 0.12% -3.603 32.982 0.05% 0.000µs 1 200
credit_card/is_card_number/ throughput 255003176.303op/s 255308959.547op/s ± 137722.086op/s 255307595.407op/s ± 58429.142op/s 255366752.869op/s 255474165.680op/s 255537790.481op/s 256567701.011op/s 0.49% 3.639 33.379 0.05% 9738.422op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 82.195µs 82.612µs ± 0.266µs 82.603µs ± 0.175µs 82.739µs 83.091µs 83.503µs 83.937µs 1.61% 1.497 3.721 0.32% 0.019µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 11913683.217op/s 12104834.676op/s ± 38852.158op/s 12106084.034op/s ± 25684.473op/s 12136260.663op/s 12148498.930op/s 12157737.628op/s 12166205.930op/s 0.50% -1.463 3.555 0.32% 2747.262op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 76.414µs 76.974µs ± 0.288µs 76.954µs ± 0.171µs 77.120µs 77.523µs 77.785µs 77.797µs 1.09% 0.609 0.236 0.37% 0.020µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 12853997.865op/s 12991658.349op/s ± 48498.765op/s 12994737.141op/s ± 28732.058op/s 13026194.048op/s 13064272.892op/s 13075552.016op/s 13086553.154op/s 0.71% -0.589 0.202 0.37% 3429.381op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.899µs 3.917µs ± 0.002µs 3.917µs ± 0.001µs 3.918µs 3.920µs 3.921µs 3.923µs 0.16% -2.538 23.767 0.05% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 254908307.366op/s 255320815.755op/s ± 134840.951op/s 255328252.763op/s ± 57177.247op/s 255382659.517op/s 255471097.607op/s 255560832.125op/s 256455210.610op/s 0.44% 2.569 24.057 0.05% 9534.695op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 72.837µs 73.542µs ± 0.371µs 73.508µs ± 0.268µs 73.751µs 74.129µs 74.725µs 74.798µs 1.75% 0.771 0.621 0.50% 0.026µs 1 200
credit_card/is_card_number/378282246310005 throughput 13369259.943op/s 13598043.205op/s ± 68384.560op/s 13603888.674op/s ± 49666.823op/s 13654935.865op/s 13687888.911op/s 13711391.274op/s 13729242.975op/s 0.92% -0.741 0.541 0.50% 4835.519op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 51.988µs 52.267µs ± 0.117µs 52.267µs ± 0.080µs 52.346µs 52.448µs 52.513µs 52.643µs 0.72% 0.095 0.004 0.22% 0.008µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 18995810.237op/s 19132715.279op/s ± 42929.018op/s 19132358.503op/s ± 29163.245op/s 19161470.116op/s 19204170.973op/s 19229100.667op/s 19235105.992op/s 0.54% -0.082 -0.005 0.22% 3035.540op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.478µs 6.645µs ± 0.067µs 6.641µs ± 0.045µs 6.689µs 6.761µs 6.802µs 6.809µs 2.54% 0.104 -0.466 1.01% 0.005µs 1 200
credit_card/is_card_number/x371413321323331 throughput 146855607.184op/s 150508531.945op/s ± 1523368.546op/s 150579907.754op/s ± 1035595.331op/s 151610120.195op/s 152849996.150op/s 153752693.133op/s 154374951.147op/s 2.52% -0.057 -0.467 1.01% 107718.423op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.897µs 3.917µs ± 0.002µs 3.917µs ± 0.001µs 3.917µs 3.919µs 3.920µs 3.924µs 0.20% -4.667 50.164 0.05% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 254824707.740op/s 255322134.999op/s ± 126125.389op/s 255323505.080op/s ± 50791.498op/s 255374213.589op/s 255440212.679op/s 255572630.628op/s 256591173.203op/s 0.50% 4.712 50.672 0.05% 8918.412op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 63.708µs 63.955µs ± 0.169µs 63.898µs ± 0.077µs 64.029µs 64.281µs 64.453µs 65.130µs 1.93% 2.499 11.291 0.26% 0.012µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15353970.635op/s 15636024.318op/s ± 41142.510op/s 15650055.196op/s ± 18741.355op/s 15661436.845op/s 15675207.181op/s 15685714.440op/s 15696725.663op/s 0.30% -2.445 10.790 0.26% 2909.215op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 57.807µs 57.912µs ± 0.065µs 57.897µs ± 0.031µs 57.934µs 58.010µs 58.233µs 58.304µs 0.70% 2.701 11.349 0.11% 0.005µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 17151466.672op/s 17267682.054op/s ± 19409.366op/s 17272028.947op/s ± 9305.523op/s 17280085.709op/s 17286132.615op/s 17288617.752op/s 17298960.233op/s 0.16% -2.681 11.200 0.11% 1372.449op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.897µs 3.917µs ± 0.002µs 3.917µs ± 0.001µs 3.918µs 3.920µs 3.921µs 3.926µs 0.23% -4.217 44.500 0.05% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 254682711.611op/s 255270836.002op/s ± 136120.513op/s 255265666.443op/s ± 51105.343op/s 255321558.835op/s 255426103.278op/s 255514014.005op/s 256596586.864op/s 0.52% 4.263 44.981 0.05% 9625.174op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 54.628µs 54.768µs ± 0.165µs 54.717µs ± 0.034µs 54.754µs 55.125µs 55.187µs 56.054µs 2.44% 3.521 18.311 0.30% 0.012µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 17840065.277op/s 18259038.339op/s ± 54509.001op/s 18276009.995op/s ± 11217.291op/s 18286814.293op/s 18291188.222op/s 18299383.049op/s 18305788.290op/s 0.16% -3.451 17.470 0.30% 3854.368op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 51.985µs 52.220µs ± 0.110µs 52.219µs ± 0.057µs 52.270µs 52.365µs 52.436µs 53.144µs 1.77% 3.064 24.173 0.21% 0.008µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 18816631.825op/s 19149977.082op/s ± 39916.612op/s 19150151.202op/s ± 20896.923op/s 19173369.149op/s 19203940.467op/s 19222760.310op/s 19236414.533op/s 0.45% -2.960 23.095 0.21% 2822.531op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.439µs 6.653µs ± 0.065µs 6.650µs ± 0.045µs 6.696µs 6.758µs 6.804µs 6.836µs 2.80% -0.200 0.256 0.98% 0.005µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 146274760.680op/s 150320340.576op/s ± 1475765.539op/s 150374511.992op/s ± 1024625.543op/s 151353904.229op/s 152697620.182op/s 154232316.508op/s 155292394.798op/s 3.27% 0.266 0.317 0.98% 104352.382op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.917µs; 3.917µs] or [-0.007%; +0.007%] None None None
credit_card/is_card_number/ throughput [255289872.590op/s; 255328046.503op/s] or [-0.007%; +0.007%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [82.576µs; 82.649µs] or [-0.045%; +0.045%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12099450.141op/s; 12110219.212op/s] or [-0.044%; +0.044%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [76.934µs; 77.013µs] or [-0.052%; +0.052%] None None None
credit_card/is_card_number/ 378282246310005 throughput [12984936.887op/s; 12998379.812op/s] or [-0.052%; +0.052%] None None None
credit_card/is_card_number/37828224631 execution_time [3.916µs; 3.917µs] or [-0.007%; +0.007%] None None None
credit_card/is_card_number/37828224631 throughput [255302128.096op/s; 255339503.414op/s] or [-0.007%; +0.007%] None None None
credit_card/is_card_number/378282246310005 execution_time [73.490µs; 73.593µs] or [-0.070%; +0.070%] None None None
credit_card/is_card_number/378282246310005 throughput [13588565.762op/s; 13607520.647op/s] or [-0.070%; +0.070%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [52.251µs; 52.283µs] or [-0.031%; +0.031%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [19126765.730op/s; 19138664.828op/s] or [-0.031%; +0.031%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.635µs; 6.654µs] or [-0.140%; +0.140%] None None None
credit_card/is_card_number/x371413321323331 throughput [150297407.716op/s; 150719656.175op/s] or [-0.140%; +0.140%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.916µs; 3.917µs] or [-0.007%; +0.007%] None None None
credit_card/is_card_number_no_luhn/ throughput [255304655.234op/s; 255339614.765op/s] or [-0.007%; +0.007%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [63.932µs; 63.979µs] or [-0.037%; +0.037%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15630322.362op/s; 15641726.274op/s] or [-0.036%; +0.036%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [57.903µs; 57.921µs] or [-0.016%; +0.016%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [17264992.102op/s; 17270372.005op/s] or [-0.016%; +0.016%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.917µs; 3.918µs] or [-0.007%; +0.007%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255251971.008op/s; 255289700.996op/s] or [-0.007%; +0.007%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [54.745µs; 54.791µs] or [-0.042%; +0.042%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [18251483.915op/s; 18266592.762op/s] or [-0.041%; +0.041%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [52.204µs; 52.235µs] or [-0.029%; +0.029%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [19144445.023op/s; 19155509.140op/s] or [-0.029%; +0.029%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.644µs; 6.662µs] or [-0.136%; +0.136%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [150115813.665op/s; 150524867.486op/s] or [-0.136%; +0.136%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0f2176f 1743009920 duncan-harvey/remove-dogstatsd
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.393µs 2.417µs ± 0.014µs 2.415µs ± 0.009µs 2.423µs 2.447µs 2.452µs 2.455µs 1.64% 0.723 0.077 0.59% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.415µs; 2.419µs] or [-0.083%; +0.083%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0f2176f 1743009920 duncan-harvey/remove-dogstatsd
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 146.711µs 147.923µs ± 0.305µs 147.918µs ± 0.121µs 148.036µs 148.302µs 148.774µs 149.941µs 1.37% 1.072 11.675 0.21% 0.022µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [147.881µs; 147.966µs] or [-0.029%; +0.029%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0f2176f 1743009920 duncan-harvey/remove-dogstatsd
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 4.893µs 4.991µs ± 0.064µs 5.007µs ± 0.068µs 5.021µs 5.095µs 5.096µs 5.097µs 1.81% 0.190 -1.314 1.28% 0.005µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [4.982µs; 5.000µs] or [-0.177%; +0.177%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0f2176f 1743009920 duncan-harvey/remove-dogstatsd
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 67.041µs 67.230µs ± 0.179µs 67.206µs ± 0.040µs 67.255µs 67.373µs 67.598µs 69.434µs 3.31% 9.682 114.344 0.27% 0.013µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [67.206µs; 67.255µs] or [-0.037%; +0.037%] None None None

Baseline

Omitted due to size.

@duncanpharvey duncanpharvey marked this pull request as ready for review March 25, 2025 20:46
@duncanpharvey duncanpharvey requested review from a team as code owners March 25, 2025 20:46
Comment thread serverless/Cargo.toml Outdated
datadog-trace-protobuf = { path = "../trace-protobuf" }
datadog-trace-utils = { path = "../trace-utils" }
dogstatsd = { path = "../dogstatsd" }
dogstatsd = { version = "0.1.0", default-features = false, git = "https://github.com/DataDog/serverless-components/", rev = "4dfe72ab1850680f41dd79d30a937eb68e7ba6da" }
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

do you need the rev here? just curious, not sure how it works when you have both version and a git rev

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good point! It looks like the version is ignored when the git rev is specified. The dogstatsd version still shows up in Cargo.lock so it doesn't need to be specified in Cargo.toml. I just pushed a change to remove it

@duncanpharvey duncanpharvey enabled auto-merge (squash) March 26, 2025 14:10
Comment thread serverless/Cargo.toml
datadog-trace-protobuf = { path = "../trace-protobuf" }
datadog-trace-utils = { path = "../trace-utils" }
dogstatsd = { path = "../dogstatsd" }
dogstatsd = { git = "https://github.com/DataDog/serverless-components/", rev = "4dfe72ab1850680f41dd79d30a937eb68e7ba6da", default-features = false }
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

do we have to use commit hashes? can we use tags instead? for human-readability

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

or, even better, can we version the dogstatsd library?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Eventually the plan is to have both the serverless binary crate and the dogstatsd crate in the serverless-components repo together in a mono repo approach. So for now we don't plan on versioning dogstatsd. Pinning to the commit hash in the other repo is just a temporary solution until the crates can reference in each other in the same repo.

@duncanpharvey duncanpharvey merged commit 0548e98 into main Mar 26, 2025
34 checks passed
@duncanpharvey duncanpharvey deleted the duncan-harvey/remove-dogstatsd branch March 26, 2025 17:44
duncanpharvey added a commit that referenced this pull request Apr 16, 2025
* remove serverless specific dogstatsd server implementation

* remove dogstatsd version from dependency
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants