Skip to content

Optimize/compression#3937

Merged
szuecs merged 3 commits intomasterfrom
optimize/compression
Mar 26, 2026
Merged

Optimize/compression#3937
szuecs merged 3 commits intomasterfrom
optimize/compression

Conversation

@szuecs
Copy link
Copy Markdown
Member

@szuecs szuecs commented Mar 25, 2026 •
edited
Loading

see commit message

ref: #3933
fix: #3932

szuecs added 2 commits March 25, 2026 22:41
@szuecs
test: add benchmarks for deflate
b6f4ee6 
Signed-off-by: Sandor Szücs <sandor.szuecs@zalando.de>
@szuecs
optimize: deflate and gzip compression by leveraging an optimized lib…
4f1f281 
…rary

goos: linux
goarch: amd64
pkg: github.com/zalando/skipper/filters/builtin
cpu: AMD Ryzen 7 PRO 4750U with Radeon Graphics
                    │    old.txt     │               new.txt                │
                    │     sec/op     │    sec/op     vs base                │
CompressDeflate0        18.52µ ± 59%   18.03µ ± 56%   -2.60% (p=0.029 n=10)
CompressDeflate0-2      11.00µ ±  3%   11.40µ ±  9%        ~ (p=0.075 n=10)
CompressDeflate0-4      6.405µ ±  1%   7.122µ ±  1%  +11.19% (p=0.000 n=10)
CompressDeflate0-8      4.675µ ±  3%   5.072µ ±  8%   +8.48% (p=0.000 n=10)
CompressDeflate0-16     3.989µ ±  2%   4.465µ ±  2%  +11.92% (p=0.000 n=10)
CompressDeflate2        33.31µ ±  1%   29.30µ ±  1%  -12.04% (p=0.000 n=10)
CompressDeflate2-2      18.60µ ±  2%   17.99µ ±  3%   -3.26% (p=0.004 n=10)
CompressDeflate2-4      11.18µ ±  2%   11.06µ ±  1%        ~ (p=0.075 n=10)
CompressDeflate2-8      7.796µ ±  3%   7.761µ ±  5%        ~ (p=0.494 n=10)
CompressDeflate2-16     6.361µ ±  1%   6.457µ ±  1%   +1.51% (p=0.004 n=10)
CompressDeflate4       156.39µ ±  3%   56.42µ ±  3%  -63.92% (p=0.000 n=10)
CompressDeflate4-2      85.19µ ±  1%   36.27µ ±  2%  -57.43% (p=0.000 n=10)
CompressDeflate4-4      50.89µ ±  3%   23.32µ ±  8%  -54.18% (p=0.000 n=10)
CompressDeflate4-8      33.67µ ±  1%   16.10µ ±  1%  -52.20% (p=0.000 n=10)
CompressDeflate4-16     32.91µ ± 14%   14.07µ ±  6%  -57.25% (p=0.000 n=10)
CompressDeflate6       10.321m ±  1%   2.549m ±  1%  -75.30% (p=0.000 n=10)
CompressDeflate6-2      5.948m ±  2%   1.776m ±  7%  -70.15% (p=0.000 n=10)
CompressDeflate6-4      3.564m ±  2%   1.145m ±  2%  -67.87% (p=0.000 n=10)
CompressDeflate6-8     2410.7µ ±  2%   796.2µ ±  1%  -66.97% (p=0.000 n=10)
CompressDeflate6-16    2032.4µ ±  1%   713.4µ ±  3%  -64.90% (p=0.000 n=10)
CompressDeflate8       1006.1m ±  8%   215.3m ±  5%  -78.60% (p=0.000 n=10)
CompressDeflate8-2     1033.0m ±  6%   138.9m ±  6%  -86.55% (p=0.000 n=10)
CompressDeflate8-4     1057.8m ±  3%   103.0m ± 12%  -90.26% (p=0.000 n=10)
CompressDeflate8-8    1062.16m ±  2%   70.81m ± 11%  -93.33% (p=0.000 n=10)
CompressDeflate8-16   1085.24m ±  6%   75.88m ±  4%  -93.01% (p=0.000 n=10)
geomean                 475.6µ         203.4µ        -57.24%

                    │   old.txt    │                new.txt                │
                    │     B/op     │     B/op      vs base                 │
CompressDeflate0      15.80Ki ± 0%   15.80Ki ± 0%       ~ (p=1.000 n=10) ¹
CompressDeflate0-2    16.36Ki ± 0%   16.21Ki ± 0%  -0.95% (p=0.000 n=10)
CompressDeflate0-4    17.51Ki ± 0%   17.12Ki ± 0%  -2.19% (p=0.000 n=10)
CompressDeflate0-8    18.77Ki ± 1%   18.34Ki ± 1%  -2.30% (p=0.000 n=10)
CompressDeflate0-16   18.62Ki ± 1%   18.04Ki ± 1%  -3.11% (p=0.000 n=10)
CompressDeflate2      15.80Ki ± 0%   15.80Ki ± 0%       ~ (p=1.000 n=10) ¹
CompressDeflate2-2    16.53Ki ± 1%   16.38Ki ± 0%  -0.90% (p=0.006 n=10)
CompressDeflate2-4    17.90Ki ± 1%   17.57Ki ± 1%  -1.87% (p=0.000 n=10)
CompressDeflate2-8    19.18Ki ± 1%   18.71Ki ± 1%  -2.45% (p=0.000 n=10)
CompressDeflate2-16   20.37Ki ± 1%   19.64Ki ± 1%  -3.59% (p=0.000 n=10)
CompressDeflate4      39.18Ki ± 0%   39.18Ki ± 0%       ~ (p=1.000 n=10) ¹
CompressDeflate4-2    40.17Ki ± 1%   40.41Ki ± 0%  +0.60% (p=0.002 n=10)
CompressDeflate4-4    41.84Ki ± 1%   42.46Ki ± 1%  +1.50% (p=0.002 n=10)
CompressDeflate4-8    42.46Ki ± 1%   44.73Ki ± 1%  +5.33% (p=0.000 n=10)
CompressDeflate4-16   42.03Ki ± 1%   44.98Ki ± 1%  +7.00% (p=0.000 n=10)
CompressDeflate6      2.101Mi ± 0%   2.101Mi ± 0%  +0.00% (p=0.012 n=10)
CompressDeflate6-2    2.136Mi ± 2%   2.131Mi ± 0%       ~ (p=0.579 n=10)
CompressDeflate6-4    2.166Mi ± 1%   2.187Mi ± 1%  +0.99% (p=0.007 n=10)
CompressDeflate6-8    2.179Mi ± 1%   2.215Mi ± 0%  +1.66% (p=0.000 n=10)
CompressDeflate6-16   2.204Mi ± 1%   2.184Mi ± 0%  -0.94% (p=0.005 n=10)
CompressDeflate8      236.0Mi ± 0%   236.0Mi ± 0%  -0.00% (p=0.002 n=10)
CompressDeflate8-2    237.1Mi ± 0%   236.5Mi ± 0%  -0.27% (p=0.001 n=10)
CompressDeflate8-4    237.1Mi ± 0%   236.4Mi ± 0%       ~ (p=0.138 n=10)
CompressDeflate8-8    237.2Mi ± 0%   236.6Mi ± 0%  -0.24% (p=0.002 n=10)
CompressDeflate8-16   237.2Mi ± 0%   236.7Mi ± 0%  -0.18% (p=0.000 n=10)
geomean               369.0Ki        368.6Ki       -0.12%
¹ all samples are equal

                    │   old.txt    │               new.txt                │
                    │  allocs/op   │ allocs/op   vs base                  │
CompressDeflate0       24.00 ±  0%   24.00 ± 0%        ~ (p=1.000 n=10) ¹
CompressDeflate0-2     24.00 ±  0%   24.00 ± 0%        ~ (p=1.000 n=10) ¹
CompressDeflate0-4     24.00 ±  0%   24.00 ± 0%        ~ (p=1.000 n=10) ¹
CompressDeflate0-8     24.00 ±  0%   24.00 ± 0%        ~ (p=1.000 n=10) ¹
CompressDeflate0-16    24.00 ±  0%   24.00 ± 0%        ~ (p=1.000 n=10) ¹
CompressDeflate2       24.00 ±  0%   24.00 ± 0%        ~ (p=1.000 n=10) ¹
CompressDeflate2-2     24.00 ±  0%   24.00 ± 0%        ~ (p=1.000 n=10) ¹
CompressDeflate2-4     24.00 ±  0%   24.00 ± 0%        ~ (p=1.000 n=10) ¹
CompressDeflate2-8     24.00 ±  0%   24.00 ± 0%        ~ (p=1.000 n=10) ¹
CompressDeflate2-16    24.00 ±  0%   24.00 ± 0%        ~ (p=1.000 n=10) ¹
CompressDeflate4       34.00 ±  0%   34.00 ± 0%        ~ (p=1.000 n=10) ¹
CompressDeflate4-2     34.00 ±  0%   34.00 ± 0%        ~ (p=1.000 n=10) ¹
CompressDeflate4-4     34.00 ±  0%   34.00 ± 0%        ~ (p=1.000 n=10) ¹
CompressDeflate4-8     34.00 ±  0%   34.00 ± 0%        ~ (p=1.000 n=10) ¹
CompressDeflate4-16    34.00 ±  0%   34.00 ± 0%        ~ (p=1.000 n=10) ¹
CompressDeflate6       48.00 ±  0%   48.00 ± 0%        ~ (p=1.000 n=10) ¹
CompressDeflate6-2     48.00 ±  0%   48.00 ± 0%        ~ (p=1.000 n=10)
CompressDeflate6-4     48.00 ±  0%   49.00 ± 0%   +2.08% (p=0.000 n=10)
CompressDeflate6-8     48.00 ±  0%   49.00 ± 0%   +2.08% (p=0.000 n=10)
CompressDeflate6-16    48.00 ±  0%   48.00 ± 0%        ~ (p=1.000 n=10) ¹
CompressDeflate8       71.00 ± 28%   63.00 ± 5%  -11.27% (p=0.000 n=10)
CompressDeflate8-2     94.50 ±  8%   71.50 ± 3%  -24.34% (p=0.000 n=10)
CompressDeflate8-4     99.00 ± 17%   69.00 ± 3%  -30.30% (p=0.000 n=10)
CompressDeflate8-8    112.50 ±  5%   71.50 ± 3%  -36.44% (p=0.000 n=10)
CompressDeflate8-16   128.50 ±  3%   75.00 ± 3%  -41.63% (p=0.000 n=10)
geomean                39.26         36.66        -6.61%
¹ all samples are equal

Signed-off-by: Sandor Szücs <sandor.szuecs@zalando.de>
@szuecs szuecs added optimization minor no risk changes, for example new filters labels Mar 26, 2026
@szuecs
copied from #3933 by @ivan-digital
0762b28 
Signed-off-by: Sandor Szücs <sandor.szuecs@zalando.de>
@szuecs
Copy link
Copy Markdown
Member Author

szuecs commented Mar 26, 2026

👍

@szuecs szuecs merged commit 6ac9da5 into master Mar 26, 2026
15 checks passed
@szuecs szuecs deleted the optimize/compression branch March 26, 2026 08:30
This was referenced Mar 26, 2026
Open
Closed
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@madumalt madumalt madumalt approved these changes

Assignees

No one assigned

Labels

minor no risk changes, for example new filters optimization

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

optimize compression

2 participants

@szuecs @madumalt