Skip to content

Add features to configure flate2#7827

Merged
alamb merged 8 commits intoapache:mainfrom
zeevm:zeevm/configure_flate2
Jul 3, 2025
Merged

Add features to configure flate2#7827
alamb merged 8 commits intoapache:mainfrom
zeevm:zeevm/configure_flate2

Conversation

@zeevm
Copy link
Copy Markdown
Contributor

@zeevm zeevm commented Jun 30, 2025

Which issue does this PR close?

Rationale for this change

Allow choosing the previously default "rust_backend" instead of "libz-rs-sys" for flate2 dependency.

What changes are included in this PR?

Two new features, "flate2-rust_backened" and "flate2-zlib-rs".

Are there any user-facing changes?

When enabling "flate2", one of these must also be enabled.

@github-actions github-actions Bot added the parquet Changes to the parquet crate label Jun 30, 2025
Copy link
Copy Markdown
Contributor

@alamb alamb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @zeevm this seems good to me, but I worry we will potentially break it in the future if there is no specific test.

Perhaps we could add a test perhaps in this matrix:

run: cargo check -p parquet --no-default-features --features encryption --features async

BTW can you share your usecase for using the rust backend

CC @psvri as you added the code to use zlib sys in

@alamb alamb marked this pull request as draft July 2, 2025 19:32
@alamb
Copy link
Copy Markdown
Contributor

alamb commented Jul 2, 2025

Marking as draft as I think this PR is no longer waiting on feedback and I am trying to make it easier to find PRs in need of review. Please mark it as ready for review when it is ready for another look

@zeevm zeevm marked this pull request as ready for review July 3, 2025 10:54
@zeevm
Copy link
Copy Markdown
Contributor Author

zeevm commented Jul 3, 2025

@alamb I've added the tests as requested

@zeevm zeevm requested a review from alamb July 3, 2025 11:54
Copy link
Copy Markdown
Contributor

@alamb alamb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you @zeevm

Comment thread parquet/Cargo.toml
zeevm and others added 2 commits July 3, 2025 23:50
Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
@alamb alamb merged commit 32caf76 into apache:main Jul 3, 2025
32 checks passed
@alamb
Copy link
Copy Markdown
Contributor

alamb commented Jul 3, 2025

THnak you @zeevm

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

parquet Changes to the parquet crate

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Allow choosing flate2 backend

2 participants