Skip to content

Spark 3.4: Update RewriteDataFilesSparkAction and RewritePositionDeleteFilesSparkAction to use the new APIs#12980

Merged
pvary merged 1 commit intoapache:mainfrom
gaborkaszab:main_spark_action_backport
May 7, 2025
Merged

Spark 3.4: Update RewriteDataFilesSparkAction and RewritePositionDeleteFilesSparkAction to use the new APIs#12980
pvary merged 1 commit intoapache:mainfrom
gaborkaszab:main_spark_action_backport

Conversation

@gaborkaszab
Copy link
Collaborator

…teFilesSparkAction to use the new APIs

@github-actions github-actions bot added the spark label May 6, 2025
@pvary pvary changed the title Spark 3.4: Update RewriteDataFilesSparkAction and RewritePositionDele… Spark 3.4: Update RewriteDataFilesSparkAction and RewritePositionDeleteFilesSparkAction to use the new APIs May 6, 2025
@pvary
Copy link
Contributor

pvary commented May 6, 2025

@gaborkaszab: Was this a clean backport, or you needed to change anything?

@gaborkaszab
Copy link
Collaborator Author

This is a backport of #12692. Note, changes in IcebergSortCompactionBenchmark.java and TestCompressionSettings.java didn't apply cleanly and I had to manually make the changes in these files.

cc @pvary @RussellSpitzer @stevenzwu @manuzhang

@manuzhang
Copy link
Member

This is a backport of #12692. Note, changes in IcebergSortCompactionBenchmark.java and TestCompressionSettings.java didn't apply cleanly and I had to manually make the changes in these files.

Please put these into description.

@pvary pvary merged commit 176a6c6 into apache:main May 7, 2025
27 checks passed
@pvary
Copy link
Contributor

pvary commented May 7, 2025

Merged to main.
Thanks for the PR @gaborkaszab and @manuzhang for the review!

devendra-nr pushed a commit to devendra-nr/iceberg that referenced this pull request Dec 8, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants