-
Notifications
You must be signed in to change notification settings - Fork 4.8k
HIVE-26990 - Upgrade Iceberg from 1.0.0 to 1.1.0 #3968
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
This reverts commit 67506d6.
ayushtkn
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Changes Looks good.
We have patched HadoopInputFile as well in Hive. We should sync that as well with the 1.1.0 code.
Guess this commit is the only extra one:
apache/iceberg@1bdc699
Can you check if that can be included?
|
Looks like apache/iceberg#5670 was included only downstream, I guess we can disregard it for now, but it might bite us eventually. |
|
Kudos, SonarCloud Quality Gate passed! |
ayushtkn
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
…t Miskolczi, reviewed by Ayush Saxena) * Update iceberg version * Core: Use CharSequenceSet instead of Set<CharSequence> * Flink: Add SupportsRowPosition to Avro reader to fix position deletes * Core: Deprecate functions in DeleteWriters (apache#5771) * API: Fix Transform backward compatibility in PartitionSpec * Core: Avoid extra getFileStatus call in HadoopInputFile
…t Miskolczi, reviewed by Ayush Saxena) * Update iceberg version * Core: Use CharSequenceSet instead of Set<CharSequence> * Flink: Add SupportsRowPosition to Avro reader to fix position deletes * Core: Deprecate functions in DeleteWriters (apache#5771) * API: Fix Transform backward compatibility in PartitionSpec * Core: Avoid extra getFileStatus call in HadoopInputFile








Iceberg released 1.1.0. Hive currently uses 1.0.0
What changes were proposed in this pull request?
Upgrading the iceberg/pom.xml maven dependency and porting/fixing necessary changes to be able to make all tests green.
Some comments about the changes:
Why are the changes needed?
To make sure the code compiles and all tests are green.
Does this PR introduce any user-facing change?
There will be some changes in describe metadata tables. See c13294b
How was this patch tested?
Ran all the existing tests.