Skip to content

ORC-1608: Upgrade Hadoop to 3.4.0 #1783

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
dongjoon-hyun wants to merge 2 commits into from
Closed

ORC-1608: Upgrade Hadoop to 3.4.0 #1783

dongjoon-hyun wants to merge 2 commits into from

Conversation

@dongjoon-hyun
Copy link
Member

@dongjoon-hyun dongjoon-hyun commented Feb 4, 2024 •
edited
Loading

What changes were proposed in this pull request?

This PR aims to upgrade Apache Hadoop dependency to 3.4.0.

Why are the changes needed?

To use the latest Hadoop features.

How was this patch tested?

Pass the CIs.

Was this patch authored or co-authored using generative AI tooling?

No.

dongjoon-hyun
dongjoon-hyun commented Feb 4, 2024
View reviewed changes
Copy link
Member Author

@dongjoon-hyun dongjoon-hyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is WIP because this PR is testing Apache Hadoop 3.4.0 RC1.

@dongjoon-hyun
Copy link
Member Author

dongjoon-hyun commented Feb 4, 2024

It seems okay except Javadoc.

@dongjoon-hyun
Copy link
Member Author

dongjoon-hyun commented Mar 4, 2024

This is WIP because this PR is testing Apache Hadoop 3.4.0 RC2.

https://lists.apache.org/thread/cp2fc9w334rkd7ko9dwsodnhfg1sqxhs

@dongjoon-hyun
Copy link
Member Author

dongjoon-hyun commented Mar 4, 2024

It seems to be deleted already for RC3.

Screenshot 2024-03-04 at 13 36 06

@dongjoon-hyun dongjoon-hyun added this to the 2.1.0 milestone Mar 8, 2024
@dongjoon-hyun
Copy link
Member Author

dongjoon-hyun commented Mar 9, 2024

This is WIP because this PR is testing Apache Hadoop 3.4.0 RC3.

@dongjoon-hyun
Copy link
Member Author

dongjoon-hyun commented Mar 14, 2024

For the record, I casted +1 for Hadoop 3.4.0 RC3.

@dongjoon-hyun
Copy link
Member Author

dongjoon-hyun commented Mar 17, 2024 •
edited
Loading

Vote passed.

@dongjoon-hyun dongjoon-hyun marked this pull request as ready for review March 19, 2024 03:16
cxzl25
cxzl25 approved these changes Mar 19, 2024
View reviewed changes
Copy link
Contributor

@cxzl25 cxzl25 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@dongjoon-hyun
Copy link
Member Author

dongjoon-hyun commented Mar 19, 2024

Thank you, @cxzl25 . This PR is still waiting for Apache Hadoop 3.4.0 API doc. It's not published yet.

@dongjoon-hyun
Copy link
Member Author

dongjoon-hyun commented Mar 19, 2024

Javadoc generation passed.

Screenshot 2024-03-19 at 09 45 33

Merged to main for Apache ORC 2.1.0.

@dongjoon-hyun dongjoon-hyun deleted the ORC-1608 branch March 19, 2024 16:46
@dongjoon-hyun
Copy link
Member Author

dongjoon-hyun commented Mar 19, 2024

For the record, I'm also working in the Apache Spark community with the following.

If needed, we are able to backport this to branch-2.0 and make Apache ORC 2.0.1 release.

@dongjoon-hyun
Copy link
Member Author

dongjoon-hyun commented Mar 19, 2024

cc @wgtmac and @williamhyun , too.

@dongjoon-hyun dongjoon-hyun mentioned this pull request Oct 18, 2024
Closed
dongjoon-hyun added a commit that referenced this pull request Oct 18, 2024
@dongjoon-hyun
ORC-1608: Upgrade Hadoop to 3.4.0
2f2d0ba 
### What changes were proposed in this pull request?

This PR aims to upgrade Apache Hadoop dependency to 3.4.0.

### Why are the changes needed?

To use the latest Hadoop features.
- https://hadoop.apache.org/docs/r3.4.0

### How was this patch tested?

Pass the CIs.

### Was this patch authored or co-authored using generative AI tooling?

No.

Closes #1783 from dongjoon-hyun/ORC-1608.

Authored-by: Dongjoon Hyun <dongjoon@apache.org>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
(cherry picked from commit d2f9d8d)
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@cxzl25 cxzl25 cxzl25 approved these changes

Assignees

No one assigned

Labels

BUILD JAVA

Projects

None yet

Milestone

2.1.0

Development

Successfully merging this pull request may close these issues.

2 participants

@dongjoon-hyun @cxzl25