Conversation
|
@a2l007 - can you look into CI failures. LGTM once those are addressed. |
|
I missed that #14005 isn't merged yet. Moving this to draft state until that PR is merged since the latest parquet version is built on top of hadoop 3.2.0. |
|
Hmm. will this upgrade break Hadoop 2? If so, we cannot make the change till we get rid of Hadoop 2 entirely. |
|
@abhishekagarwal87 I have a discussion with the parquet folks going on here: https://issues.apache.org/jira/browse/PARQUET-2276 |
|
@a2l007 - thanks for sharing the context. one way to make this work is to have different parquet-mr version for different hadoop profiles. So parquet-mr can be 1.13.0 on Hadoop 3 and 1.12.0 on Hadoop 2. We have pom profiles for different hadoop versions. |
|
@abhishekagarwal87 Thanks for the review! |
Upgrades parquet-mr dependency version to 1.13.0. The release notes for the version can be found here.
This PR has: