[JAVA][C++]Support Parquet Read and Write in Java

[asfimport]

We added a new java interface to support parquet read and write from hdfs or local file.

The purpose of this implementation is that when we loading and dumping parquet data in Java, we can only use rowBased put and get methods. Since arrow already has C++ implementation to load and dump parquet, so we wrapped those codes as Java APIs.

After test, we noticed in our workload, performance improved more than 2x comparing with rowBased load and dump. So we want to contribute codes to arrow.

since this is a total independent change, there is no codes change to current arrow codes. We added two folders as listed:  java/adapter/parquet and cpp/src/jni/parquet

Reporter: Chendi.Xue

Related issues:

• [Java][Dataset] Implement Datasets Java API (incorporates)
• [Java][Dataset] Support writing to files within dataset scanner via JNI (incorporates)

PRs and other links:

• GitHub Pull Request apache/arrow#5522
• GitHub Pull Request apache/arrow#5717
• GitHub Pull Request apache/arrow#5719

_{Note: This issue was originally created as ARROW-6720. Please see the migration documentation for further details.}

[asfimport]

Ben Kietzman / @bkietz:
Issue resolved by pull request 5820
apache/arrow#5820

[asfimport]

Micah Kornfield / @emkornfield:
I don't think this has been fully resolved, we should probably make subtasks to record the progress towards getting this all checked in.

[asfimport]

Wes McKinney / @wesm:
Where do things stand on this project?

[asfimport]

Wes McKinney / @wesm:
I moved out of 1.0.0 due to lack of activity

[asfimport]

Krisztian Szucs / @kszucs:
It would be nice to have a status update here. Until that I'm postponing to 3.0.

[asfimport]

Steve M. Kim:
I think that this proposed feature interacts with

• ARROW-7272

• ARROW-7808

  Once we have the ability to view the same Arrow buffers as a RecordBatch/Table across both Java and cpp, we just need to provide Java methods that invoke the Parquet reader and writer functionality in cpp.

[asfimport]

Hongze Zhang / @zhztheplayer:
Added issue links for Java Dataset read API and write API.

[asfimport]

Todd Farmer / @toddfarmer:
This issue was last updated over 90 days ago, which may be an indication it is no longer being actively worked. To better reflect the current state, the issue is being unassigned. Please feel free to re-take assignment of the issue if it is being actively worked, or if you plan to start that work soon.