[C++][Java][Dataset] JNI bridge between RecordBatch and VectorSchemaRoot

[asfimport]

Given a C++ std::shared_ptr, retrieve it in java as a VectorSchemaRoot class. Gandiva already offer a similar facility but with raw buffers. It would be convenient if users could call C++ that yields RecordBatch and retrieve it in a seamless fashion.

This would remove one roadblock of using C++ dataset facility in Java.

Reporter: Francois Saint-Jacques / @fsaintjacques
Assignee: Hongze Zhang / @zhztheplayer

Related issues:

• [Java] Dataset JNI bridge should use the C data interface (supercedes)

PRs and other links:

• GitHub Pull Request #10883

_{Note: This issue was originally created as ARROW-7272. Please see the migration documentation for further details.}

[asfimport]

Antoine Pitrou / @pitrou:
The C data interface should be the preferred way to achieve this. It requires implementing on the Java side, though.

[asfimport]

Jacques Nadeau / @jacques-n:

The C data interface should be the preferred way to achieve this. It requires implementing on the Java side, though.

Should it be? Why not use flatbuffer since that is already supported on both sides of the boundary?

[asfimport]

Antoine Pitrou / @pitrou:
Assuming flatbuffers can be messaged to handle buffer lifetimes properly, why not.

[asfimport]

Hongze Zhang / @zhztheplayer:
Let's limit the scope of changes into dataset module since we don't yet have a common module for jni utilities.

[asfimport]

Antoine Pitrou / @pitrou:
Issue resolved by pull request 10883
#10883