add a Java wrapper for datafusion

[jimexist]

Is your feature request related to a problem or challenge? Please describe what you are trying to do.

A challenge to add a Java wrapper for datafusion, so that we can leverage Rust's speed and memory management and also Java's eco-system.

Describe the solution you'd like
A clear and concise description of what you want to happen.

Unlike Python where we have maturin - an easy to use binding to Rust, I'm trying to use JNI in this case but that requires handling memory on/off heap. One way to achieve this is to leverage Arrow's IPC between Java and Rust.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

[jimexist]

maybe related apache/arrow#11067

[alamb]

In general I am somewhat down on adding more integration tests into the core DataFusion repo as each type of integration added makes any PR in the core that much more complicated and there are more possibilities for flakytests in some infrastructural components that we may/may not be familiar with

What would you think about implementing this as its own crate / in its own repo? That would also allow initial revisions to be iterated on / released faster than if it is in the arrow-datafusion repo and under ASF governance?

[jimexist]

In general I am somewhat down on adding more integration tests into the core DataFusion repo as each type of integration added makes any PR in the core that much more complicated and there are more possibilities for flakytests in some infrastructural components that we may/may not be familiar with

What would you think about implementing this as its own crate / in its own repo? That would also allow initial revisions to be iterated on / released faster than if it is in the arrow-datafusion repo and under ASF governance?

Agree that this can be in a separate repo.

Let me still keep this open for some feedback collections

[Dandandan]

I agree this could be done better in a separate repo.
If it's mature enough to be considered in the repository, we can decide to do so.

[houqp]

it looks like everyone is having mono repo PTSD here :D

[jimexist]

for the moment let me put this here, once ready i can transfer it under apache org