-
Notifications
You must be signed in to change notification settings - Fork 4k
Closed
Description
Right now the datasets JNI bridge uses some custom buffer passing which only seems to handle primitive arrays correctly (child array buffers and dictionaries are not considered):
https://github.com/apache/arrow/blob/master/cpp/src/jni/dataset/jni_wrapper.cc#L498-L500
Instead, it should use the C data interface, which is now implemented in Java.
Reporter: Antoine Pitrou / @pitrou
Related issues:
- [Java] Consolidate JNI compilation (relates to)
- [C++][JNI] DisposableScannerAdaptor does not handle arrays with offsets (supercedes)
- [C++][Java][Dataset] JNI bridge between RecordBatch and VectorSchemaRoot (is superceded by)
Note: This issue was originally created as ARROW-15753. Please see the migration documentation for further details.