What is the problem the feature request solves?
#1817 introduces integration that allows usage of hadoop-aws's s3a configuration with the object_store used by the native scan implementations.
Some more work can be done to improve this -
-
The feature works with native_datafusion but not with native_iceberg_compat. To be truly useful we need the same integration in native_iceberg_compat.
-
To allow usage of custom authentication, we need a JNI based adapter that can get credentials from an AWS credentials provider (Both AWS SDK V1 and V2 credentials providers must be supported).
-
Document usage.
Describe the potential solution
No response
Additional context
No response
What is the problem the feature request solves?
#1817 introduces integration that allows usage of
hadoop-aws'ss3aconfiguration with theobject_storeused by the native scan implementations.Some more work can be done to improve this -
The feature works with
native_datafusionbut not withnative_iceberg_compat. To be truly useful we need the same integration innative_iceberg_compat.To allow usage of custom authentication, we need a JNI based adapter that can get credentials from an AWS credentials provider (Both AWS SDK V1 and V2 credentials providers must be supported).
Document usage.
Describe the potential solution
No response
Additional context
No response