[Feature] Support skipping AWS Glue archive #4967
Description
Search before asking
- I searched in the issues and found nothing similar.
Motivation
Paimon's Iceberg compatibility layer suggests using https://github.com/promotedai/aws-glue-data-catalog-client-for-apache-hive-metastore to connect to AWS Glue catalog. This AWS Glue client package supports skipping Glue archive, however, Paimon is never skipping archive when using that client.
Related issue in Apache Iceberg apache/iceberg#5965
Solution
Introduce a table option that allows enabling or disabling skipping AWS Glue archives.
Anything else?
No response
Are you willing to submit a PR?
- I'm willing to submit a PR! [iceberg] Support skipping AWS Glue archive #4962