Sample of usage Parquet-1396 and Parquet-1178 for column level encryption with pluggable key access

[asfimport]

This Jira provides a sample to use Parquet-1396 and Parquet-1178 column level encryption with pluggable key access. The Spark SQL application shows how to configure Parquet-1396 to encrypt and columns. The project CryptoMetadataRetriever shows how to implement the interface defined in Parquet-1396 as an example. 

The project to be uploaded soon. 

 

Reporter: Xinli Shang / @shangxinli

Related issues:

• EncryptionPropertiesFactory and DecryptionPropertiesFactory (Blocked)
• Passing Field Metadata to Parquet (Blocked)
• Parquet modular encryption (depends upon)

Externally tracked issue: #2220

_{Note: This issue was originally created as PARQUET-1397. Please see the migration documentation for further details.}

[asfimport]

Gabor Szadovszky / @gszadovszky:
As it is related to encryption which is not targeted to 1.11.0 I'm removing target from here.