From 333a360ce6c146b1ae35d48e0d6166b447a1c675 Mon Sep 17 00:00:00 2001 From: andersonm-ibm <63074550+andersonm-ibm@users.noreply.github.com> Date: Tue, 11 Jan 2022 23:53:02 +0200 Subject: [PATCH 1/2] Update parquet-encryption.md - add missing newline Add a missing newline in the Python: Writing encrypted data example. --- parquet-encryption.md | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/parquet-encryption.md b/parquet-encryption.md index 4805fe3..2aeabad 100644 --- a/parquet-encryption.md +++ b/parquet-encryption.md @@ -135,7 +135,8 @@ The following sample code snippets for Python and Scala show how to create data sc._jsc.hadoopConfiguration().set("encryption.key.list", "key1: AAECAwQFBgcICQoLDA0ODw==, key2: AAECAAECAAECAAECAAECAA==") - encryptedParquetPath = "squares.parquet.encrypted"squaresDF.write\ + encryptedParquetPath = "squares.parquet.encrypted" + squaresDF.write\ .option("parquet.encryption.column.keys", "key1:square_int_column")\ .option("parquet.encryption.footer.key", "key2")\ .parquet(encryptedParquetPath) From 4b5012a758b6225d6635ff0a137ee695b3b0d1fb Mon Sep 17 00:00:00 2001 From: andersonm-ibm <63074550+andersonm-ibm@users.noreply.github.com> Date: Wed, 12 Jan 2022 00:42:58 +0200 Subject: [PATCH 2/2] Add another missing newline in parquet-encryption.md --- parquet-encryption.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/parquet-encryption.md b/parquet-encryption.md index 2aeabad..01eea26 100644 --- a/parquet-encryption.md +++ b/parquet-encryption.md @@ -126,9 +126,9 @@ The following sample code snippets for Python and Scala show how to create data - Python: Writing encrypted data ```python - from pyspark.sql import + from pyspark.sql import Row - RowsquaresDF = spark.createDataFrame( + squaresDF = spark.createDataFrame( sc.parallelize(range(1, 6)) .map(lambda i: Row(int_column=i, square_int_column=i ** 2)))