From 50165567a9edd4f6e6ae43663bf6cfb40d39f4bc Mon Sep 17 00:00:00 2001 From: Maxim Gekk Date: Mon, 13 Jan 2020 23:13:10 +0300 Subject: [PATCH 1/4] Update sql-data-sources-avro.md --- docs/sql-data-sources-avro.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/sql-data-sources-avro.md b/docs/sql-data-sources-avro.md index dc534abce28e9..d025c348b1797 100644 --- a/docs/sql-data-sources-avro.md +++ b/docs/sql-data-sources-avro.md @@ -230,7 +230,7 @@ Data source options of Avro can be set via: ignoreExtension true - The option controls ignoring of files without .avro extensions in read.
If the option is enabled, all files (with and without .avro extension) are loaded. + The option controls ignoring of files without .avro extensions in read.
If the option is enabled, all files (with and without .avro extension) are loaded.
The option has been already deprecated, and it will be removed in the future releases. Please use the general data source option pathGlobFilter for filtering file names. read From 91a1deef2dbe5cecdf4592570c1880f663bb629c Mon Sep 17 00:00:00 2001 From: Maxim Gekk Date: Mon, 13 Jan 2020 23:44:21 +0300 Subject: [PATCH 2/4] Describe pathGlobFilter --- docs/sql-data-sources-avro.md | 6 ++++++ 1 file changed, 6 insertions(+) diff --git a/docs/sql-data-sources-avro.md b/docs/sql-data-sources-avro.md index d025c348b1797..ecf2c2494423b 100644 --- a/docs/sql-data-sources-avro.md +++ b/docs/sql-data-sources-avro.md @@ -233,6 +233,12 @@ Data source options of Avro can be set via: The option controls ignoring of files without .avro extensions in read.
If the option is enabled, all files (with and without .avro extension) are loaded.
The option has been already deprecated, and it will be removed in the future releases. Please use the general data source option pathGlobFilter for filtering file names. read + + pathGlobFilter + "" + The option specifies an optional glob pattern to only include files with paths matching the pattern. The syntax follows org.apache.hadoop.fs.GlobFilter. It does not change the behavior of partition discovery. + read + compression snappy From bfbaf2b4eb17cfc0457a8c710003fc59138bace5 Mon Sep 17 00:00:00 2001 From: Maxim Gekk Date: Tue, 14 Jan 2020 10:12:52 +0300 Subject: [PATCH 3/4] Revert "Describe pathGlobFilter" This reverts commit 91a1deef2dbe5cecdf4592570c1880f663bb629c. --- docs/sql-data-sources-avro.md | 6 ------ 1 file changed, 6 deletions(-) diff --git a/docs/sql-data-sources-avro.md b/docs/sql-data-sources-avro.md index ecf2c2494423b..d025c348b1797 100644 --- a/docs/sql-data-sources-avro.md +++ b/docs/sql-data-sources-avro.md @@ -233,12 +233,6 @@ Data source options of Avro can be set via: The option controls ignoring of files without .avro extensions in read.
If the option is enabled, all files (with and without .avro extension) are loaded.
The option has been already deprecated, and it will be removed in the future releases. Please use the general data source option pathGlobFilter for filtering file names. read - - pathGlobFilter - "" - The option specifies an optional glob pattern to only include files with paths matching the pattern. The syntax follows org.apache.hadoop.fs.GlobFilter. It does not change the behavior of partition discovery. - read - compression snappy From 75613424e17d25eedc75df3c48e1be02fbcf8af4 Mon Sep 17 00:00:00 2001 From: Maxim Gekk Date: Wed, 15 Jan 2020 10:07:09 +0300 Subject: [PATCH 4/4] been already deprecated -> been deprecated --- docs/sql-data-sources-avro.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/sql-data-sources-avro.md b/docs/sql-data-sources-avro.md index d025c348b1797..b0076878e02da 100644 --- a/docs/sql-data-sources-avro.md +++ b/docs/sql-data-sources-avro.md @@ -230,7 +230,7 @@ Data source options of Avro can be set via: ignoreExtension true - The option controls ignoring of files without .avro extensions in read.
If the option is enabled, all files (with and without .avro extension) are loaded.
The option has been already deprecated, and it will be removed in the future releases. Please use the general data source option pathGlobFilter for filtering file names. + The option controls ignoring of files without .avro extensions in read.
If the option is enabled, all files (with and without .avro extension) are loaded.
The option has been deprecated, and it will be removed in the future releases. Please use the general data source option pathGlobFilter for filtering file names. read