From 7fb13fd69bc0e746ff2873dd2a8b62b28b3d64c1 Mon Sep 17 00:00:00 2001 From: Gian Merlino Date: Wed, 8 Jul 2020 13:06:06 -0700 Subject: [PATCH 1/2] Fix documentation for Kinesis fetchThreads The default was changed in #9819, but the documentation wasn't updated. --- docs/development/extensions-core/kinesis-ingestion.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/development/extensions-core/kinesis-ingestion.md b/docs/development/extensions-core/kinesis-ingestion.md index 6698f10b2fe1..2551d6e2255e 100644 --- a/docs/development/extensions-core/kinesis-ingestion.md +++ b/docs/development/extensions-core/kinesis-ingestion.md @@ -185,7 +185,7 @@ The tuningConfig is optional and default parameters will be used if no tuningCon | `recordBufferOfferTimeout` | Integer | Length of time in milliseconds to wait for space to become available in the buffer before timing out. | no (default == 5000) | | `recordBufferFullWait` | Integer | Length of time in milliseconds to wait for the buffer to drain before attempting to fetch records from Kinesis again. | no (default == 5000) | | `fetchSequenceNumberTimeout` | Integer | Length of time in milliseconds to wait for Kinesis to return the earliest or latest sequence number for a shard. Kinesis will not return the latest sequence number if no data is actively being written to that shard. In this case, this fetch call will repeatedly timeout and retry until fresh data is written to the stream. | no (default == 60000) | -| `fetchThreads` | Integer | Size of the pool of threads fetching data from Kinesis. There is no benefit in having more threads than Kinesis shards. | no (default == max(1, {numProcessors} - 1)) | +| `fetchThreads` | Integer | Size of the pool of threads fetching data from Kinesis. There is no benefit in having more threads than Kinesis shards. | no (default == procs * 2, where "procs" is the number of processors on the server that the task is running on) | | `segmentWriteOutMediumFactory` | Object | Segment write-out medium to use when creating segments. See below for more information. | no (not specified by default, the value from `druid.peon.defaultSegmentWriteOutMediumFactory.type` is used) | | `intermediateHandoffPeriod` | ISO8601 Period | How often the tasks should hand off segments. Handoff will happen either if `maxRowsPerSegment` or `maxTotalRows` is hit or every `intermediateHandoffPeriod`, whichever happens earlier. | no (default == P2147483647D) | | `logParseExceptions` | Boolean | If true, log an error message when a parsing exception occurs, containing information about the row where the error occurred. | no, default == false | From 25ca680155f1b86b294e121a287e6e9d324b0ea1 Mon Sep 17 00:00:00 2001 From: Gian Merlino Date: Wed, 8 Jul 2020 16:44:16 -0700 Subject: [PATCH 2/2] Add 'procs' to spelling. --- website/.spelling | 1 + 1 file changed, 1 insertion(+) diff --git a/website/.spelling b/website/.spelling index bd96d4e9b9d3..4e2f74d571e3 100644 --- a/website/.spelling +++ b/website/.spelling @@ -331,6 +331,7 @@ prepends prepopulated preprocessing priori +procs programmatically proto proxied