From 9df89a047ed6c4d72e0239586fe3abb0af73cc1b Mon Sep 17 00:00:00 2001 From: Misha Tiurin <650819+tiurin@users.noreply.github.com> Date: Wed, 2 Apr 2025 12:14:57 +0200 Subject: [PATCH 1/3] Update Managed Flink docs - Reflect recent changes to how LocalStack runs Flink cluster - Clarify parallelism limitations --- content/en/user-guide/aws/kinesisanalyticsv2/index.md | 4 ++++ 1 file changed, 4 insertions(+) diff --git a/content/en/user-guide/aws/kinesisanalyticsv2/index.md b/content/en/user-guide/aws/kinesisanalyticsv2/index.md index 1dc8df4107..e4b82febfa 100644 --- a/content/en/user-guide/aws/kinesisanalyticsv2/index.md +++ b/content/en/user-guide/aws/kinesisanalyticsv2/index.md @@ -17,6 +17,9 @@ This service was formerly known as 'Kinesis Data Analytics for Apache Flink'. LocalStack lets you to run Flink applications locally and implements several [AWS-compatible API operations](https://docs.localstack.cloud/references/coverage/coverage_kinesisanalyticsv2/). +A separate Apache Flink cluster is started in [application mode](https://nightlies.apache.org/flink/flink-docs-release-1.20/docs/deployment/overview/#application-mode) for every Managed Flink application created. +Flink cluster deployment on LocalStack consists of 2 separate containers for [JobManager](https://nightlies.apache.org/flink/flink-docs-release-1.20/docs/concepts/flink-architecture/#jobmanager) and [TaskManager](https://nightlies.apache.org/flink/flink-docs-release-1.20/docs/concepts/flink-architecture/#taskmanagers). + {{< callout "note" >}} The emulated MSF provider was introduced and made the default in LocalStack v4.1. @@ -260,3 +263,4 @@ $ awslocal kinesisanalyticsv2 untag-resource \ - [Snapshot/savepoint management](https://docs.aws.amazon.com/managed-flink/latest/java/how-snapshots.html) is not implemented - CloudTrail integration and CloudWatch metrics is not implemented. The application logging level defaults to `INFO` and can not be overridden. +- Parallelism is limited to the default value of 1, with one TaskManager that has one [Task Slot](https://nightlies.apache.org/flink/flink-docs-release-1.20/docs/concepts/flink-architecture/#task-slots-and-resources) allocated. From 807b0714a801c267305ceff68fa8839e17070930 Mon Sep 17 00:00:00 2001 From: Misha Tiurin <650819+tiurin@users.noreply.github.com> Date: Wed, 2 Apr 2025 13:46:37 +0200 Subject: [PATCH 2/3] Use words instead of digits Co-authored-by: Viren Nadkarni --- content/en/user-guide/aws/kinesisanalyticsv2/index.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/content/en/user-guide/aws/kinesisanalyticsv2/index.md b/content/en/user-guide/aws/kinesisanalyticsv2/index.md index e4b82febfa..fd1e8a6da0 100644 --- a/content/en/user-guide/aws/kinesisanalyticsv2/index.md +++ b/content/en/user-guide/aws/kinesisanalyticsv2/index.md @@ -18,7 +18,7 @@ This service was formerly known as 'Kinesis Data Analytics for Apache Flink'. LocalStack lets you to run Flink applications locally and implements several [AWS-compatible API operations](https://docs.localstack.cloud/references/coverage/coverage_kinesisanalyticsv2/). A separate Apache Flink cluster is started in [application mode](https://nightlies.apache.org/flink/flink-docs-release-1.20/docs/deployment/overview/#application-mode) for every Managed Flink application created. -Flink cluster deployment on LocalStack consists of 2 separate containers for [JobManager](https://nightlies.apache.org/flink/flink-docs-release-1.20/docs/concepts/flink-architecture/#jobmanager) and [TaskManager](https://nightlies.apache.org/flink/flink-docs-release-1.20/docs/concepts/flink-architecture/#taskmanagers). +Flink cluster deployment on LocalStack consists of two separate containers for [JobManager](https://nightlies.apache.org/flink/flink-docs-release-1.20/docs/concepts/flink-architecture/#jobmanager) and [TaskManager](https://nightlies.apache.org/flink/flink-docs-release-1.20/docs/concepts/flink-architecture/#taskmanagers). {{< callout "note" >}} The emulated MSF provider was introduced and made the default in LocalStack v4.1. From 136c56baea41a2a39e094951fd763b28b64ae1d7 Mon Sep 17 00:00:00 2001 From: Misha Tiurin <650819+tiurin@users.noreply.github.com> Date: Wed, 2 Apr 2025 13:58:08 +0200 Subject: [PATCH 3/3] Clarify that parallelism parameters are ignored --- content/en/user-guide/aws/kinesisanalyticsv2/index.md | 1 + 1 file changed, 1 insertion(+) diff --git a/content/en/user-guide/aws/kinesisanalyticsv2/index.md b/content/en/user-guide/aws/kinesisanalyticsv2/index.md index fd1e8a6da0..88c38d21e4 100644 --- a/content/en/user-guide/aws/kinesisanalyticsv2/index.md +++ b/content/en/user-guide/aws/kinesisanalyticsv2/index.md @@ -264,3 +264,4 @@ $ awslocal kinesisanalyticsv2 untag-resource \ - CloudTrail integration and CloudWatch metrics is not implemented. The application logging level defaults to `INFO` and can not be overridden. - Parallelism is limited to the default value of 1, with one TaskManager that has one [Task Slot](https://nightlies.apache.org/flink/flink-docs-release-1.20/docs/concepts/flink-architecture/#task-slots-and-resources) allocated. + [Parallelism configuration](https://docs.aws.amazon.com/managed-flink/latest/apiv2/API_FlinkApplicationConfiguration.html#APIReference-Type-FlinkApplicationConfiguration-ParallelismConfiguration) provided on Flink application creation or update is ignored.