[Failing Test]: beam_PreCommit_Java_Kafka_IO_Direct flaky: KafkaIOIT.testWatermarkUpdateWithSparseMessages

[Abacn]

What happened?

This is kafka version compability tests and running multiple times in a test suite run. With high probability (20%-50%) one of the run fails.

The test relies on two concurrently running pipelines which may cause the flake under unpredictable CPU load on host machine.

Issue Failure

Failure: Test is flaky

Issue Priority

Priority: 2 (backlog / disabled test but we think the product is healthy)

Issue Components

• Component: Python SDK
• Component: Java SDK
• Component: Go SDK
• Component: Typescript SDK
• Component: IO connector
• Component: Beam examples
• Component: Beam playground
• Component: Beam katas
• Component: Website
• Component: Spark Runner
• Component: Flink Runner
• Component: Samza Runner
• Component: Twister2 Runner
• Component: Hazelcast Jet Runner
• Component: Google Cloud Dataflow Runner

[Abacn]

Looks like this is resolved by #26153 (see history of https://ci-beam.apache.org/job/beam_PreCommit_Java_Kafka_IO_Direct_Cron/) closing this for now. CC: @johnjcasey