Skip to content

KAFKA-9896: fix flaky StandbyTaskEOSIntegrationTest#8883

Merged
guozhangwang merged 2 commits intoapache:trunkfrom
ableegoldman:HOTFIX-fix-flaky-StandbyTaskEOSIntegrationTest
Jun 18, 2020
Merged

KAFKA-9896: fix flaky StandbyTaskEOSIntegrationTest#8883
guozhangwang merged 2 commits intoapache:trunkfrom
ableegoldman:HOTFIX-fix-flaky-StandbyTaskEOSIntegrationTest

Conversation

@ableegoldman
Copy link
Copy Markdown
Member

We seem to typically fail on waiting for the first record to be processed, which we only give 15s. 15s to process a single record is reasonable, but we don't wait for the instances to reach the RUNNIG state until after we wait for the record to be processed.

We should first make sure the instance reaches running (for which a 60s timeout seems to be the common case in other integration tests), and then wait on the record to be processed.

@mjsax mjsax added streams tests Test fixes (including flaky tests) labels Jun 16, 2020
@mjsax
Copy link
Copy Markdown
Member

mjsax commented Jun 16, 2020

Retest this please.

@mjsax
Copy link
Copy Markdown
Member

mjsax commented Jun 16, 2020

Retest this please.

1 similar comment
@mjsax
Copy link
Copy Markdown
Member

mjsax commented Jun 16, 2020

Retest this please.

@mjsax
Copy link
Copy Markdown
Member

mjsax commented Jun 17, 2020

Checkstyle error:

[ant:checkstyle] [ERROR] /home/jenkins/jenkins-slave/workspace/kafka-pr-jdk11-scala2.13/streams/src/test/java/org/apache/kafka/streams/integration/StandbyTaskEOSIntegrationTest.java:46:8: Unused import - java.util.Arrays. [UnusedImports]
15:29:35 [ant:checkstyle] [ERROR] /home/jenkins/jenkins-slave/workspace/kafka-pr-jdk11-scala2.13/streams/src/test/java/org/apache/kafka/streams/integration/StandbyTaskEOSIntegrationTest.java:56:15: Unused import - org.apache.kafka.test.TestUtils.waitForCondition. [UnusedImports]

@ableegoldman ableegoldman force-pushed the HOTFIX-fix-flaky-StandbyTaskEOSIntegrationTest branch from 767ae11 to 46a50f3 Compare June 17, 2020 01:42
@mjsax
Copy link
Copy Markdown
Member

mjsax commented Jun 17, 2020

Retest this please.

1 similar comment
@mjsax
Copy link
Copy Markdown
Member

mjsax commented Jun 17, 2020

Retest this please.

@ableegoldman
Copy link
Copy Markdown
Member Author

Failed with unrelated flaky
admin.ReassignPartitionsUnitTest.testModifyBrokerThrottles
and
connect.mirror.MirrorConnectorsIntegrationTest.testReplication

@mjsax
Copy link
Copy Markdown
Member

mjsax commented Jun 17, 2020

Retest this please

Copy link
Copy Markdown
Contributor

@guozhangwang guozhangwang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

@ableegoldman
Copy link
Copy Markdown
Member Author

@mjsax can this merged? One failure in one build:

MirrorConnectorsIntegrationTest.testReplication

@guozhangwang guozhangwang merged commit 7ed899a into apache:trunk Jun 18, 2020
Kvicii pushed a commit to Kvicii/kafka that referenced this pull request Jun 21, 2020
* 'trunk' of github.com:apache/kafka:
  KAFKA-10168: fix StreamsConfig parameter name variable (apache#8865)
  MINOR: code cleanup for inconsistent naming (apache#8871)
  KAFKA-10138: Prefer --bootstrap-server for reassign_partitions command in ducktape tests (apache#8898)
  KAFKA-10185: Restoration info logging (apache#8896)
  KAFKA-9891: add integration tests for EOS and StandbyTask (apache#8890)
  MINOR: Reduce build time by gating test coverage plugins behind a flag (apache#8899)
  KAFKA-10141; Add more detail to log segment delete messages (apache#8850)
  KAFKA-10113; Specify fetch offsets correctly in `LogTruncationException` (apache#8822)
  KAFKA-10167: use the admin client to read end-offset (apache#8876)
  MINOR: Upgrade ducktape to 0.7.8 (apache#8879)
  KAFKA-10123; Fix incorrect value for AWAIT_RESET#hasPosition (apache#8841)
  KAFKA-9896: fix flaky StandbyTaskEOSIntegrationTest (apache#8883)
  MINOR: clean up unused checkstyle suppressions for Streams (apache#8861)
  MINOR: reuse toConfigObject(Map) to generate Config (apache#8889)
  MINOR: Upgrade jetty to 9.4.27.v20200227 and jersey to 2.31 (apache#8859)
  MINOR: Fix flaky HighAvailabilityTaskAssignorIntegrationTest (apache#8884)
  KAFKA-10147 MockAdminClient#describeConfigs(Collection<ConfigResource>) is unable to handle broker resource (apache#8853)
  KAFKA-10165: Remove Percentiles from e2e metrics (apache#8882)

# Conflicts:
#	core/src/main/scala/kafka/log/Log.scala
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

streams tests Test fixes (including flaky tests)

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants