Skip to content

KAFKA-7938: Fix test flakiness in DeleteConsumerGroupsTest#6312

Merged
vahidhashemian merged 1 commit intoapache:trunkfrom
gwenshap:KAFKA-7938-trunk
Feb 23, 2019
Merged

KAFKA-7938: Fix test flakiness in DeleteConsumerGroupsTest#6312
vahidhashemian merged 1 commit intoapache:trunkfrom
gwenshap:KAFKA-7938-trunk

Conversation

@gwenshap
Copy link
Copy Markdown
Contributor

Address the comments on PR-6307. Sorry for new PR, but one of the comments was to move the PR to another branch.


This attempts to fix KAFKA-7938 and KAFKA-7946.

I removed two tests:

  • testDeleteWithShortInitialization basically didn't check the result and therefore always passed
  • testDeleteCmdWithShortInitialization has no way to enforce that initialization is indeed short, and therefore sometimes FAILED because the group would be created before the CMD tried to delete it.

I thought the tests had limited value relative to the effort of figuring out a way to make the timing work.

I also fixed testDeleteCmdNonEmptyGroup and testDeleteNonEmptyGroup so they will validate that the group both exists and is non-empty before starting the test itself. I also added some extra information for future debugging sessions :)

I ran the tests LOTS of times to validate, but with flaky tests, it is hard to tell :)

Committer Checklist (excluded from commit message)

  • Verify design and implementation
  • Verify test coverage and CI build status
  • Verify documentation (including upgrade notes)

@gwenshap
Copy link
Copy Markdown
Contributor Author

cc @mjsax

Copy link
Copy Markdown
Contributor

@vahidhashemian vahidhashemian left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Thanks!
The failed unit tests seems to be another flaky test.

@vahidhashemian vahidhashemian merged commit e82cc50 into apache:trunk Feb 23, 2019
vahidhashemian pushed a commit that referenced this pull request Feb 23, 2019
@vahidhashemian
Copy link
Copy Markdown
Contributor

Also cherry-picked to 2.2 branch.

jarekr pushed a commit to confluentinc/kafka that referenced this pull request Apr 18, 2019
* AK/trunk: (36 commits)
  KAFKA-7962: Avoid NPE for StickyAssignor (apache#6308)
  Address flakiness of CustomQuotaCallbackTest#testCustomQuotaCallback (apache#6330)
  KAFKA-7918: Inline generic parameters Pt. II: RocksDB Bytes Store and Memory LRU Caches (apache#6327)
  MINOR: fix parameter naming (apache#6316)
  KAFKA-7956 In ShutdownableThread, immediately complete the shutdown if the thread has not been started (apache#6218)
  MINOR: Refactor replica log dir fetching for improved logging (apache#6313)
  [TRIVIAL] Remove unused StreamsGraphNode#repartitionRequired (apache#6227)
  MINOR: Increase produce timeout to 120 seconds (apache#6326)
  KAFKA-7918: Inline generic parameters Pt. I: in-memory key-value store (apache#6293)
  MINOR: Fix line break issue in upgrade notes (apache#6320)
  KAFKA-7972: Use automatic RPC generation in SaslHandshake
  MINOR: Enable capture of full stack trace in StreamTask#process (apache#6310)
  KAFKA-7938: Fix test flakiness in DeleteConsumerGroupsTest (apache#6312)
  KAFKA-7937: Fix Flaky Test ResetConsumerGroupOffsetTest.testResetOffsetsNotExistingGroup (apache#6311)
  MINOR: Update docs to say 2.2 (apache#6315)
  KAFKA-7672 : force write checkpoint during StreamTask #suspend (apache#6115)
  KAFKA-7961; Ignore assignment for un-subscribed partitions (apache#6304)
  KAFKA-7672: Restoring tasks need to be closed upon task suspension (apache#6113)
  KAFKA-7864; validate partitions are 0-based (apache#6246)
  KAFKA-7492 : Updated javadocs for aggregate and reduce methods returning null behavior. (apache#6285)
  ...
pengxiaolong pushed a commit to pengxiaolong/kafka that referenced this pull request Jun 14, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants