Skip to content

MINOR: V2.8 system tests for Raft-based metadata quorums#10175

Closed
rondagostino wants to merge 5 commits intoapache:2.8from
rondagostino:kip500_system_tests_2.8
Closed

MINOR: V2.8 system tests for Raft-based metadata quorums#10175
rondagostino wants to merge 5 commits intoapache:2.8from
rondagostino:kip500_system_tests_2.8

Conversation

@rondagostino
Copy link
Copy Markdown
Contributor

@rondagostino rondagostino commented Feb 22, 2021

Adds a new sanity_checks/bounce_test.py system test for a simple produce/bounce/produce series of events. Augments this and other sanity_checks tests so they run all metadata quorum types: ZooKeeper, remote Raft, and co-located Raft.

Augments several tests/client and tests/core system tests to run for remote Raft-based metadata quorums in addition to ZooKeeper. Co-located Raft controllers are not tested here as this configuration is presumed to work assuming sanity_checks as well as any unit/integration tests pass.

Augments a simple set of tests in tests/connect, tests/streams, and tests/tools to run for remote Raft-based metadata quorums in addition to ZooKeeper.

Adds missing @cluster annotations for dozens of system tests that were missing them -- this was causing these tests to grab the entire cluster of nodes and negatively impact the parallelism of the system test run. This PR adds 40% more system tests, but thanks to the addition of the missing @#cluster annotations we are able to complete the new 140% test workload in 8% less time than before.

This is equivalent to #10105 targeted at trunk except for get_offset_shell_test.py which has diverged on trunk compared to 2.8 -- the PRs differ in this single file.

Committer Checklist (excluded from commit message)

  • Verify design and implementation
  • Verify test coverage and CI build status
  • Verify documentation (including upgrade notes)

@cmccabe
Copy link
Copy Markdown
Contributor

cmccabe commented Feb 22, 2021

thanks, @rondagostino! I backported this as part of the #10105 PR as we usually do (we don't usually have a separate PR for the branch). Thanks for showing me how to resolve the conflicts in get_offset_shell_test.py.

@cmccabe cmccabe closed this Feb 22, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants