Skip to content

Upgrade tests for KAFKA-13769#12122

Merged
mjsax merged 4 commits intoapache:trunkfrom
Gerrrr:KAFKA-13769-upgrade-tests
May 14, 2022
Merged

Upgrade tests for KAFKA-13769#12122
mjsax merged 4 commits intoapache:trunkfrom
Gerrrr:KAFKA-13769-upgrade-tests

Conversation

@Gerrrr
Copy link
Copy Markdown
Contributor

@Gerrrr Gerrrr commented May 4, 2022

This PR adds upgrade tests for the changes in Foreign Key join protocol in KAFKA-13769. New upgrade tests ensure that FK joins keep working after a 2-bounce upgrade despite the protocol changes. I added the tests for all Kafka versions starting from 2.4 - the version that introduced FK joins.

Committer Checklist (excluded from commit message)

  • Verify design and implementation
  • Verify test coverage and CI build status
  • Verify documentation (including upgrade notes)

@Gerrrr Gerrrr force-pushed the KAFKA-13769-upgrade-tests branch 3 times, most recently from 5a6dea4 to d25cdd4 Compare May 5, 2022 12:55
@Gerrrr Gerrrr force-pushed the KAFKA-13769-upgrade-tests branch from 3a69e4c to 371c5b9 Compare May 10, 2022 09:56
@Gerrrr
Copy link
Copy Markdown
Contributor Author

Gerrrr commented May 10, 2022

@mjsax Can you please review?

Copy link
Copy Markdown
Member

@mjsax mjsax left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the PR. Can you trigger a system test run to ensure it's working before we merge it.


private static <KIn, VIn, KOut, VOut> ProcessorSupplier<KIn, VIn, KOut, VOut> printProcessorSupplier() {
private static void buildFKTable(final KStream<String, Integer> primaryTable,
final KTable<Integer, String> otherTable) {
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: indention

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done in d530a29.


metadata_1_versions = [str(LATEST_0_10_0)]
metadata_2_versions = [str(LATEST_0_10_1), str(LATEST_0_10_2), str(LATEST_0_11_0), str(LATEST_1_0), str(LATEST_1_1)]
fk_join_versions = [str(V_2_4_0)]
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We only test with latest bug-fix releases, so we can use LATEST_2_4 here.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we test all versions 2.4 - 3.1 ?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done in d530a29.

@Gerrrr
Copy link
Copy Markdown
Contributor Author

Gerrrr commented May 11, 2022

@mjsax How can I trigger system tests in the CI?

@Gerrrr Gerrrr force-pushed the KAFKA-13769-upgrade-tests branch from d530a29 to 4ea47f1 Compare May 13, 2022 13:39
@Gerrrr
Copy link
Copy Markdown
Contributor Author

Gerrrr commented May 13, 2022

Green CI run with system tests - https://jenkins.confluent.io/job/system-test-kafka-branch-builder/4897/.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants