Skip to content

KAFKA-10341: Add 2.6.0 to system tests and streams upgrade tests#9116

Merged
rhauch merged 1 commit intoapache:trunkfrom
rhauch:kafka-10341
Aug 4, 2020
Merged

KAFKA-10341: Add 2.6.0 to system tests and streams upgrade tests#9116
rhauch merged 1 commit intoapache:trunkfrom
rhauch:kafka-10341

Conversation

@rhauch
Copy link
Copy Markdown
Contributor

@rhauch rhauch commented Aug 3, 2020

BTW, tests/kafkatest/version.py was already modified to define the 2.6.0 version constants for the system tests, but these variables were never used. Thus, no need to modify that file.

Based upon #8378 (for 2.5)

Committer Checklist (excluded from commit message)

  • Verify design and implementation
  • Verify test coverage and CI build status
  • Verify documentation (including upgrade notes)

@rhauch
Copy link
Copy Markdown
Contributor Author

rhauch commented Aug 3, 2020

Just kicked off a build of the Streams system tests (e.g., TC_PATHS=tests/kafkatest/tests/streams/streams_upgrade_test.py) using this PR:
https://jenkins.confluent.io/job/system-test-kafka-branch-builder/4082/

and a full system test run using this PR: https://jenkins.confluent.io/job/system-test-kafka-branch-builder/4083/

@rhauch rhauch requested review from abbccdda and mjsax August 3, 2020 22:59
@mjsax mjsax added streams tests Test fixes (including flaky tests) labels Aug 3, 2020
Copy link
Copy Markdown
Member

@mjsax mjsax left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @rhauch! LGTM assuming Jenkins and system tests passed.

@rhauch
Copy link
Copy Markdown
Contributor Author

rhauch commented Aug 4, 2020

Thanks, @mjsax

The streams-only system test run (https://jenkins.confluent.io/job/system-test-kafka-branch-builder/4082/) passed. The other was interrupted by a Jenkins restart. I'll restart the full system test run tomorrow AM.

@rhauch
Copy link
Copy Markdown
Contributor Author

rhauch commented Aug 4, 2020

Green builds on JDK 11 and 14, and two unrelated failures (known flaky integration tests, not system tests) on JDK 8:

Test Result (2 failures / +1)
    org.apache.kafka.streams.integration.EosBetaUpgradeIntegrationTest.shouldUpgradeFromEosAlphaToEosBeta[false]
    org.apache.kafka.streams.integration.EosBetaUpgradeIntegrationTest.shouldUpgradeFromEosAlphaToEosBeta[true]

I started a second run of all system tests with this branch: https://jenkins.confluent.io/job/system-test-kafka-branch-builder/4088/

@rhauch
Copy link
Copy Markdown
Contributor Author

rhauch commented Aug 4, 2020

The [second run|https://jenkins.confluent.io/job/system-test-kafka-branch-builder/4088] with all of the system tests had [two failures|http://confluent-kafka-branch-builder-system-test-results.s3-us-west-2.amazonaws.com/2020-08-04--001.1596577078--rhauch--kafka-10341--f0164cbb3/report.html]:

Module: kafkatest.tests.core.round_trip_fault_test 
Class:  RoundTripFaultTest 
Method: test_round_trip_workload_with_broker_partition

Module: kafkatest.tests.client.consumer_test
Class:  OffsetValidationTest
Method: test_static_consumer_bounce 
Arguments: {   "bounce_mode": "all",   "clean_shutdown": true,   "num_bounces": 5,   "static_membership": false }

These have been somewhat flaky recently on the 2.6 branch (at least), but they are not directly affected by this PR.

@rhauch rhauch merged commit 1112fd4 into apache:trunk Aug 4, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

streams tests Test fixes (including flaky tests)

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants