Skip to content

KAFKA-8080: Remove system test#20406

Closed
RaidenE1 wants to merge 3 commits intoapache:trunkfrom
RaidenE1:remove-system-test
Closed

KAFKA-8080: Remove system test#20406
RaidenE1 wants to merge 3 commits intoapache:trunkfrom
RaidenE1:remove-system-test

Conversation

@RaidenE1
Copy link
Copy Markdown
Contributor

After KAFKA-7944, the system test streams_eos_test.py is mostly redundant.

@github-actions github-actions Bot added triage PRs from the community streams tests Test fixes (including flaky tests) labels Aug 25, 2025
@github-actions
Copy link
Copy Markdown

github-actions Bot commented Sep 2, 2025

A label of 'needs-attention' was automatically added to this PR in order to raise the
attention of the committers. Once this issue has been triaged, the triage label
should be removed to prevent this automation from happening again.

Copy link
Copy Markdown
Member

@mjsax mjsax left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Couple of minor question. Overall, it's quite hard to read the diff. Would it be possible to split this into multiple PRs, to make individual rewrite easier to follow?

Eg, move a method from EOSTestDriver to SmokeTestDriver. Introduced helper class RecordProcessingState, introduce VerificationResult?

final int maxRecordsPerKey,
final boolean eosEnabled) {
final Properties props = createConsumerProperties(kafka);
final KafkaConsumer<String, Number> consumer = new KafkaConsumer<>(props);
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: let's user try-with-resource

return partitions;
}

private static void verifyAllTransactionFinished(final KafkaConsumer<byte[], byte[]> consumer,
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Seems we copied this from EosTestDriver? Why did we drop the repartition step?

If we use repartitioning in the EOS test, but not in the Smoke test, we should add a partition step to the smoke test, to not reduce test coverage.


try (final KafkaConsumer<byte[], byte[]> eosConsumer = new KafkaConsumer<>(eosProps)) {
verifyAllTransactionFinished(eosConsumer, kafka);
return new VerificationResult(true, "EOS verification passed");
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If we are working with VerificationResult, would it be better to let verifyAllTransactionFinished return what we need? Or at least a boolean, to avoid unnecessary exception handling?

@github-actions github-actions Bot removed needs-attention triage PRs from the community labels Oct 7, 2025
@RaidenE1 RaidenE1 closed this Oct 16, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

streams tests Test fixes (including flaky tests)

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants