Skip to content

KAFKA-14133: Migrate Admin mock in TaskManagerTest to Mockito#13712

Merged
cadonna merged 2 commits intoapache:trunkfrom
clolov:KAFKA-14133-PART9
Jun 13, 2023
Merged

KAFKA-14133: Migrate Admin mock in TaskManagerTest to Mockito#13712
cadonna merged 2 commits intoapache:trunkfrom
clolov:KAFKA-14133-PART9

Conversation

@clolov
Copy link
Copy Markdown
Contributor

@clolov clolov commented May 12, 2023 •
edited
Loading

This pull requests migrates the Admin mock in TaskManagerTest from EasyMock to Mockito.
The change is restricted to a single mock to minimize the scope and make it easier for review.

The reasoning as to why we would like to migrate a single mock rather than all mocks in the file at the same time has been discussed in #12607 (comment)

Similar to:
#13529
#13621
#13681
#13711

This needs to be rebased on top of #13711 before merging

machi1990
machi1990 reviewed May 12, 2023
View reviewed changes
Comment thread streams/src/test/java/org/apache/kafka/streams/processor/internals/TaskManagerTest.java Outdated
Comment on lines 3781 to 3729
Copy link
Copy Markdown
Contributor

@machi1990 machi1990 May 12, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This line is removed, and I wonder whether we should add a similar assertion for the adminClient mock after each of these two calls: https://github.com/apache/kafka/blob/ff6b6dd601d9a6156dba249a8b52201a34eaca13/streams/src/test/java/org/apache/kafka/streams/processor/internals/TaskManagerTest.java#L3775-L3779

Copy link
Copy Markdown
Contributor Author

@clolov clolov May 15, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Heya, thank you for the review! I am not quite certain I follow what you mean. The reason this is removed here and elsewhere is that Mockito verifies internally that all when statements are called. EasyMock does not do this by default so it requires an explicit verification.

Copy link
Copy Markdown
Contributor

@machi1990 machi1990 May 15, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You are right; I didn't notice that we are using STRICT_STUBS strictness: https://github.com/apache/kafka/blob/ff6b6dd601d9a6156dba249a8b52201a34eaca13/streams/src/test/java/org/apache/kafka/streams/processor/internals/TaskManagerTest.java#L208

Thanks for the reply!

machi1990
machi1990 reviewed May 12, 2023
View reviewed changes
Comment thread streams/src/test/java/org/apache/kafka/streams/processor/internals/TaskManagerTest.java Outdated
Copy link
Copy Markdown
Contributor

@machi1990 machi1990 May 12, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

same comment as https://github.com/apache/kafka/pull/13712/files#r1192833508

Comment thread streams/src/test/java/org/apache/kafka/streams/processor/internals/TaskManagerTest.java Outdated
Copy link
Copy Markdown
Contributor

@machi1990 machi1990 May 12, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

same comment as https://github.com/apache/kafka/pull/13712/files#r1192833508

@divijvaidya divijvaidya added the tests Test fixes (including flaky tests) label May 15, 2023
@clolov clolov added the streams label May 18, 2023
cadonna
cadonna reviewed Jun 6, 2023
View reviewed changes
Copy link
Copy Markdown
Member

@cadonna cadonna left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the PR, @clolov !

Here my feedback.

Comment thread streams/src/test/java/org/apache/kafka/streams/processor/internals/TaskManagerTest.java Outdated
Comment on lines 3751 to 3700
Copy link
Copy Markdown
Member

@cadonna cadonna Jun 6, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think you need to verify the order of the calls since the admin mock is reset to strict in EasyMock. The order is indeed important here because you do not want to purge records in the wrong order from a repartition topic.

@clolov clolov force-pushed the KAFKA-14133-PART9 branch from ff6b6dd to c49c043 Compare June 6, 2023 16:55
@clolov
Copy link
Copy Markdown
Contributor Author

clolov commented Jun 6, 2023

Heya @cadonna! I hope I have addressed your comment, rebased and updated the overview!

cadonna
cadonna approved these changes Jun 8, 2023
View reviewed changes
Copy link
Copy Markdown
Member

@cadonna cadonna left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

There is just one checkstyle failure that I tried to correct.

Comment thread streams/src/test/java/org/apache/kafka/streams/processor/internals/TaskManagerTest.java Outdated
@cadonna
Copy link
Copy Markdown
Member

cadonna commented Jun 12, 2023

Build failures are unrelated:

    Build / JDK 8 and Scala 2.12 / integration.kafka.server.FetchFromFollowerIntegrationTest.testRackAwareRangeAssignor()
    Build / JDK 8 and Scala 2.12 / kafka.api.ConsumerBounceTest.testConsumptionWithBrokerFailures()
    Build / JDK 8 and Scala 2.12 / org.apache.kafka.controller.QuorumControllerTest.testBalancePartitionLeaders()
    Build / JDK 17 and Scala 2.13 / org.apache.kafka.clients.consumer.KafkaConsumerTest.testShouldAttemptToRejoinGroupAfterSyncGroupFailed()
    Build / JDK 17 and Scala 2.13 / org.apache.kafka.connect.mirror.integration.DedicatedMirrorIntegrationTest.testMultiNodeCluster()
    Build / JDK 17 and Scala 2.13 / org.apache.kafka.connect.mirror.integration.MirrorConnectorsIntegrationExactlyOnceTest.testReplicationWithEmptyPartition()
    Build / JDK 17 and Scala 2.13 / kafka.zk.ZkMigrationIntegrationTest.[1] Type=ZK, Name=testNewAndChangedTopicsInDualWrite, MetadataVersion=3.4-IV0, Security=PLAINTEXT
    Build / JDK 17 and Scala 2.13 / kafka.zk.ZkMigrationIntegrationTest.[1] Type=ZK, Name=testNewAndChangedTopicsInDualWrite, MetadataVersion=3.4-IV0, Security=PLAINTEXT
    Build / JDK 17 and Scala 2.13 / org.apache.kafka.controller.QuorumControllerTest.testBalancePartitionLeaders()
    Build / JDK 17 and Scala 2.13 / org.apache.kafka.trogdor.coordinator.CoordinatorTest.testTaskRequestWithOldStartMsGetsUpdated()
    Build / JDK 11 and Scala 2.13 / kafka.api.ConsumerBounceTest.testCloseDuringRebalance()
    Build / JDK 11 and Scala 2.13 / org.apache.kafka.controller.QuorumControllerTest.testBalancePartitionLeaders()
    Build / JDK 11 and Scala 2.13 / org.apache.kafka.trogdor.coordinator.CoordinatorTest.testTaskRequestWithOldStartMsGetsUpdated()

@clolov
Copy link
Copy Markdown
Contributor Author

clolov commented Jun 12, 2023

Heya @cadonna! Is there something I need to do or this can be merged?

@cadonna
Copy link
Copy Markdown
Member

cadonna commented Jun 12, 2023

I was not sure. The description says

This needs to be rebased on top of #13711 before merging

Can I merge it anyways?

@clolov
Copy link
Copy Markdown
Contributor Author

clolov commented Jun 13, 2023

Ah, sorry, yeah, I have caused the confusion. Technically the order of merging between this and #13711 doesn't matter as long as one is rebased on top of the other afterwards. This appears to be ready to merge so let's go with merging this and I will then update 13711.

@cadonna cadonna merged commit 7f0e455 into apache:trunk Jun 13, 2023
@clolov
Copy link
Copy Markdown
Contributor Author

clolov commented Jun 13, 2023

Thank you! I will now address the comments on the other one!

@clolov clolov deleted the KAFKA-14133-PART9 branch January 27, 2026 11:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@cadonna cadonna cadonna approved these changes

+1 more reviewer

@machi1990 machi1990 machi1990 left review comments

Reviewers whose approvals may not affect merge requirements

Assignees

No one assigned

Labels

streams tests Test fixes (including flaky tests)

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@clolov @cadonna @machi1990 @divijvaidya