KAFKA-8602: Backport bugfix for standby task creation

[cadonna]

Backports bugfix in standby task creation from PR #7008.
A separate PR is needed because some tests in the original PR
use topology optimizations and mocks that were introduced afterwards.

Committer Checklist (excluded from commit message)

• Verify design and implementation
• Verify test coverage and CI build status
• Verify documentation (including upgrade notes)

[cadonna]

ping @bbejeck @mjsax @abbccdda @ableegoldman @vvcephei @guozhangwang

[bbejeck]

retest this please

[mjsax]

Retest this please

[cadonna]

Retest this, please

[bbejeck]

retest this please

[mjsax]

Java 10 errors:

kafka.api.SaslGssapiSslEndToEndAuthorizationTest.testProduceConsumeTopicAutoCreateTopicCreateAcl
kafka.api.SslEndToEndAuthorizationTest.testProduceConsumeTopicAutoCreateTopicCreateAcl

Java8 failed, too. Results are not available any longer.

Retest this please.

[cadonna]

Retest this, please

[cadonna]

In Java 10 the following tests failed:

kafka.api.AdminClientIntegrationTest.testConsumeAfterDeleteRecords
kafka.api.SslEndToEndAuthorizationTest.testProduceConsumeTopicAutoCreateTopicCreateAcl
kafka.server.LogDirFailureTest.testIOExceptionDuringLogRoll
org.apache.kafka.streams.scala.KStreamTest.join 2 KStreams should join correctly records

In Java 8 the following tests failed:

kafka.api.AdminClientIntegrationTest.testConsumeAfterDeleteRecords
kafka.api.AdminClientIntegrationTest.testDeleteRecordsWithException
kafka.api.SaslPlainSslEndToEndAuthorizationTest.testProduceConsumeTopicAutoCreateTopicCreateAcl

Retest this, please

[cadonna]

In Java 10 the following test failed

kafka.server.LogDirFailureTest.testIOExceptionDuringLogRoll

In Java 8 the following 190 tests failed.

Retest this, please

[mjsax]

Java 10 failures:

kafka.admin.ResetConsumerGroupOffsetTest.testResetOffsetsToEarliestOnTopicsAndPartitions
kafka.api.PlaintextEndToEndAuthorizationTest.testProduceConsumeTopicAutoCreateTopicCreateAcl
kafka.api.SaslOAuthBearerSslEndToEndAuthorizationTest.testProduceConsumeTopicAutoCreateTopicCreateAcl

Seems Java10 is just flaky.

Java8 had 169 failures, including

org.apache.kafka.streams.scala.KStreamTest.join 2 KStreams should join correctly records

java.lang.NullPointerException
	at org.apache.kafka.streams.scala.KStreamTest$$anonfun$6.apply$mcV$sp(KStreamTest.scala:151)
	at org.apache.kafka.streams.scala.KStreamTest$$anonfun$6.apply(KStreamTest.scala:137)
	at org.apache.kafka.streams.scala.KStreamTest$$anonfun$6.apply(KStreamTest.scala:137)

Seems this fails regularly? Also reported above. Retesting to verify.

The other failures in Java8 seems env issue with regard to Junit (this may depend which host is executing the run? I think, not all workers have the same setup...)

Retest this please.

[cadonna]

Java 8 passed.

In Java 10 the following tests failed:

kafka.api.AdminClientIntegrationTest.testConsumeAfterDeleteRecords
kafka.api.GroupEndToEndAuthorizationTest.testProduceConsumeTopicAutoCreateTopicCreateAcl
kafka.api.SslEndToEndAuthorizationTest.testProduceConsumeTopicAutoCreateTopicCreateAcl

Probably flaky. None of those tests failed in all Java 10 build runs.