Kafka-6693: Added consumer workload to Trogdor

[apovzner]

Added consumer only workload to Trogdor. The topics must already be pre-populated. The spec lets the user request topic pattern and range of partitions to assign to [startPartition, endPartition].

Committer Checklist (excluded from commit message)

• Verify design and implementation
• Verify test coverage and CI build status
• Verify documentation (including upgrade notes)

[cmccabe]

Should be CREATE_TOPICS_REQUEST_TIMEOUT for consistency

[cmccabe]

We should have a clientConf as well, right-- as per the discussion earlier about admin client security configs

[apovzner]

Yes, added commonConf and adminClientConf.

[cmccabe]

Looks good overall. Thanks, @apovzner

[rajinisivaram]

@apovzner Thanks for the PR. Looks good, left a few minor comments.

[rajinisivaram]

Perhaps we should change the name of CREATE_TOPICS_REQUEST_TIMEOUT since it used as timeout for ListTopicsRequest and DescribeTopicsRequest.

[rajinisivaram]

Perhaps it is better to check isInternal first to avoid doing the regex match unnecessarily?

[rajinisivaram]

It feels odd to set this.consumer to null here. I was expecting any previous value to be set to null immediately after the consumer is closed. Otherwise, there ought to be a consumer.close() before setting to null. Since stop closes and sets consumer to null, perhaps we dont need this here?

[apovzner]

Yes, stop() closes the consumer and sets to null anyway, and we guard agains multiple start() or close() calls. I will remove setting it to null here.

[rajinisivaram]

remove blank line?

[rajinisivaram]

Can we use either records or messages consistently?

[apovzner]

I will change to ConsumeMessages since we use word message everywhere.

[rajinisivaram]

Could use Utils.mkSet()

[rajinisivaram]

Could use Utils.mkSet

[rajinisivaram]

@apovzner Thanks for the updates, LGTM

[rajinisivaram]

Merging to trunk.