Skip to content

KAFKA-7502: Cleanup KTable materialization logic in a single place (doMapValues)#6520

Merged
bbejeck merged 3 commits intoapache:trunkfrom
dongjinleekr:feature/KAFKA-7502-map-values
Mar 29, 2019
Merged

KAFKA-7502: Cleanup KTable materialization logic in a single place (doMapValues)#6520
bbejeck merged 3 commits intoapache:trunkfrom
dongjinleekr:feature/KAFKA-7502-map-values

Conversation

@dongjinleekr
Copy link
Copy Markdown
Contributor

This PR is the final part of KAFKA-7502, which cleans up KTableImpl#doMapValues method. (follow up of #6174, #6453, and #6519)

Committer Checklist (excluded from commit message)

  • Verify design and implementation
  • Verify test coverage and CI build status
  • Verify documentation (including upgrade notes)

1. TableProcessorNode: remove materializedInternal, use storeBuilder instead.
2. Instantiate StoreBuilder in KTableImpl#[doFilter, doMapValues, doTransformValues], instead of TableProcessorNode#init.
… 2. Reformat+trivial changes on TableProcessorNode.java.
@dongjinleekr dongjinleekr changed the title KAFKA-7502: Cleanup KTable materialization logic in a single place KAFKA-7502: Cleanup KTable materialization logic in a single place (doMapValues) Mar 28, 2019
@dongjinleekr
Copy link
Copy Markdown
Contributor Author

cc/ @bbejeck @guozhangwang

@guozhangwang
Copy link
Copy Markdown
Contributor

This and the other #6519 seems just code cleanup and LGTM. I've reviewed both and leave to @bbejeck to take another look and merge.

@dongjinleekr
Copy link
Copy Markdown
Contributor Author

retest this please

Copy link
Copy Markdown
Member

@bbejeck bbejeck left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @dongjinleekr LGTM

@bbejeck bbejeck merged commit ff78c68 into apache:trunk Mar 29, 2019
@bbejeck
Copy link
Copy Markdown
Member

bbejeck commented Mar 29, 2019

Merged #6520 into trunk.

jarekr pushed a commit to confluentinc/kafka that referenced this pull request Apr 18, 2019
* apache/trunk:
  KAFKA-8030: Fix flaky tests in TopicCommandWithAdminClientTest
  fix compile error for example (apache#6526)
  MINOR: Comment spelling nit
  MINOR: Optimize ConnectionStressWorker
  KAFKA-8034: Use automatic RPC generation in DeleteTopics
  MINOR: Move KTable source topic for changelog to optimization framework (apache#6500)
  KAFKA-7502: Cleanup KTable materialization logic in a single place (doMapValues) (apache#6520)
  Cleanup KTableImpl#doTransformValues (apache#6519)
  MINOR: Streams input topic corrected (apache#6513)
  MINOR: WorkerUtils#abort: fix bug in abort logic (apache#6516)
  KAFKA-7502: Cleanup KTable materialization logic in a single place (filter) (apache#6453)
  MINOR: Fix some spelling corrections in comments (apache#6507)
  KAFKA-3522: Add RocksDBTimestampedSegmentedBytesStore (apache#6186)
  MINOR: Add 2.2.0 upgrade instructions (apache#6501)
pengxiaolong pushed a commit to pengxiaolong/kafka that referenced this pull request Jun 14, 2019
…oMapValues) (apache#6520)

* Move materialization logic from TableProcessorNode to KTableImpl

1. TableProcessorNode: remove materializedInternal, use storeBuilder instead.
2. Instantiate StoreBuilder in KTableImpl#[doFilter, doMapValues, doTransformValues], instead of TableProcessorNode#init.

* Cleanup KTableImpl#doMapValues

* 1. Add TableProcessorNode(String, ProcessorParameters, StoreBuilder). 2. Reformat+trivial changes on TableProcessorNode.java.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants