Skip to content

KAFKA-7502: Cleanup KTable materialization logic in a single place (filter)#6453

Merged
guozhangwang merged 5 commits intoapache:trunkfrom
dongjinleekr:feature/KAFKA-7502-filter
Mar 28, 2019
Merged

KAFKA-7502: Cleanup KTable materialization logic in a single place (filter)#6453
guozhangwang merged 5 commits intoapache:trunkfrom
dongjinleekr:feature/KAFKA-7502-filter

Conversation

@dongjinleekr
Copy link
Copy Markdown
Contributor

This PR is a follow-up of #6174, which handles doFilter method.

cc/ @guozhangwang @bbejeck

Committer Checklist (excluded from commit message)

  • Verify design and implementation
  • Verify test coverage and CI build status
  • Verify documentation (including upgrade notes)

@dongjinleekr dongjinleekr changed the title KAFKA-7502: Cleanup KTable materialization logic in a single place KAFKA-7502: Cleanup KTable materialization logic in a single place (filter) Mar 16, 2019
@bbejeck
Copy link
Copy Markdown
Member

bbejeck commented Mar 21, 2019

Java 8 passed, Java 11 failed. Results already cleaned up.

retest this please

@bbejeck bbejeck requested a review from guozhangwang March 21, 2019 17:20
@bbejeck
Copy link
Copy Markdown
Member

bbejeck commented Mar 21, 2019

ping @guozhangwang @mjsax @vvcephei @ableegoldman for reviews

Copy link
Copy Markdown
Member

@bbejeck bbejeck left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @dongjinleekr, I've made a pass over overall this looks good to me. I just have a couple of minor comments.

Comment thread streams/src/main/java/org/apache/kafka/streams/kstream/internals/KTableImpl.java Outdated
Copy link
Copy Markdown
Member

@bbejeck bbejeck left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actually meant to hit comment first.

Thanks @dongjinleekr, I've made a pass over overall this looks good to me. I just have a couple of minor comments.

Copy link
Copy Markdown
Member

@bbejeck bbejeck left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the updates @dongjinleekr looks good to me.

However, the build failure is related.
Take a look at line 314 in KTableImpl the TableProcessorNode constructor parameters need adjusting.

1. TableProcessorNode: remove materializedInternal, use storeBuilder instead.
2. Instantiate StoreBuilder in KTableImpl#[doFilter, doMapValues, doTransformValues], instead of TableProcessorNode#init.
… 2. Reformat+trivial changes on TableProcessorNode.java.
@dongjinleekr dongjinleekr force-pushed the feature/KAFKA-7502-filter branch from dac3d7a to e44aa46 Compare March 25, 2019 07:01
@dongjinleekr
Copy link
Copy Markdown
Contributor Author

@bbejeck I'm sorry, I omitted a line from commit; here is the fix with rebasing onto the latest trunk.
Screenshot from 2019-03-25 16-00-56

Copy link
Copy Markdown
Member

@bbejeck bbejeck left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the updates @dongjinleekr, LGTM

@bbejeck
Copy link
Copy Markdown
Member

bbejeck commented Mar 25, 2019

call for second review @guozhangwang

Copy link
Copy Markdown
Contributor

@guozhangwang guozhangwang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Left two comments, otherwise LGTM!

@guozhangwang
Copy link
Copy Markdown
Contributor

Jenkins failure: https://issues.apache.org/jira/browse/KAFKA-7965

@guozhangwang
Copy link
Copy Markdown
Contributor

retest this please

@guozhangwang guozhangwang merged commit d63d702 into apache:trunk Mar 28, 2019
@guozhangwang
Copy link
Copy Markdown
Contributor

Thanks @dongjinleekr !

bbejeck pushed a commit that referenced this pull request Mar 29, 2019
This PR is a follow-up of #6174 and #6453, which cleans up KTableImpl#doTransformValues method.

Reviewers: Bill Bejeck <bbejeck@gmail.com>
jarekr pushed a commit to confluentinc/kafka that referenced this pull request Apr 18, 2019
* apache/trunk:
  KAFKA-8030: Fix flaky tests in TopicCommandWithAdminClientTest
  fix compile error for example (apache#6526)
  MINOR: Comment spelling nit
  MINOR: Optimize ConnectionStressWorker
  KAFKA-8034: Use automatic RPC generation in DeleteTopics
  MINOR: Move KTable source topic for changelog to optimization framework (apache#6500)
  KAFKA-7502: Cleanup KTable materialization logic in a single place (doMapValues) (apache#6520)
  Cleanup KTableImpl#doTransformValues (apache#6519)
  MINOR: Streams input topic corrected (apache#6513)
  MINOR: WorkerUtils#abort: fix bug in abort logic (apache#6516)
  KAFKA-7502: Cleanup KTable materialization logic in a single place (filter) (apache#6453)
  MINOR: Fix some spelling corrections in comments (apache#6507)
  KAFKA-3522: Add RocksDBTimestampedSegmentedBytesStore (apache#6186)
  MINOR: Add 2.2.0 upgrade instructions (apache#6501)
pengxiaolong pushed a commit to pengxiaolong/kafka that referenced this pull request Jun 14, 2019
…ilter) (apache#6453)

This PR is a follow-up of apache#6174, which handles doFilter / doMapValues / doTransformValues methods.

Reviewers: Bill Bejeck <bill@confluent.io>, Guozhang Wang <guozhang@confluent.io>
pengxiaolong pushed a commit to pengxiaolong/kafka that referenced this pull request Jun 14, 2019
This PR is a follow-up of apache#6174 and apache#6453, which cleans up KTableImpl#doTransformValues method.

Reviewers: Bill Bejeck <bbejeck@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants