Skip to content

MINOR: Move KTable source topic for changelog to optimization framework#6500

Merged
bbejeck merged 3 commits intoapache:trunkfrom
bbejeck:MINOR_move_ktable_materialization_to_internal_streams_builder
Mar 29, 2019
Merged

MINOR: Move KTable source topic for changelog to optimization framework#6500
bbejeck merged 3 commits intoapache:trunkfrom
bbejeck:MINOR_move_ktable_materialization_to_internal_streams_builder

Conversation

@bbejeck
Copy link
Copy Markdown
Member

@bbejeck bbejeck commented Mar 25, 2019

Since we've added Kafka Streams optimizations in 2.1 we need to move the optimization for source KTable nodes (use source topic as changelog) to the optimization framework.

Updated streams tests.

Committer Checklist (excluded from commit message)

  • Verify design and implementation
  • Verify test coverage and CI build status
  • Verify documentation (including upgrade notes)

@bbejeck
Copy link
Copy Markdown
Member Author

bbejeck commented Mar 25, 2019

ping @guozhangwang @mjsax @vvcephei @ableegoldman for reviews.

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is the optimization and we only apply it for materialized KTable objects.

Copy link
Copy Markdown
Contributor

@guozhangwang guozhangwang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

One nit, otherwise LGTM.

Feel free to merge afterwards.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: we can move this line up outside the if condition and remove else?

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ack

@bbejeck bbejeck force-pushed the MINOR_move_ktable_materialization_to_internal_streams_builder branch from 9847c1a to 0fd9b6a Compare March 29, 2019 17:59
@bbejeck
Copy link
Copy Markdown
Member Author

bbejeck commented Mar 29, 2019

Addressed comments and rebased with trunk, waiting for Jenkins to complete for merging

@bbejeck bbejeck merged commit 369d89f into apache:trunk Mar 29, 2019
@bbejeck bbejeck deleted the MINOR_move_ktable_materialization_to_internal_streams_builder branch March 29, 2019 21:17
@bbejeck
Copy link
Copy Markdown
Member Author

bbejeck commented Mar 29, 2019

Merged #6500 into trunk.

jarekr pushed a commit to confluentinc/kafka that referenced this pull request Apr 18, 2019
* apache/trunk:
  KAFKA-8030: Fix flaky tests in TopicCommandWithAdminClientTest
  fix compile error for example (apache#6526)
  MINOR: Comment spelling nit
  MINOR: Optimize ConnectionStressWorker
  KAFKA-8034: Use automatic RPC generation in DeleteTopics
  MINOR: Move KTable source topic for changelog to optimization framework (apache#6500)
  KAFKA-7502: Cleanup KTable materialization logic in a single place (doMapValues) (apache#6520)
  Cleanup KTableImpl#doTransformValues (apache#6519)
  MINOR: Streams input topic corrected (apache#6513)
  MINOR: WorkerUtils#abort: fix bug in abort logic (apache#6516)
  KAFKA-7502: Cleanup KTable materialization logic in a single place (filter) (apache#6453)
  MINOR: Fix some spelling corrections in comments (apache#6507)
  KAFKA-3522: Add RocksDBTimestampedSegmentedBytesStore (apache#6186)
  MINOR: Add 2.2.0 upgrade instructions (apache#6501)
pengxiaolong pushed a commit to pengxiaolong/kafka that referenced this pull request Jun 14, 2019
…rk (apache#6500)

Since we've added Kafka Streams optimizations in 2.1 we need to move the optimization for source KTable nodes (use source topic as changelog) to the optimization framework.

Reviewers: Guozhang Wang <wangguoz@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants