Skip to content

KAFKA-14834: [4/N] Drop out-of-order records from table-table join with versioned tables#13510

Merged
mjsax merged 4 commits intoapache:trunkfrom
vcrfxia:kip-914-table-table-join
Apr 13, 2023
Merged

KAFKA-14834: [4/N] Drop out-of-order records from table-table join with versioned tables#13510
mjsax merged 4 commits intoapache:trunkfrom
vcrfxia:kip-914-table-table-join

Conversation

@vcrfxia
Copy link
Copy Markdown
Contributor

@vcrfxia vcrfxia commented Apr 5, 2023

This PR updates primary-key table-table join processors to ignore out-of-order records from versioned tables, as specified in KIP-914. Foreign-key table-table joins will be updated in a subsequent PR.

Committer Checklist (excluded from commit message)

  • Verify design and implementation
  • Verify test coverage and CI build status
  • Verify documentation (including upgrade notes)

@vcrfxia vcrfxia force-pushed the kip-914-table-table-join branch from 18e478f to 1e78965 Compare April 6, 2023 17:08
Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just checking: adding state stores to an existing processor topology is a backwards-compatible change, right? I can't think of why it wouldn't be, but if it's not then that would mean compatibility concerns for this PR.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes. We only give access to an existing store (within the same sub-topology). No compatibility concern.

@vcrfxia vcrfxia force-pushed the kip-914-table-table-join branch from 30df37e to 80163bc Compare April 12, 2023 04:03
@mjsax mjsax added streams kip Requires or implements a KIP labels Apr 12, 2023
@mjsax mjsax merged commit 1395ad6 into apache:trunk Apr 13, 2023
@vcrfxia vcrfxia deleted the kip-914-table-table-join branch April 13, 2023 00:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

kip Requires or implements a KIP streams

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants