Skip to content

MINOR: Permit tombstone offsets with any partition for file source connector#14233

Closed
C0urante wants to merge 1 commit intoapache:trunkfrom
C0urante:file-source-connector-tombstone-offsets
Closed

MINOR: Permit tombstone offsets with any partition for file source connector#14233
C0urante wants to merge 1 commit intoapache:trunkfrom
C0urante:file-source-connector-tombstone-offsets

Conversation

@C0urante
Copy link
Copy Markdown
Contributor

@C0urante C0urante commented Aug 17, 2023

This aligns the behavior of the file and MM2 source connectors with regards to tombstone offsets submitted via the REST API. Partition validation is intentionally disabled for tombstone offsets to allow users to clean up the offsets topic in case there's garbage in there, which may come from previous connectors with the same name but a different type, or newer versions of the connector that aren't compatible with the current version after an upgrade is reverted.

See #14005 for the PR that introduced this logic to MM2.

Committer Checklist (excluded from commit message)

  • Verify design and implementation
  • Verify test coverage and CI build status
  • Verify documentation (including upgrade notes)

@C0urante
Copy link
Copy Markdown
Contributor Author

Closing in favor of #14234

@C0urante C0urante closed this Aug 17, 2023
@C0urante C0urante deleted the file-source-connector-tombstone-offsets branch August 17, 2023 14:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant