Skip to content

[Backport] WindowOperatorQueryFrameProcessor fixes (#17209) (#17211)#17231

Merged
kgyrtkirk merged 2 commits intoapache:31.0.0from
Akshat-Jain:backport-17209-and-17211-to-31.0.0
Oct 3, 2024
Merged

[Backport] WindowOperatorQueryFrameProcessor fixes (#17209) (#17211)#17231
kgyrtkirk merged 2 commits intoapache:31.0.0from
Akshat-Jain:backport-17209-and-17211-to-31.0.0

Conversation

@Akshat-Jain
Copy link
Copy Markdown
Contributor

Backport of #17209 and #17211 to 31.0.0.

… adhere to FrameProcessor's contract (apache#17209)

This PR fixes the above issue by maintaining the state of last rowId flushed to output channel, and triggering another iteration of runIncrementally() method if frame writer has rows pending flush to the output channel.

The above is done keeping in mind FrameProcessor's contract which enforces that we should write only a single frame to each output channel in any given iteration of runIncrementally().
@github-actions github-actions Bot added Area - Batch Ingestion Area - MSQ For multi stage queries - https://github.com/apache/druid/issues/12262 labels Oct 3, 2024
@abhishekagarwal87 abhishekagarwal87 added this to the 31.0.0 milestone Oct 3, 2024
@kfaraz kfaraz changed the title [Backport] WindowOperatorQueryFrameProcessor: Fix frame writer capacity issues + Avoid unnecessary re-runs of runIncrementally [Backport] WindowOperatorQueryFrameProcessor fixes (#17209) (#17211) Oct 3, 2024
@kgyrtkirk kgyrtkirk merged commit feae7f7 into apache:31.0.0 Oct 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Area - Batch Ingestion Area - MSQ For multi stage queries - https://github.com/apache/druid/issues/12262 Backport

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants