Skip to content

Joins can take forever to finish on historicals without ever timing out.#17099

Merged
kgyrtkirk merged 1 commit intoapache:masterfrom
abhishekagarwal87:post_join_cursor
Sep 19, 2024
Merged

Joins can take forever to finish on historicals without ever timing out.#17099
kgyrtkirk merged 1 commit intoapache:masterfrom
abhishekagarwal87:post_join_cursor

Conversation

@abhishekagarwal87
Copy link
Copy Markdown
Contributor

Screenshot 2024-09-18 at 11 13 09 AM

This screenshot is of a processing thread that keeps running, hogging the CPU well beyond the configured timeout because PostJoinCursor is not interruptible. This PR fixes the problem by always allowing interruptions when PostJoinCursor is in play.

Copy link
Copy Markdown
Member

@kgyrtkirk kgyrtkirk left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I wonder if there are any benchmarks for this - if none then I think its better to not take the risk here

@kgyrtkirk kgyrtkirk merged commit 8d1e596 into apache:master Sep 19, 2024
@abhishekagarwal87 abhishekagarwal87 added this to the 31.0.0 milestone Sep 26, 2024
kfaraz pushed a commit to kfaraz/druid that referenced this pull request Sep 30, 2024
kfaraz added a commit that referenced this pull request Sep 30, 2024
…7196)

Co-authored-by: Abhishek Agarwal <1477457+abhishekagarwal87@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants