Skip to content

Conversation

@pepijnve
Copy link
Contributor

Which issue does this PR close?

Rationale for this change

Using poll_proceed instead of consume_budget allows for budget consumption rollback which lets tasks attempt more avenues to make progress.

What changes are included in this PR?

  • Switch the default coop implementation to the one based on poll_proceed

Are these changes tested?

Covered by coop test cases.

Are there any user-facing changes?

Tokio version dependency bump.

@github-actions github-actions bot added common Related to common crate physical-plan Changes to the physical-plan crate labels Jul 11, 2025
@pepijnve
Copy link
Contributor Author

Draft status since this depends on the current git version of Tokio. Can be considered for merging after the next Tokio scheduled release.

@pepijnve pepijnve force-pushed the poll_proceed branch 2 times, most recently from 70f3ff0 to 8db9848 Compare July 11, 2025 10:11
@pepijnve pepijnve marked this pull request as ready for review July 26, 2025 15:34
@pepijnve
Copy link
Contributor Author

With the release of Tokio 1.47.0 this is now a candidate for merging

Copy link
Contributor

@alamb alamb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you @pepijnve

@alamb
Copy link
Contributor

alamb commented Jul 30, 2025

I merged this PR up to resolve a conflict

@alamb alamb merged commit 3dc3aaa into apache:main Jul 30, 2025
29 checks passed
@alamb
Copy link
Contributor

alamb commented Jul 30, 2025

Thanks again @pepijnve

Standing-Man pushed a commit to Standing-Man/datafusion that referenced this pull request Aug 4, 2025
@pepijnve pepijnve deleted the poll_proceed branch November 3, 2025 16:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

common Related to common crate physical-plan Changes to the physical-plan crate

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Update cooperative scheduling code to use poll_proceed when/if it becomes available in Tokio

2 participants