[Rust][DataFusion] RepartitionExec Hanging #27550
Description
Found an interesting defect where the final partition of the RepartitionExec::execute thread spawner was consistently not being spawned via tokio::spawn. This meant that RepartitionStream::poll_next was sitting waiting forever for data that never arrived.
It looks like a race condition where the JoinHandle was not being awaited and something strange going on with the internals of tokio like lazy evaluation?
Reporter: Mike Seddon / @seddonm1
Assignee: Mike Seddon / @seddonm1
PRs and other links:
Note: This issue was originally created as ARROW-11687. Please see the migration documentation for further details.