File IO on Tokio Workers #8188
Description
Describe the bug
Both CsvExec and NdJsonExec perform file IO on the tokio worker threads, this acts to starve the worker pool, potentially leaving CPUs idle. In cases involving FIFO files, this could even lead to deadlock
To Reproduce
No response
Expected behavior
We should probably just convert the files to streams and decode them that way
Additional context
We probably want to wait for #7994 first, so that any changes don't negatively impact the streaming use-case