Arrow Java reports memory leak when Comet shuffle is enabled with AQE coalesce partition

[viirya]

Describe the bug

We have disabled Comet shuffle when AQE coalesce partitions is enabled due to potential memory leak issue on Java Arrow StreamReader (#380).

This blocks us to enable Comet shuffle by default #387.

Steps to reproduce

No response

Expected behavior

No response

Additional context

No response