Apply filters to `RecordBatch` instead of indices in nested loop join

[jonathanc-n]

Is your feature request related to a problem or challenge?

I think batch coalescer won't make this faster as this is buffering everything in memory anyway.

The main idea would be to apply the filters iteratively to the incoming RecordBatch instead of the indices, so we have to change the API / implementation a bit more.

@Dandandan mentions in #16443 that we apply filters to the RecordBatch when processing incoming batches in nested loop join.

Describe the solution you'd like

No response

Describe alternatives you've considered

No response

Additional context

No response

[jonathanc-n]

@UBarney I think you would be interested in this. This is just an issue to make sure we have a more solid space for it to be recorded. Just a note that we should use push_batch_with_filter in BatchCoalescer when complete.

[2010YOUY01]

Maybe we should add a new API to BatchCoalescer first, like push_joined_batch(left_batch, right_batch, left_indices, right_indices)