Improve remove_orphan_files performance by using "inventory listing"

[ajantha-bhat]

Feature Request / Improvement

Compared to listFiles API, inventory listing can be cost efficient for remove_orphan_files performance.
So, we can enhance the procedure/action to accept the inventory information.

Reference: https://delta.io/blog/efficient-delta-vacuum/

Query engine

Spark

[anuragmantri]

Hi @ajantha-bhat - Don't we already support this after #4503?

[anuragmantri]

@flyrain did some analysis on this internally. He may have some ideas here.

[github-actions]

This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.

[github-actions]

This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale'