[Python] Allow Dataset construction from `FileInfo` objects

[fjetter]

Describe the enhancement requested

I'm developing a new dask integration with pyarrow parquet reader (see dask/dask-expr#882) and want to rely on the pyarrow Filesystem more.

Right now, we are performing a list operation ourselves to get all touched files and I would like to pass the retrieved FileInfo objects directly to the dataset constructor. This API is already exposed in C++ but python bindings are missing.

The benefit of this is that there is API is that it cuts the need to perform additional HEAD requests to a remote storage.

This came up in #38389 (comment) and there's been related work already with #37857

Component(s)

Python