feat: add python bindings for the v2 reader/writer

[westonpace]

Prerequisites:

• feat: mvp for lance version 0.2 reader / writer #1965

[codecov-commenter]

Codecov Report

Attention: Patch coverage is 58.71560% with 45 lines in your changes are missing coverage. Please review.

Project coverage is 80.99%. Comparing base (d189ca2) to head (7d8b83a).
Report is 1 commits behind head on main.

Files	Patch %	Lines
rust/lance-file/src/v2/reader.rs	47.94%	36 Missing and 2 partials ⚠️
rust/lance-io/src/object_writer.rs	55.55%	2 Missing and 2 partials ⚠️
rust/lance-file/src/v2/writer.rs	92.30%	0 Missing and 2 partials ⚠️
rust/lance-io/src/object_store.rs	0.00%	0 Missing and 1 partial ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #2158      +/-   ##
==========================================
- Coverage   81.04%   80.99%   -0.06%     
==========================================
  Files         181      181              
  Lines       51279    51385     +106     
  Branches    51279    51385     +106     
==========================================
+ Hits        41560    41620      +60     
- Misses       7282     7344      +62     
+ Partials     2437     2421      -16     

Flag	Coverage Δ
unittests	80.99% <58.71%> (-0.06%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[eddyxu]

2024 :)

[westonpace]

#2177 😆

[eddyxu]

Is this interface mostly internal utility? The public main interface is still pyarrow.Dataset?

[westonpace]

Yes. This is mainly for benchmarking / advanced use cases.