feat: Enable native_datafusion scans in auto scan mode [WIP]

[andygrove]

Which issue does this PR close?

Closes #3040

Follows on from the refactor in #2978

Rationale for this change

native_datafusion is faster than native_iceberg_compat, so we should use it when we can.

What changes are included in this PR?

How are these changes tested?

[codecov-commenter]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 59.20%. Comparing base (f09f8af) to head (0ac55aa).
⚠️ Report is 832 commits behind head on main.

Additional details and impacted files

@@             Coverage Diff              @@
##               main    #2969      +/-   ##
============================================
+ Coverage     56.12%   59.20%   +3.07%     
- Complexity      976     1355     +379     
============================================
  Files           119      167      +48     
  Lines         11743    15525    +3782     
  Branches       2251     2576     +325     
============================================
+ Hits           6591     9191    +2600     
- Misses         4012     5055    +1043     
- Partials       1140     1279     +139     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[mbutrovich]

Re: d0bab1e

native_datafusion should support bucket scans: #2888