New approach: python only stream API.#101

Closed

alxmrs wants to merge 5 commits intomainfrom

claude/fix-datafusion-pushdown-filters-uRAg3

Commits on Jan 15, 2026

New approach: python only stream API.
alxmrs
committed
Clever strategy: use a rust-implemented datafusion provider to read from arrow streams, which are lazy, to implement the table registration, which in the default df library, is not lazy enough.
alxmrs
committed
CC Self-review. Applied lint. Using new method in the high level API (XarrayContext). This leads to two failed tests, but this could be caused by test errors.
alxmrs
committed

Commits on Jan 16, 2026