Skip to content

Add SchemaAdapterFactory Support for ListingTable with Schema Evolution and Mapping #16583

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
kosiew merged 21 commits into from
Jul 4, 2025
Merged

Add SchemaAdapterFactory Support for ListingTable with Schema Evolution and Mapping #16583

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
21 commits
Select commit Hold shift + click to select a range
f779360
Add schema adapter factory and related code into ListingTableConfig
kosiew Jun 27, 2025
cf35911
refactor: rename `None` to `Unset` in `SchemaSource` and add debug as…
kosiew Jun 27, 2025
fe07c22
docs: enhance documentation for ListingTableConfig with schema evolut…
kosiew Jun 27, 2025
b2dfb98
docs: clarify schema adapter layering in create_file_source_with_sche…
kosiew Jun 27, 2025
1db3b88
test: add unit test for default schema adapter factory in ListingTable
kosiew Jun 27, 2025
b1bf1c2
docs: add examples for schema evolution and configuration in ListingT…
kosiew Jun 27, 2025
86933eb
refactor: rename `None` to `Unset` in `SchemaSource` for clarity in s…
kosiew Jun 27, 2025
d28e615
fix: improve assertion for table_paths in ListingTableConfig to use i…
kosiew Jun 28, 2025
cb75d37
docs: update examples in ListingTableConfig to include ListingTableUr…
kosiew Jun 28, 2025
217f781
Merge branch 'main' into listing-config-14757
kosiew Jun 28, 2025
17da443
Merge branch 'main' into listing-config-14757
kosiew Jul 1, 2025
5c719c2
Update datafusion/core/src/datasource/listing/table.rs
kosiew Jul 3, 2025
362767c
Amend SchemaAdapterFactory documentation to be more specific
kosiew Jul 3, 2025
a300a30
move custom schema adapter example to schema_adapter.rs
kosiew Jul 3, 2025
dd77340
Revert "move custom schema adapter example to schema_adapter.rs"
kosiew Jul 3, 2025
2c022b4
docs: Remove redundant complete example for schema evolution setup in…
kosiew Jul 3, 2025
69ab53e
feat: Enhance SchemaAdapterFactory with create_with_projected_schema …
kosiew Jul 3, 2025
614d369
Merge branch 'listing-config-14757' of github.com:kosiew/datafusion i…
kosiew Jul 3, 2025
01fd2db
Merge branch 'main' into listing-config-14757
kosiew Jul 3, 2025
e23f87d
Merge branch 'main' into listing-config-14757
kosiew Jul 4, 2025
cc86578
Simplify comment for applying listing table schema adapter to source
kosiew Jul 4, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading