Add schema-aware CastColumnExpr with owned cast/format options for safe struct casting#20202

Closed

kosiew wants to merge 24 commits intoapache:mainfrom

kosiew:castcolumnexpr-20162

Commits on Feb 8, 2026

feat(physical-expr): Implement CastColumnExpr with schema-aware validation and proto support
kosiew
committed
feat(format): derive Default for OwnedCastOptions and simplify implementation
kosiew
committed
fix(cast): improve input schema creation in CastColumnExpr
kosiew
committed
fix(cast): unwrap CastColumnExpr in test cases for better error handling
kosiew
committed
feat(cast): add PhysicalCastColumnNode and PhysicalCastOptions with serialization support
kosiew
committed
fix(tests): update table schema to allow nullable fields in parquet tests
kosiew
committed
fix(schema): update column index lookup for physical schema to ensure correctness
kosiew
committed
fix(row_filter): align nullability with file schema to prevent narrowing of nullable data
kosiew
committed
fix(cast): improve error messages for incompatible field casts in CastColumnExpr tests
kosiew
committed
refactor(spill_pool): simplify writer and reader task handling in examples
kosiew
committed
fix(custom_file_casts): update logical schema to allow nullable Int32 column
kosiew
committed
Refactor cast validation into focused helper functions
kosiew
committed
refactor validate_cast_compatibility
kosiew
committed
feat: add validate_field_compatibility function and update imports
kosiew
committed
fix(cast_column): update Hash implementation to include input_schema
kosiew
committed
fix(physical_cast_column): update backward compatibility comment for DataFusion version
kosiew
committed
style: format prost.rs
kosiew
committed
Updated the test expectations to match the new error text.
kosiew
committed
revert to main's spill_pool.rs
kosiew
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add schema-aware CastColumnExpr with owned cast/format options for safe struct casting#20202

Add schema-aware CastColumnExpr with owned cast/format options for safe struct casting#20202
kosiew wants to merge 24 commits intoapache:mainfrom
kosiew:castcolumnexpr-20162

Commits on Feb 8, 2026

feat(physical-expr): Implement CastColumnExpr with schema-aware validation and proto support

feat(format): derive Default for OwnedCastOptions and simplify implementation

fix(cast): improve input schema creation in CastColumnExpr

fix(cast): unwrap CastColumnExpr in test cases for better error handling

feat(cast): add PhysicalCastColumnNode and PhysicalCastOptions with serialization support

fix(tests): update table schema to allow nullable fields in parquet tests

fix(schema): update column index lookup for physical schema to ensure correctness

fix(row_filter): align nullability with file schema to prevent narrowing of nullable data

fix(cast): improve error messages for incompatible field casts in CastColumnExpr tests

refactor(spill_pool): simplify writer and reader task handling in examples

fix(custom_file_casts): update logical schema to allow nullable Int32 column

Refactor cast validation into focused helper functions

refactor validate_cast_compatibility

feat: add validate_field_compatibility function and update imports

fix(cast_column): update Hash implementation to include input_schema

fix(physical_cast_column): update backward compatibility comment for DataFusion version

style: format prost.rs

Updated the test expectations to match the new error text.

revert to main's spill_pool.rs

Commits on Feb 23, 2026

Update documentation for OwnedCastOptions to clarify lifetime handling

Clarify documentation for OwnedCastOptions regarding lifetime handling

Refactor format and casting options handling

Update function signatures to use named lifetimes

Replaced both unwrap_or_else(FormatOptions::new) with unwrap_or_default() in from_proto.rs.