Skip to content

Conversation

@LiaCastaneda
Copy link

@LiaCastaneda LiaCastaneda commented Sep 30, 2025

This PR Reverts the arrow V56 upgrade back to version 55.x , along with PRs that depend on arrow features from V56.

@LiaCastaneda
Copy link
Author

Again, the test is failing with no space left on device (os error 28) but the cargo test macos-aarch64 is passing

----
logical_plan TableScan: t projection=[int_col, str_col]
physical_plan DataSourceExec: file_groups={2 groups: [[WORKSPACE_ROOT/datafusion/sqllogictest/test_files/scratch/listing_table_statistics/1.parquet], [WORKSPACE_ROOT/datafusion/sqllogictest/test_files/scratch/listing_table_statistics/2.parquet]]}, projection=[int_col, str_col], file_type=parquet, statistics=[Rows=Exact(4), Bytes=Exact(212), [(Col[0]: Min=Exact(Int64(-1)) Max=Exact(Int64(3)) Null=Exact(0)),(Col[1]: Min=Exact(Utf8View("a")) Max=Exact(Utf8View("d")) Null=Exact(0))]]
physical_plan DataSourceExec: file_groups={2 groups: [[WORKSPACE_ROOT/datafusion/sqllogictest/test_files/scratch/listing_table_statistics/1.parquet], [WORKSPACE_ROOT/datafusion/sqllogictest/test_files/scratch/listing_table_statistics/2.parquet]]}, projection=[int_col, str_col], file_type=parquet, statistics=[Rows=Exact(4), Bytes=Exact(288), [(Col[0]: Min=Exact(Int64(-1)) Max=Exact(Int64(3)) Null=Exact(0)),(Col[1]: Min=Exact(Utf8View("a")) Max=Exact(Utf8View("d")) Null=Exact(0))]]
Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This was Bytes=Exact(288) before the arrow upgrade

Copy link

@gabotechs gabotechs left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍 It looks like we are losing pretty much nothing with this revert, let's go!

Comment on lines -2205 to -2214
DataType::Decimal32(_precision, _scale) => {
return _not_impl_err!(
"Decimal32 not supported in ScalarValue::iter_to_array"
);
}
DataType::Decimal64(_precision, _scale) => {
return _not_impl_err!(
"Decimal64 not supported in ScalarValue::iter_to_array"
);
}

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

not a big deal to lose this

@LiaCastaneda LiaCastaneda marked this pull request as ready for review September 30, 2025 14:15
@LiaCastaneda LiaCastaneda merged commit 5506e69 into branch-50 Sep 30, 2025
78 of 81 checks passed
LiaCastaneda added a commit that referenced this pull request Oct 2, 2025
@gabotechs gabotechs changed the title Revert arrow upgrade and related changes [branch-50] Revert arrow upgrade and related changes Oct 15, 2025
LiaCastaneda added a commit that referenced this pull request Oct 15, 2025
* Revert "Revert arrow upgrade and related changes (#50)"

This reverts commit 5506e69.

* Allow typo
@LiaCastaneda LiaCastaneda deleted the lia/revert-arrow-upgrade-and-related-changes branch January 13, 2026 18:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants