-
Notifications
You must be signed in to change notification settings - Fork 3
[branch-50] Revert arrow upgrade and related changes #50
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[branch-50] Revert arrow upgrade and related changes #50
Conversation
|
Again, the test is failing with |
| ---- | ||
| logical_plan TableScan: t projection=[int_col, str_col] | ||
| physical_plan DataSourceExec: file_groups={2 groups: [[WORKSPACE_ROOT/datafusion/sqllogictest/test_files/scratch/listing_table_statistics/1.parquet], [WORKSPACE_ROOT/datafusion/sqllogictest/test_files/scratch/listing_table_statistics/2.parquet]]}, projection=[int_col, str_col], file_type=parquet, statistics=[Rows=Exact(4), Bytes=Exact(212), [(Col[0]: Min=Exact(Int64(-1)) Max=Exact(Int64(3)) Null=Exact(0)),(Col[1]: Min=Exact(Utf8View("a")) Max=Exact(Utf8View("d")) Null=Exact(0))]] | ||
| physical_plan DataSourceExec: file_groups={2 groups: [[WORKSPACE_ROOT/datafusion/sqllogictest/test_files/scratch/listing_table_statistics/1.parquet], [WORKSPACE_ROOT/datafusion/sqllogictest/test_files/scratch/listing_table_statistics/2.parquet]]}, projection=[int_col, str_col], file_type=parquet, statistics=[Rows=Exact(4), Bytes=Exact(288), [(Col[0]: Min=Exact(Int64(-1)) Max=Exact(Int64(3)) Null=Exact(0)),(Col[1]: Min=Exact(Utf8View("a")) Max=Exact(Utf8View("d")) Null=Exact(0))]] |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This was Bytes=Exact(288) before the arrow upgrade
gabotechs
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
👍 It looks like we are losing pretty much nothing with this revert, let's go!
| DataType::Decimal32(_precision, _scale) => { | ||
| return _not_impl_err!( | ||
| "Decimal32 not supported in ScalarValue::iter_to_array" | ||
| ); | ||
| } | ||
| DataType::Decimal64(_precision, _scale) => { | ||
| return _not_impl_err!( | ||
| "Decimal64 not supported in ScalarValue::iter_to_array" | ||
| ); | ||
| } |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
not a big deal to lose this
This reverts commit 5506e69.
This PR Reverts the arrow V56 upgrade back to version 55.x , along with PRs that depend on arrow features from V56.