Skip to content

Conversation

@renovate
Copy link
Contributor

@renovate renovate bot commented Nov 24, 2025

Note: This PR body was truncated due to platform limits.

This PR contains the following updates:

Package Type Update Change
arrow-arith workspace.dependencies major 5657
arrow-array workspace.dependencies major 5657
arrow-buffer workspace.dependencies major 5657
arrow-cast workspace.dependencies major 5657
arrow-data workspace.dependencies major 5657
arrow-ipc workspace.dependencies major 5657
arrow-ord workspace.dependencies major 5657
arrow-schema workspace.dependencies major 5657
arrow-select workspace.dependencies major 5657
arrow-string workspace.dependencies major 5657
parquet workspace.dependencies major 5657

Release Notes

apache/arrow-rs (arrow-arith)

v57.1.0

Compare Source

Full Changelog

Implemented enhancements:

  • Eliminate bound checks in filter kernels #​8865 [arrow]
  • Respect page index policy option for ParquetObjectReader when it's not skip #​8856 [parquet]
  • Speed up collect_bool and remove unsafe #​8848 [arrow]
  • Error reading parquet FileMetaData with empty lists encoded as element-type=0 #​8826 [parquet]
  • ValueStatistics methods can't be used from generic context in external crate #​8823 [parquet]
  • Custom Pretty-Printing Implementation for Column when Formatting Record Batches #​8821 [arrow]
  • Parquet-concat: supports bloom filter and page index #​8804 [parquet]
  • [Parquet] virtual row number support #​7299
  • [Variant] Enforce shredded-type validation in shred_variant #​8795 [arrow]
  • Simplify decision logic to call FilterBuilder::optimize or not #​8781 [arrow]
  • [Variant] Add variant to arrow for DataType::{Binary, LargeBinary, BinaryView} #​8767 [arrow]
  • Provide algorithm that allows zipping arrays whose values are not prealigned #​8752 [arrow]
  • [Parquet] ParquetMetadataReader decodes too much metadata under point-get scenerio #​8751 [parquet]
  • arrow-json supports encoding binary arrays, but not decoding #​8736 [arrow]
  • Allow FilterPredicate instances to be reused for RecordBatches #​8692 [arrow]
  • ArrowJsonBatch::from_batch is incomplete #​8684 [arrow]
  • parquet-layout: More info about layout including footer size, page index, bloom filter? #​8682 [parquet]
  • Rewrite ParquetRecordBatchStream (async API) in terms of the PushDecoder #​8677 [parquet]
  • [JSON] Add encoding for binary view #​8674 [arrow]
  • Refactor arrow-cast decimal casting to unify the rescale logic used in Parquet variant casts #​8670 [arrow]
  • [Variant] Support Uuid/FixedSizeBinary(16) shredding #​8665
  • [Parquet]There should be an encoding counter to know how many encodings the repo supports in total #​8662 [parquet]
  • Improve parse_data_type for List, ListView, LargeList, LargeListView, FixedSizeList, Union, Map, RunEndCoded. #​8648 [arrow]
  • [Variant] Support variant to arrow primitive support null/time/decimal_* #​8637
  • Return error from RleDecoder::reset rather than panic #​8632 [parquet]
  • Add bitwise ops on BooleanBufferBuilder and MutableBuffer that mutate directly the buffer #​8618 [arrow]
  • [Variant] Add variant_to_arrow Utf-8, LargeUtf8, Utf8View types support #​8567 [arrow]

Fixed bugs:

  • Regression: Parsing List(Int64) results in nullable list in 57.0.0 and a non-nullable list in 57.1.0 #​8883
  • Regression: FixedSlizeList data type parsing fails on 57.1.0 #​8880
  • (dyn ArrayFormatterFactory + 'static) can't be safely shared between threads #​8875
  • RowNumber reader has wrong row group ordering #​8864 [parquet]
  • ThriftMetadataWriter::write_column_indexes cannot handle a ColumnIndexMetaData::NONE #​8815 [parquet]
  • "Archery test With other arrows" Integration test failing on main: #​8813 [arrow]
  • [Parquet] Writing in 57.0.0 seems 10% slower than 56.0.0 #​8783 [parquet]
  • Parquet reader cannot handle files with unknown logical types #​8776 [parquet]
  • zip now treats nulls as false in provided mask regardless of the underlying bit value #​8721 [arrow]
  • [avro] Incorrect version in crate.io landing page #​8691 [arrow]
  • Array: ViewType gc() has bug when array sum length exceed i32::MAX #​8681 [arrow]
  • Parquet 56: encounter error: item_reader def levels are None when reading nested field with row filter #​8657 [parquet]
  • Degnerate and non-nullable FixedSizeListArrays are not handled #​8623 [arrow]
  • [Parquet]Performance Degradation with RowFilter on Unsorted Columns due to Fragmented ReadPlan #​8565 [parquet]

Documentation updates:

Performance improvements:

Closed issues:

  • Variant to NullType conversion ignores strict casting #​8810
  • Unify display representation for Field #​8784
  • Misleading configuration name: skip_arrow_metadata #​8780
  • Inconsistent display for types with Metadata #​8761 [arrow]
  • Internal arrow-integration-test crate is linked from arrow docs #​8739 [arrow]
  • Add benchmark for RunEndEncoded casting #​8709 [arrow]
  • [Varaint] Support VariantArray::value to return a Result<Variant> #​8672

Merged pull requests:

* This Changelog was automatically generated by github_changelog_generator

v57.0.0

Compare Source

Full Changelog

Implemented enhancements:

  • Eliminate bound checks in filter kernels #​8865 [arrow]
  • Respect page index policy option for ParquetObjectReader when it's not skip #​8856 [parquet]
  • Speed up collect_bool and remove unsafe #​8848 [arrow]
  • Error reading parquet FileMetaData with empty lists encoded as element-type=0 #​8826 [parquet]
  • ValueStatistics methods can't be used from generic context in external crate #​8823 [parquet]
  • Custom Pretty-Printing Implementation for Column when Formatting Record Batches #​8821 [arrow]
  • Parquet-concat: supports bloom filter and page index #​8804 [parquet]
  • [Parquet] virtual row number support #​7299
  • [Variant] Enforce shredded-type validation in shred_variant #​8795 [arrow]
  • Simplify decision logic to call FilterBuilder::optimize or not #​8781 [arrow]
  • [Variant] Add variant to arrow for DataType::{Binary, LargeBinary, BinaryView} #​8767 [arrow]
  • Provide algorithm that allows zipping arrays whose values are not prealigned #​8752 [arrow]
  • [Parquet] ParquetMetadataReader decodes too much metadata under point-get scenerio #​8751 [parquet]
  • arrow-json supports encoding binary arrays, but not decoding #​8736 [arrow]
  • Allow FilterPredicate instances to be reused for RecordBatches #​8692 [arrow]
  • ArrowJsonBatch::from_batch is incomplete #​8684 [arrow]
  • parquet-layout: More info about layout including footer size, page index, bloom filter? #​8682 [parquet]
  • Rewrite ParquetRecordBatchStream (async API) in terms of the PushDecoder #​8677 [parquet]
  • [JSON] Add encoding for binary view #​8674 [arrow]
  • Refactor arrow-cast decimal casting to unify the rescale logic used in Parquet variant casts #​8670 [arrow]
  • [Variant] Support Uuid/FixedSizeBinary(16) shredding #​8665
  • [Parquet]There should be an encoding counter to know how many encodings the repo supports in total #​8662 [parquet]
  • Improve parse_data_type for List, ListView, LargeList, LargeListView, FixedSizeList, Union, Map, RunEndCoded. #​8648 [arrow]
  • [Variant] Support variant to arrow primitive support null/time/decimal_* #​8637
  • Return error from RleDecoder::reset rather than panic #​8632 [parquet]
  • Add bitwise ops on BooleanBufferBuilder and MutableBuffer that mutate directly the buffer #​8618 [arrow]
  • [Variant] Add variant_to_arrow Utf-8, LargeUtf8, Utf8View types support #​8567 [arrow]

Fixed bugs:

  • Regression: Parsing List(Int64) results in nullable list in 57.0.0 and a non-nullable list in 57.1.0 #​8883
  • Regression: FixedSlizeList data type parsing fails on 57.1.0 #​8880
  • (dyn ArrayFormatterFactory + 'static) can't be safely shared between threads #​8875
  • RowNumber reader has wrong row group ordering #​8864 [parquet]
  • ThriftMetadataWriter::write_column_indexes cannot handle a ColumnIndexMetaData::NONE #​8815 [parquet]
  • "Archery test With other arrows" Integration test failing on main: #​8813 [arrow]
  • [Parquet] Writing in 57.0.0 seems 10% slower than 56.0.0 #​8783 [parquet]
  • Parquet reader cannot handle files with unknown logical types #​8776 [parquet]
  • zip now treats nulls as false in provided mask regardless of the underlying bit value #​8721 [arrow]
  • [avro] Incorrect version in crate.io landing page #​8691 [arrow]
  • Array: ViewType gc() has bug when array sum length exceed i32::MAX #​8681 [arrow]
  • Parquet 56: encounter error: item_reader def levels are None when reading nested field with row filter #​8657 [parquet]
  • Degnerate and non-nullable FixedSizeListArrays are not handled #​8623 [arrow]
  • [Parquet]Performance Degradation with RowFilter on Unsorted Columns due to Fragmented ReadPlan #​8565 [parquet]

Documentation updates:

Performance improvements:

Closed issues:

  • Variant to NullType conversion ignores strict casting #​8810
  • Unify display representation for Field #​8784
  • Misleading configuration name: skip_arrow_metadata #​8780
  • Inconsistent display for types with Metadata #​8761 [arrow]
  • Internal arrow-integration-test crate is linked from arrow docs #​8739 [arrow]
  • Add benchmark for RunEndEncoded casting #​8709 [arrow]
  • [Varaint] Support VariantArray::value to return a Result<Variant> #​8672

Merged pull requests:


Configuration

📅 Schedule: Branch creation - Between 12:00 AM and 03:59 AM, only on Monday ( * 0-3 * * 1 ) (UTC), Automerge - At any time (no schedule defined).

🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about these updates again.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate
Copy link
Contributor Author

renovate bot commented Nov 24, 2025

⚠️ Artifact update problem

Renovate failed to update an artifact related to this branch. You probably do not want to merge this PR as-is.

♻ Renovate will retry this branch, including artifacts, only when one of the following happens:

  • any of the package files in this branch needs updating, or
  • the branch becomes conflicted, or
  • you click the rebase/retry checkbox if found above, or
  • you rename this PR's title to start with "rebase!" to trigger it manually

The artifact failure details are included below:

File name: Cargo.lock
Command failed: cargo update --config net.git-fetch-with-cli=true --manifest-path Cargo.toml --package arrow-arith@56.2.0 --precise 57.1.0
    Updating crates.io index
error: failed to select a version for the requirement `arrow-arith = "^56.1"`
candidate versions found which didn't match: 57.1.0
location searched: crates.io index
required by package `lance v0.39.0`
    ... which satisfies dependency `lance = "^0.39.0"` of package `lance-bench v0.1.0 (/tmp/renovate/repos/github/vortex-data/vortex/benchmarks/lance-bench)`
    ... which satisfies path dependency `lance-bench` (locked to 0.1.0) of package `compress-bench v0.1.0 (/tmp/renovate/repos/github/vortex-data/vortex/benchmarks/compress-bench)`

@renovate renovate bot added the chore Release label indicating a trivial change label Nov 24, 2025
@codspeed-hq
Copy link

codspeed-hq bot commented Nov 24, 2025

CodSpeed Performance Report

Merging #5482 will degrade performance by 47.32%

Comparing renovate/major-57-arrow-rs (3cbbe37) with develop (da5d463)

Summary

❌ 73 regressions
✅ 1181 untouched
⏩ 623 skipped1

⚠️ Please fix the performance issues or acknowledge them on CodSpeed.

Benchmarks breakdown

Benchmark BASE HEAD Efficiency
bench_compare_varbinview[(100000, 4)] 571.8 µs 847 µs -32.49%
bench_compare_varbinview[(100000, 8)] 571.8 µs 847.5 µs -32.53%
bench_compare_varbinview[(100000, 512)] 649.8 µs 923.8 µs -29.66%
compare_int 79.3 ms 141.3 ms -43.88%
bench_compare_primitive[(10000, 128)] 141.8 µs 166.3 µs -14.75%
bench_compare_primitive[(10000, 2)] 139.8 µs 164.7 µs -15.08%
bench_compare_primitive[(10000, 8)] 139.9 µs 164.7 µs -15.08%
bench_compare_primitive[(10000, 4)] 140.4 µs 163.9 µs -14.31%
bench_compare_primitive[(10000, 32)] 140.2 µs 165.1 µs -15.09%
bench_compare_primitive[(10000, 2048)] 171.7 µs 201.3 µs -14.72%
bench_compare_primitive[(100000, 2)] 564.6 µs 839.5 µs -32.74%
bench_compare_primitive[(100000, 128)] 566.8 µs 842.8 µs -32.75%
bench_compare_primitive[(10000, 512)] 152.1 µs 178 µs -14.51%
bench_compare_primitive[(100000, 32)] 566.1 µs 841.1 µs -32.69%
bench_compare_primitive[(100000, 4)] 566.3 µs 840 µs -32.58%
bench_compare_primitive[(100000, 512)] 620.1 µs 895.4 µs -30.75%
bench_compare_primitive[(100000, 2048)] 639.8 µs 920 µs -30.46%
bench_compare_primitive[(100000, 8)] 565.1 µs 839.9 µs -32.72%
bench_compare_sliced_dict_primitive[(20000, 10000)] 312.2 µs 386.2 µs -19.16%
bench_compare_sliced_dict_primitive[(10000, 10000)] 229.3 µs 269.4 µs -14.87%
... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.

Footnotes

  1. 623 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

@renovate renovate bot changed the title chore(deps): update arrow-rs to v57 (major) Update arrow-rs to v57 (major) Nov 24, 2025
@renovate renovate bot force-pushed the renovate/major-57-arrow-rs branch 2 times, most recently from f3fe6c4 to ab3e18f Compare November 24, 2025 23:09
@renovate renovate bot changed the title Update arrow-rs to v57 (major) chore(deps): update arrow-rs to v57 (major) Nov 26, 2025
@renovate renovate bot changed the title chore(deps): update arrow-rs to v57 (major) Update arrow-rs to v57 (major) Nov 27, 2025
@renovate renovate bot changed the title Update arrow-rs to v57 (major) chore(deps): update arrow-rs to v57 (major) Nov 27, 2025
@renovate renovate bot changed the title chore(deps): update arrow-rs to v57 (major) Update arrow-rs to v57 (major) Dec 9, 2025
@renovate renovate bot force-pushed the renovate/major-57-arrow-rs branch from ab3e18f to 22aaa8b Compare December 10, 2025 11:08
@renovate renovate bot changed the title Update arrow-rs to v57 (major) chore(deps): update arrow-rs to v57 (major) Dec 16, 2025
@renovate renovate bot changed the title chore(deps): update arrow-rs to v57 (major) Update arrow-rs to v57 (major) Dec 16, 2025
@renovate renovate bot changed the title Update arrow-rs to v57 (major) chore(deps): update arrow-rs to v57 (major) Dec 16, 2025
@renovate renovate bot changed the title chore(deps): update arrow-rs to v57 (major) Update arrow-rs to v57 (major) Dec 16, 2025
@renovate renovate bot changed the title Update arrow-rs to v57 (major) chore(deps): update arrow-rs to v57 (major) Dec 17, 2025
@renovate renovate bot changed the title chore(deps): update arrow-rs to v57 (major) Update arrow-rs to v57 (major) Dec 18, 2025
@renovate renovate bot changed the title Update arrow-rs to v57 (major) chore(deps): update arrow-rs to v57 (major) Dec 18, 2025
@renovate renovate bot changed the title chore(deps): update arrow-rs to v57 (major) Update arrow-rs to v57 (major) Dec 19, 2025
@renovate renovate bot force-pushed the renovate/major-57-arrow-rs branch from 22aaa8b to 3cbbe37 Compare December 31, 2025 17:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

chore Release label indicating a trivial change

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant