When upgrading DF, even the optional Lance dependency might cause issues

[AdamGS]

When we're upgrading DF, if there's also a major arrow-rs release we'll run into dependency issues with lance until they also upgrade their arrow dependency. See the build issues in #5189.

[AdamGS]

So Lance is blocked by some dependencies, and tpchgen is blocked by parquet perf issues (potentially solved?)

[clflushopt]

Hey @AdamGS stumbled on the issue while looking around Vortex repo, the parquet perf issues were addressed in clflushopt/tpchgen-rs#200 we had to flag the issue upstream apache/arrow-rs#8783 and wait on it to be merged. I just tagged and released v2.0.2 which uses arrow v57.1.0 which I hope unblocks you.

[AdamGS]

Thanks @clflushopt! I'm going to merge those updates as part of #5189 now that #5676 merged and hopefully made these upgrades independent of each other.

[AdamGS]

This is solved by #5676, and #5189 now shows that it actually works!