What is the problem the feature request solves?
I came across this TODO in the code base:
|
// TODO: Remove this constraint when we upgrade to new arrow-rs including |
The associated PR (apache/arrow-rs#6225) merged and the issue (apache/arrow-rs#6226) is closed, and we should be on a new enough version of arrow-rs.
There was a Comet issue (#807) and associated PR (#811) to fall back in the problematic scenario.
Describe the potential solution
Relax the fallback constraints and modify/add tests.
Additional context
No response
What is the problem the feature request solves?
I came across this TODO in the code base:
datafusion-comet/spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala
Line 2962 in 87ef44c
The associated PR (apache/arrow-rs#6225) merged and the issue (apache/arrow-rs#6226) is closed, and we should be on a new enough version of arrow-rs.
There was a Comet issue (#807) and associated PR (#811) to fall back in the problematic scenario.
Describe the potential solution
Relax the fallback constraints and modify/add tests.
Additional context
No response