[CI] Spark integration tests are failing

[asfimport]

It is failing 3 days ago, see the build history here https://github.com/ursa-labs/crossbow/branches/all?query=spark

It might be a spark regression: https://github.com/ursa-labs/crossbow/runs/864989434

cc @BryanCutler

Reporter: Krisztian Szucs / @kszucs
Assignee: Bryan Cutler / @BryanCutler

PRs and other links:

• GitHub Pull Request #7746

_{Note: This issue was originally created as ARROW-9438. Please see the migration documentation for further details.}

[asfimport]

Bryan Cutler / @BryanCutler:
The errors are coming from the recent change in Arrow Java in ARROW-9300. I have a patch ready for that as part of the Arrow 1.0.0 upgrade, I'll make a PR to do that here soon. There will still be 1 pyspark test failure due to ARROW-9223. That will take a little more effort to resolve, and require another patch.

[asfimport]

Wes McKinney / @wesm:
Issue resolved by pull request 7746
#7746