[Python] Pyarrow 4.0.0 dependency numpy 1.19.4 throws errors on Apple silicon/M1 compilation

[asfimport]

Hi team! I've been unable to install older numpy versions (including 1.19.4 as specified here for aarch64 machines) on my Apple Silicon machine because the build process throws a number of numpy compilation errors. I've been able to successfully install numpy 1.20.2 however - is it possible to bump up the numpy acceptable version number to enable Apple silicon installations?

Thanks!

Reporter: Jack Wells
Assignee: Krisztian Szucs / @kszucs

Related issues:

• [Python][Packaging] Wheel builds for Apple Silicon (is fixed by)
• [Python][Packaging] Wheel builds for Apple Silicon (is superceded by)

Original Issue Attachments:

• pyarrow_build_errors.txt

Externally tracked issue: https://github.com/apache/arrow/blob/master/python/requirements-wheel-build.txt

_{Note: This issue was originally created as ARROW-12579. Please see the migration documentation for further details.}

[asfimport]

Krisztian Szucs / @kszucs:
Since ARROW-10658 has been resolved, the dependency versions should be correct now in the requirements files.

We may update a numpy pin in setup.py: https://github.com/apache/arrow/blob/master/python/setup.py#L567
Though I'm not sure whether we should pin numpy there or not.

There is no explicit mention in numpy's changelog about which is the first version with support for M1.
The first numpy wheel for M1 is 1.21, but that doesn't mean that earlier numpy versions wouldn't compile.

I'd leave the current numpy pin in setup.py as is to prevent any conflict with conda. Any opinons @xhochy?

[asfimport]

Antoine Pitrou / @pitrou:
I agree this looks done. Also, requirements-wheel-build.txt is not for end users, it is only for us when building wheels.