Unable to cross compile for aarch64

[cyrusbehr]

I am trying to cross compile for aarch64. I am using the following build steps:

test -e v0.3.14.zip || wget https://github.com/xianyi/OpenBLAS/archive/refs/tags/v0.3.14.zip
test -e OpenBLAS-0.3.14 || unzip v0.3.14.zip

cd OpenBLAS-0.3.14
make BINARY=64 CC=aarch64-linux-gnu-gcc FC=aarch64-linux-gnu-gfortran HOSTCC=gcc NOFORTRAN=1 -j4

mkdir packaged
make DESTDIR=./packaged install

The compilation fails on the following:

aarch64-linux-gnu-gcc -c -O2 -DMAX_STACK_ALLOC=2048 -Wall -DF_INTERFACE_GFORT -fPIC -DNO_LAPACK -DNO_LAPACKE -DSMP_SERVER -DNO_WARMUP -DMAX_CPU_NUMBER=20 -DMAX_PARALLEL_NUMBER=1 -DBUILD_SINGLE=1 -DBUILD_DOUBLE=1 -DBUILD_COMPLEX=1 -DBUILD_COMPLEX16=1 -DVERSION=\"0.3.14\" -UASMNAME -UASMFNAME -UNAME -UCNAME -UCHAR_NAME -UCHAR_CNAME -DASMNAME=samax_k -DASMFNAME=samax_k_ -DNAME=samax_k_ -DCNAME=samax_k -DCHAR_NAME=\"samax_k_\" -DCHAR_CNAME=\"samax_k\" -DNO_AFFINITY -I.. -UDOUBLE  -UCOMPLEX -UCOMPLEX -UDOUBLE  -DUSE_ABS -UUSE_MIN ../kernel/arm64/amax.S -o samax_k.o
make[1]: *** No rule to make target '../kernel/arm64/amin.S', needed by 'samin_k.o'.  Stop.
make[1]: *** Waiting for unfinished jobs....
make[1]: Leaving directory '/home/cyrus/work/c-sdks/3rd_party_libs/OpenBLAS-0.3.14/kernel'
Makefile:163: recipe for target 'libs' failed
make: *** [libs] Error 1

Any thoughts?

[cyrusbehr]

Trying to use CMake with an aarch64 toolchain file fails almost immediately:

(base) 03:07 PM_~/work/c-sdks/3rd_party_libs/OpenBLAS-0.3.14/build[cuda_aarch64_cc !?]$ cmake -DCMAKE_TOOLCHAIN_FILE=../../../tools/toolchain-aarch64.cmake ..
-- The C compiler identification is GNU 7.5.0
-- The ASM compiler identification is GNU
-- Found assembler: /usr/bin/aarch64-linux-gnu-as
-- Check for working C compiler: /usr/bin/aarch64-linux-gnu-gcc
-- Check for working C compiler: /usr/bin/aarch64-linux-gnu-gcc - works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Detecting C compile features
-- Detecting C compile features - done
CMake Warning at CMakeLists.txt:70 (message):
  CMake support is experimental.  It does not yet support all build options
  and may not produce the same Makefiles that OpenBLAS ships with.


-- Looking for stdatomic.h
-- Looking for stdatomic.h - found
-- -- -- -- -- -- -- -- -- -- -- -- -- --
-- Targeting the ARMV8 architecture.
-- GEMM multithread threshold set to 4.
-- Looking for a Fortran compiler
-- Looking for a Fortran compiler - NOTFOUND
-- No Fortran compiler found, can build only BLAS but not LAPACK
-- Compiling a 64-bit binary.
-- Building Single Precision
-- Building Double Precision
-- Building Complex Precision
-- Building Double Complex Precision
-- Reading vars from /home/cyrus/work/c-sdks/3rd_party_libs/OpenBLAS-0.3.14/kernel/arm64/KERNEL...
-- Reading vars from /home/cyrus/work/c-sdks/3rd_party_libs/OpenBLAS-0.3.14/kernel/arm64/KERNEL.ARMV8...
-- Generating openblas_config.h in include/openblas
-- Generating cblas.h in include/openblas
-- Configuring done
-- Generating done
-- Build files have been written to: /home/cyrus/work/c-sdks/3rd_party_libs/OpenBLAS-0.3.14/build
(base) 03:07 PM_~/work/c-sdks/3rd_party_libs/OpenBLAS-0.3.14/build[cuda_aarch64_cc !?]$ make -j4
Scanning dependencies of target interface
Scanning dependencies of target driver_level2
Scanning dependencies of target driver_level3
Scanning dependencies of target kernel
[  0%] Building C object driver/level3/CMakeFiles/driver_level3.dir/CMakeFiles/sgemm_nn.c.o
[  0%] Building C object kernel/CMakeFiles/kernel.dir/CMakeFiles/lsame.c.o
[  0%] Building C object driver/level2/CMakeFiles/driver_level2.dir/CMakeFiles/ssbmv_U.c.o
[  0%] Building C object interface/CMakeFiles/interface.dir/CMakeFiles/scopy.c.o
[  0%] Building C object kernel/CMakeFiles/kernel.dir/CMakeFiles/scabs1.c.o
[  0%] Building C object driver/level3/CMakeFiles/driver_level3.dir/CMakeFiles/dgemm_nn.c.o
[  0%] Building C object driver/level2/CMakeFiles/driver_level2.dir/CMakeFiles/dsbmv_U.c.o
[  0%] Building C object interface/CMakeFiles/interface.dir/CMakeFiles/snrm2.c.o
[  0%] Building C object kernel/CMakeFiles/kernel.dir/CMakeFiles/dcabs1.c.o
[  0%] Building C object driver/level3/CMakeFiles/driver_level3.dir/CMakeFiles/cgemm_nn.c.o
[  0%] Building C object driver/level2/CMakeFiles/driver_level2.dir/CMakeFiles/csbmv_U.c.o
[  0%] Building C object interface/CMakeFiles/interface.dir/CMakeFiles/dcopy.c.o
[  0%] Building ASM object kernel/CMakeFiles/kernel.dir/CMakeFiles/samax_k.S.o
/usr/bin/aarch64-linux-gnu-as: invalid option -- 'H'
kernel/CMakeFiles/kernel.dir/build.make:118: recipe for target 'kernel/CMakeFiles/kernel.dir/CMakeFiles/samax_k.S.o' failed
make[2]: *** [kernel/CMakeFiles/kernel.dir/CMakeFiles/samax_k.S.o] Error 1
CMakeFiles/Makefile2:356: recipe for target 'kernel/CMakeFiles/kernel.dir/all' failed
make[1]: *** [kernel/CMakeFiles/kernel.dir/all] Error 2
make[1]: *** Waiting for unfinished jobs....

[martin-frbg]

Your first build attempt with make seems to be missing the TARGET option (e.g. ARMV8).
No idea yet why it fails with cmake (or what the "invalid option" starting with an "H" was)

[cyrusbehr]

Ok, I hadn't realized I had to specify the target CPU, I thought I could get away with compiling for a generic aarch64 device.