[Nvidia][CI] Jetson toolchain files public acess

[ChaiBapchya]

Description

Currently, CI for Jetson builds uses aarch64 cross depedencies package based on Jetpack 4.3

However, it needs to be manually downloaded using SDK Manager tool and placed in a private S3 bucket because we don't have license to redistribute them.

Fix would be to make it publicly available under nvidia machine learning apt repository http://developer.download.nvidia.com/compute/machine-learning/repos/ubuntu1804/x86_64/

For reference
https://github.com/apache/incubator-mxnet/blob/master/ci/docker/Dockerfile.build.jetson#L61-L65

@leezu @ptrendx @TristonC

[ChaiBapchya]

Currently, MXNet devs won't be able to reproduce CI issue for Jetson via

ci/build.py --docker-registry mxnetci --platform jetson --docker-build-retries 0 --shm-size 500m /work/runtime_functions.sh build_jetson

As it fails for

Step 11/17 : RUN aws s3 cp s3://mxnet-ci-prod-private-slave-data/nvidia/sdkm_downloads/cuda-repo-ubuntu1804-10-0-local-10.0.326-410.108_1.0-1_amd64.deb . &&     dpkg -i cuda-repo-ubuntu1804-10-0-local-10.0.326-410.108_1.0-1_amd64.deb &&     rm cuda-repo-ubuntu1804-10-0-local-10.0.326-410.108_1.0-1_amd64.deb &&     apt-key add /var/cuda-repo-10-0-local-10.0.326-410.108/7fa2af80.pub &&     aws s3 cp s3://mxnet-ci-prod-private-slave-data/nvidia/sdkm_downloads/cuda-repo-cross-aarch64-10-0-local-10.0.326_1.0-1_all.deb . &&     dpkg -i cuda-repo-cross-aarch64-10-0-local-10.0.326_1.0-1_all.deb &&     rm cuda-repo-cross-aarch64-10-0-local-10.0.326_1.0-1_all.deb &&     apt-get update &&     apt-get install -y -f &&     apt-get install -y cuda-cross-aarch64 cuda-cross-aarch64-10-0 &&     rm -rf /var/lib/apt/lists/*
 ---> Running in 0ee2a3406e2c
fatal error: Unable to locate credentials

This needs access to the private mxnet CI prod account bucket which isn't feasible.

[leezu]

Thanks @ChaiBapchya for opening the tracking issue! Previously I was given an early-June 2020 ETA for public availability of the files. I just followed up with the owner. Ideally the files are available already / will be soon and we just need to update the Dockerfile.

[leezu]

Nvidia helped to make the files available publicly:

https://repo.download.nvidia.com/jetson/x86_64/pool/r32.4/c/cuda/cuda-cross-aarch64-10-2_10.2.89-1_all.deb
https://repo.download.nvidia.com/jetson/x86_64/pool/r32.4/c/cuda/cuda-cross-aarch64_10.2.89-1_all.deb
https://repo.download.nvidia.com/jetson/x86_64/pool/r32.4/c/cuda/cuda-cudart-cross-aarch64-10-2_10.2.89-1_all.deb
https://repo.download.nvidia.com/jetson/x86_64/pool/r32.4/c/cuda/cuda-cufft-cross-aarch64-10-2_10.2.89-1_all.deb
https://repo.download.nvidia.com/jetson/x86_64/pool/r32.4/c/cuda/cuda-cupti-cross-aarch64-10-2_10.2.89-1_all.deb
https://repo.download.nvidia.com/jetson/x86_64/pool/r32.4/c/cuda/cuda-curand-cross-aarch64-10-2_10.2.89-1_all.deb
https://repo.download.nvidia.com/jetson/x86_64/pool/r32.4/c/cuda/cuda-cusolver-cross-aarch64-10-2_10.2.89-1_all.deb
https://repo.download.nvidia.com/jetson/x86_64/pool/r32.4/c/cuda/cuda-cusparse-cross-aarch64-10-2_10.2.89-1_all.deb
https://repo.download.nvidia.com/jetson/x86_64/pool/r32.4/c/cuda/cuda-driver-cross-aarch64-10-2_10.2.89-1_all.deb
https://repo.download.nvidia.com/jetson/x86_64/pool/r32.4/c/cuda/cuda-misc-headers-cross-aarch64-10-2_10.2.89-1_all.deb
https://repo.download.nvidia.com/jetson/x86_64/pool/r32.4/c/cuda/cuda-npp-cross-aarch64-10-2_10.2.89-1_all.deb
https://repo.download.nvidia.com/jetson/x86_64/pool/r32.4/c/cuda/cuda-nsight-compute-addon-l4t-10-2_10.2.89-1_all.deb
https://repo.download.nvidia.com/jetson/x86_64/pool/r32.4/c/cuda/cuda-nvgraph-cross-aarch64-10-2_10.2.89-1_all.deb
https://repo.download.nvidia.com/jetson/x86_64/pool/r32.4/c/cuda/cuda-nvml-cross-aarch64-10-2_10.2.89-1_all.deb
https://repo.download.nvidia.com/jetson/x86_64/pool/r32.4/c/cuda/cuda-nvrtc-cross-aarch64-10-2_10.2.89-1_all.deb
https://repo.download.nvidia.com/jetson/x86_64/pool/r32.4/c/cublas/libcublas-cross-aarch64_10.2.2.89-1_all.deb
https://repo.download.nvidia.com/jetson/x86_64/pool/r32.4/n/nsight-compute/nsight-compute-addon-l4t-2019.5.0_2019.5.0.14-1_all.deb

Now the Dockerfile can be updated to make use of the public files and the private S3 bucket can be deleted.

[ChaiBapchya]

Yes working on that fix.

[leezu]

Thank you @ChaiBapchya!

[josefhernandez]

I'm getting back this error on versions master, 1.8.0 and 1.7.0
Last week everything compiled ok