Pre-built Binary for CUDA 11.1

[szha]

Description

CUDA 11.1 is now available and mxnet should provide pre-built binary for it.

[Neutron3529]

CUDA 11.2 is now available and mxnet should provide pre-built binary for it.
It seems that CUDA 11.2 is faster than CUDA 11.1, at least on my RTX 3090.

[chinakook]

Pytorch said they are going to skip CUDA 11.1 because of bug and realse a CUDA 11.2 version.

[chinakook]

@Neutron3529 The latest cudnn cannot support CUDA 11.2, how did you do that?

[Neutron3529]

@Neutron3529 The latest cudnn cannot support CUDA 11.2, how did you do that?

I currently using Manjaro system, and find there are no difference between cuda 11.1+cudnn8.0.5.39 and cuda 11.2+cudnn8.0.5.39(maybe 11.1)

All the trainings are fine and running at full speed.

[szha]

CUDA 11.2 support in #19764, currently pending new release for cudnn, details are in the PR.