CI builds are failing on AMD64 with "no space left on device"

**Describe the bug**
CI builds are failing on AMD64 with "no space left on device"

**To Reproduce**
Look at recent builds.

**Expected behavior**
Should not run out of space.

**Additional context**
We have seen this before: https://issues.apache.org/jira/browse/ARROW-12112
