It would be interesting if the ingest-tarball.sh script would support ingesting a combined tarball of software installations for the software layer, in which a small number of installations across all (or at least multiple) CPU targets are included.
For OSU-Micro-Benchmarks (see PR #201), we had to create and ingest 10 separate small tarballs, which only adds overhead (since for each tarball, a PR to the staging repo is created, and needs to be reviewed/merged).
The bot could combine all tarballs into a single one when it's instructed to do the deploy.
The ingest script currently makes a couple of assumptions that are incorrect for such a combined tarball, including that the tarball only includes software installations for a single CPU target, and that tar tf ${tarball} | head -1 allows to determine whether it's an ingesting for software/compat/init .
It would be interesting if the
ingest-tarball.shscript would support ingesting a combined tarball of software installations for the software layer, in which a small number of installations across all (or at least multiple) CPU targets are included.For
OSU-Micro-Benchmarks(see PR #201), we had to create and ingest 10 separate small tarballs, which only adds overhead (since for each tarball, a PR to thestagingrepo is created, and needs to be reviewed/merged).The bot could combine all tarballs into a single one when it's instructed to do the deploy.
The ingest script currently makes a couple of assumptions that are incorrect for such a combined tarball, including that the tarball only includes software installations for a single CPU target, and that
tar tf ${tarball} | head -1allows to determine whether it's an ingesting forsoftware/compat/init.