task/WC-263: Archive publications to Ranch via Jenkins webhook

[jarosenb]

Overview:

Add a step to the publication pipeline to archive the publication directory to Ranch. This is done by sending a webhook to Jenkins, which launches a task to SSH into cloud.data and transfer files to Ranch via SCP.

Jenkins task: https://jenkins.portals.tacc.utexas.edu/view/DesignSafe/job/designsafe_ranch_publication_backup/ which runs the following command:

ssh -o StrictHostKeyChecking=no tg458981@cloud.data.tacc.utexas.edu \
"tar hvzcf - -C /corral/projects/NHERI/published/published-data $PROJECT_ID" \
| ssh -o StrictHostKeyChecking=no tg458981@ranch.tacc.utexas.edu \
"cat > /scoutfs/projects/DesignSafe-CI/publication_backup/${PROJECT_ID}.tar.gz"

Additionally, add a pipeline step to create a SHA512 manifest for each published collection. This manifest needs to be created before backup so that the tar archive can be validated later.

PR Status:

• Ready.
• Work in Progress.
• Hold.

Related Jira tickets:

• WC-263

Summary of Changes:

Testing Steps:

N/A (this won't work locally, will be testable in PPRD following an actual data transfer)

UI Photos:

Notes: