Add GCC 9.3.0 for arch generic to pilot.nessi by trz42 · Pull Request #12 · trz42/software-layer

trz42 · 2022-08-17T12:14:20Z

No description provided.

EESSI_PILOT_VERSION is not available before a script is sourced.

Otherwise there seems to be no other way currently to tell the EESSI install script to build for the generic architecture.

This reverts commit 8415e2e. Reverting because it didn't work.

`install_software_layer.sh` now passes command line arguments to `EESSI-pilot-install-software.sh` (attempt to build stack by bot for architecture `generic`).

Added a 4th parameter. If it is set to "--generic", the variable EESSI_SOFTWARE_SUBDIR_OVERRIDE will be set to EESSI_OS_TYPE/EESSI_CPU_FAMILY/generic.

Otherwise it would not be visible to the .py script determining the target.

Removed unneccessary code (echos etc)

eessi-bot-devel-trz42 · 2022-08-26T03:28:26Z

Job 4478033 on Fram-TR for x86_64-intel-broadwell in job dir /cluster/projects/nn9992k/pilot.nessi/jobs/2022.08/pr_12/4478033

date	job status	comment
Aug 26 03:28:25 UTC 2022	submitted	job waits for release by job manager
Aug 26 03:29:05 UTC 2022	released	job awaits launch by Slurm scheduler
Aug 26 05:12:14 UTC 2022	finished	😁 SUCCESS tarball `eessi-2021.12-software-linux-x86_64-intel-broadwell-1661490582.tar.gz` (0.697 GiB) in job dir

eessi-bot-devel-trz42 · 2022-08-26T03:28:32Z

Job 6504695 on Saga-TR for x86_64-skylake_avx512 in job dir /cluster/projects/nn9992k/pilot.nessi/jobs/2022.08/pr_12/6504695

date	job status	comment
Aug 26 03:28:31 UTC 2022	submitted	job waits for release by job manager
Aug 26 03:29:15 UTC 2022	released	job awaits launch by Slurm scheduler
Aug 26 04:46:24 UTC 2022	finished	😁 SUCCESS tarball `eessi-2021.12-software-linux-x86_64-intel-skylake_avx512-1661489011.tar.gz` (0.697 GiB) in job dir

eessi-bot-devel-trz42 · 2022-08-26T03:28:35Z

Job 2267 on CitC-TR for x86_64-intel-haswell in job dir /mnt/shared/home/trz42/jobs/2022.08/pr_12/2267

date	job status	comment
Aug 26 03:28:34 UTC 2022	submitted	job waits for release by job manager
Aug 26 03:28:43 UTC 2022	released	job awaits launch by Slurm scheduler
Aug 26 05:29:03 UTC 2022	finished	😁 SUCCESS tarball `eessi-2021.12-software-linux-x86_64-intel-haswell-1661491612.tar.gz` (0.697 GiB) in job dir

eessi-bot-devel-trz42 · 2022-08-26T12:22:49Z

Job 6519153 on Saga-TR for x86_64-generic in job dir /cluster/projects/nn9992k/pilot.nessi/jobs/2022.08/pr_12/6519153

date	job status	comment
Aug 26 12:22:48 UTC 2022	submitted	job waits for release by job manager
Aug 26 12:23:13 UTC 2022	released	job awaits launch by Slurm scheduler
Aug 26 13:43:23 UTC 2022	finished	😢 FAILURE Found slurm output `slurm-6519153.out` in job dir Slurm output lacks message about created tarball. No tarball matching `eessi-software-.tar.gz` found in job dir.

eessi-bot-devel-trz42 · 2022-08-26T16:21:10Z

Job 6519883 on Saga-TR for x86_64-generic in job dir /cluster/projects/nn9992k/pilot.nessi/jobs/2022.08/pr_12/6519883

date	job status	comment
Aug 26 16:21:09 UTC 2022	submitted	job waits for release by job manager
Aug 26 16:21:41 UTC 2022	released	job awaits launch by Slurm scheduler
Aug 26 17:44:52 UTC 2022	finished	😢 FAILURE Found slurm output `slurm-6519883.out` in job dir Slurm output lacks message about created tarball. No tarball matching `eessi-software-.tar.gz` found in job dir.

eessi-bot-devel-trz42 · 2022-08-27T04:09:13Z

Job 6519991 on Saga-TR for x86_64-generic in job dir /cluster/projects/nn9992k/pilot.nessi/jobs/2022.08/pr_12/6519991

date	job status	comment
Aug 27 04:09:12 UTC 2022	submitted	job waits for release by job manager
Aug 27 04:14:01 UTC 2022	released	job awaits launch by Slurm scheduler
Aug 27 05:27:12 UTC 2022	finished	😢 FAILURE Found slurm output `slurm-6519991.out` in job dir Slurm output lacks message about created tarball. No tarball matching `eessi-software-.tar.gz` found in job dir.

eessi-bot-devel-trz42 · 2022-08-27T05:32:30Z

Job 6519999 on Saga-TR for x86_64-generic in job dir /cluster/projects/nn9992k/pilot.nessi/jobs/2022.08/pr_12/6519999

date	job status	comment
Aug 27 05:32:29 UTC 2022	submitted	job waits for release by job manager
Aug 27 05:33:14 UTC 2022	released	job awaits launch by Slurm scheduler
Aug 27 06:47:23 UTC 2022	finished	😁 SUCCESS tarball `eessi-2021.12-software-linux-x86_64-generic-1661582708.tar.gz` (0.698 GiB) in job dir

…umdo/software-layer into add-GCC-9.3.0-generic-nessi

eessi-bot-devel-trz42 · 2022-09-01T11:28:32Z

Job 243375 on eX3-TR for x86_64-generic in job dir /home/thomarob/jobs/2022.09/pr_12/243375

date	job status	comment
Sep 01 11:28:26 UTC 2022	submitted	job waits for release by job manager
Sep 01 11:29:27 UTC 2022	released	job awaits launch by Slurm scheduler
Sep 01 11:30:28 UTC 2022	finished	😁 SUCCESS tarball `eessi-2021.12-software-linux-x86_64-generic-1662031787.tar.gz` (0.000 GiB) in job dir

eessi-bot-devel-trz42 · 2022-09-01T11:28:33Z

Job 243376 on eX3-TR for x86_64-amd-zen3 in job dir /home/thomarob/jobs/2022.09/pr_12/243376

date	job status	comment
Sep 01 11:28:27 UTC 2022	submitted	job waits for release by job manager
Sep 01 11:29:25 UTC 2022	released	job awaits launch by Slurm scheduler
Sep 01 12:17:33 UTC 2022	finished	😁 SUCCESS tarball `eessi-2021.12-software-linux-x86_64-amd-zen3-1662034544.tar.gz` (0.898 GiB) in job dir

eessi-bot-devel-trz42 · 2022-09-06T20:44:33Z

Job 132566 on Fox-TR for x86_64-generic in job dir /fp/projects01/ec88/pilot.nessi/jobs/2022.09/pr_12/132566

date	job status	comment
Sep 06 20:44:32 UTC 2022	submitted	job waits for release by job manager
Sep 06 20:45:07 UTC 2022	released	job awaits launch by Slurm scheduler
Sep 06 20:47:09 UTC 2022	finished	😁 SUCCESS tarball `eessi-2021.12-software-linux-x86_64-generic-1662497176.tar.gz` (0.000 GiB) in job dir

eessi-bot-devel-trz42 · 2022-09-06T20:44:34Z

Job 244268 on eX3-TR for x86_64-amd-zen in job dir /home/thomarob/pilot.nessi/jobs/2022.09/pr_12/244268

date	job status	comment
Sep 06 20:44:27 UTC 2022	submitted	job waits for release by job manager
Sep 06 20:45:07 UTC 2022	released	job awaits launch by Slurm scheduler
Sep 06 22:28:19 UTC 2022	finished	😁 SUCCESS tarball `eessi-2021.12-software-linux-x86_64-amd-zen-1662503189.tar.gz` (0.697 GiB) in job dir

eessi-bot-devel-trz42 · 2022-09-06T20:44:34Z

Job 132567 on Fox-TR for x86_64-amd-zen2 in job dir /fp/projects01/ec88/pilot.nessi/jobs/2022.09/pr_12/132567

date	job status	comment
Sep 06 20:44:33 UTC 2022	submitted	job waits for release by job manager
Sep 06 20:45:06 UTC 2022	released	job awaits launch by Slurm scheduler
Sep 06 21:48:18 UTC 2022	finished	😁 SUCCESS tarball `eessi-2021.12-software-linux-x86_64-amd-zen2-1662500780.tar.gz` (0.697 GiB) in job dir

eessi-bot-devel-trz42 · 2022-09-06T20:44:35Z

Job 244269 on eX3-TR for x86_64-amd-zen3 in job dir /home/thomarob/pilot.nessi/jobs/2022.09/pr_12/244269

date	job status	comment
Sep 06 20:44:28 UTC 2022	submitted	job waits for release by job manager
Sep 06 20:45:09 UTC 2022	released	job awaits launch by Slurm scheduler
Sep 06 21:41:14 UTC 2022	finished	😁 SUCCESS tarball `eessi-2021.12-software-linux-x86_64-amd-zen3-1662500377.tar.gz` (0.697 GiB) in job dir

eessi-bot-devel-trz42 · 2022-09-06T20:44:35Z

Job 430673 on Betzy-TR for x86_64-amd-zen2 in job dir /cluster/projects/nn9992k/pilot.nessi/jobs/2022.09/pr_12/430673

date	job status	comment
Sep 06 20:44:34 UTC 2022	submitted	job waits for release by job manager
Sep 06 20:44:58 UTC 2022	released	job awaits launch by Slurm scheduler
Sep 06 21:27:04 UTC 2022	finished	😢 FAILURE Found slurm output `slurm-430673.out` in job dir Slurm output lacks message "No missing modules!".

eessi-bot-devel-trz42 · 2022-09-06T20:44:35Z

Job 4498270 on Fram-TR for x86_64-intel-broadwell in job dir /cluster/projects/nn9992k/pilot.nessi/jobs/2022.09/pr_12/4498270

date	job status	comment
Sep 06 20:44:34 UTC 2022	submitted	job waits for release by job manager
Sep 06 20:45:23 UTC 2022	released	job awaits launch by Slurm scheduler
Sep 06 20:47:25 UTC 2022	finished	😁 SUCCESS tarball `eessi-2021.12-software-linux-x86_64-intel-broadwell-1662497236.tar.gz` (0.000 GiB) in job dir

eessi-bot-devel-trz42 · 2022-09-06T20:44:43Z

Job 2278 on CitC-TR for x86_64-intel-haswell in job dir /mnt/shared/home/trz42/pilot.nessi/jobs/2022.09/pr_12/2278

date	job status	comment
Sep 06 08:44:42 PM UTC 2022	submitted	job waits for release by job manager
Sep 06 08:44:50 PM UTC 2022	released	job awaits launch by Slurm scheduler
Sep 06 08:50:53 PM UTC 2022	finished	😁 SUCCESS tarball `eessi-2021.12-software-linux-x86_64-intel-haswell-1662497437.tar.gz` (0.000 GiB) in job dir

eessi-bot-devel-trz42 · 2022-09-06T20:45:39Z

Job 6680467 on Saga-TR for x86_64-intel-skylake_avx512 in job dir /cluster/projects/nn9992k/pilot.nessi/jobs/2022.09/pr_12/6680467

date	job status	comment
Sep 06 20:45:38 UTC 2022	submitted	job waits for release by job manager
Sep 06 21:04:46 UTC 2022	finished	😁 SUCCESS tarball `eessi-2021.12-software-linux-x86_64-intel-skylake_avx512-1662497217.tar.gz` (0.000 GiB) in job dir

eessi-bot-devel-trz42 · 2022-09-06T20:45:41Z

Job 6680468 on Saga-TR for x86_64-generic in job dir /cluster/projects/nn9992k/pilot.nessi/jobs/2022.09/pr_12/6680468

date	job status	comment
Sep 06 20:45:40 UTC 2022	submitted	job waits for release by job manager
Sep 06 21:04:44 UTC 2022	released	job awaits launch by Slurm scheduler
Sep 06 21:06:48 UTC 2022	finished	😁 SUCCESS tarball `eessi-2021.12-software-linux-x86_64-generic-1662498384.tar.gz` (0.000 GiB) in job dir

trz42 · 2022-09-07T03:53:34Z

We abandon this PR and create a new one from main (which includes the merged Java PR #13)

disable test that will always fail when replace Rust/1.52.1 with Rust/1.60.0

poksumdo added 30 commits June 30, 2022 13:48

Branch to build stack for nessi.uiocloud.no

8e78694

Changed connection mode

a97af5b

DIRECT is the correct value

11563e2

Updated easystack file

272f896

Disabled easystack file check

90c61c1

Added a bit more debug output

2e9874a

Moved determination of software subdir into create_tarball.sh

e66f8d1

Removed one parameter from create_tarball.sh

fb74340

EESSI_PILOT_VERSION is not available before a script is sourced.

Removed additional 'then'

443ec75

Added setting of pilot_version

88c6eb7

Convert '/' to '_' in tgz filename

d8db57a

Separate between software subdir use (dir or tgz)

daaaf66

Add GCC 9.3.0 to repo

1c1efec

artificial change to trigger event

61ab4ff

fake change to trigger new pull_request create event

93828b8

added missing exclamation mark in success message

f37ba72

Addding CaDiCaL 1.3.0 to pilot.nessi

7daf78b

PR for building Java 11.0.2 for generic arch

fe15d07

Added customized startprefix for retaining EASYBUILD_OPTARCH

8415e2e

Otherwise there seems to be no other way currently to tell the EESSI install script to build for the generic architecture.

Revert "Added customized startprefix for retaining EASYBUILD_OPTARCH"

0ce75aa

This reverts commit 8415e2e. Reverting because it didn't work.

Adding handling of arguments

8e3eca6

`install_software_layer.sh` now passes command line arguments to `EESSI-pilot-install-software.sh` (attempt to build stack by bot for architecture `generic`).

Making create_tarball.sh aware of --generic

fa78dae

Added a 4th parameter. If it is set to "--generic", the variable EESSI_SOFTWARE_SUBDIR_OVERRIDE will be set to EESSI_OS_TYPE/EESSI_CPU_FAMILY/generic.

Adding more debug output for software override

e528056

Export override variable

67c154b

Otherwise it would not be visible to the .py script determining the target.

Removing OS_TYPE from orverride variable

ffc6d9e

Put comparison operands in double quotes

9726a3f

Fixing bug in comparison: -le vs -lt

e858cfb

Polished code

57d6587

Removed unneccessary code (echos etc)

Removed debugging output

8f9a8c1

Build GCC for generic target

d702f17

Improved handling of command line parameters

4dd8a7a

Fixed order of scripts to set up env vars

6607c24

truib added 2 commits August 30, 2022 10:26

Do not exit when extended attr are not supported on TMP

fcbdf5e

Merge branch 'add-GCC-9.3.0-generic-nessi' of https://github.com/poks…

cb9a5b0

…umdo/software-layer into add-GCC-9.3.0-generic-nessi

poksumdo and others added 4 commits September 2, 2022 05:39

Minor typo fixed in display_help function

55c49c8

Removed --http(s)-proxy parameters

2280b28

Fix indentation

e258610

Create EB_TMPDIR explicitly

bca7841

poksumdo closed this Sep 7, 2022

poksumdo deleted the add-GCC-9.3.0-generic-nessi branch September 7, 2022 10:48

trz42 pushed a commit that referenced this pull request May 10, 2023

Merge pull request #12 from trz42/disable_gha_check_missing_script

cd977be

disable test that will always fail when replace Rust/1.52.1 with Rust/1.60.0

Conversation

trz42 commented Aug 17, 2022

Uh oh!

eessi-bot-devel-trz42 Bot commented Aug 26, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot-devel-trz42 Bot commented Aug 26, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot-devel-trz42 Bot commented Aug 26, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot-devel-trz42 Bot commented Aug 26, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot-devel-trz42 Bot commented Aug 26, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot-devel-trz42 Bot commented Aug 27, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot-devel-trz42 Bot commented Aug 27, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot-devel-trz42 Bot commented Sep 1, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot-devel-trz42 Bot commented Sep 1, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot-devel-trz42 Bot commented Sep 6, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot-devel-trz42 Bot commented Sep 6, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot-devel-trz42 Bot commented Sep 6, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot-devel-trz42 Bot commented Sep 6, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot-devel-trz42 Bot commented Sep 6, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot-devel-trz42 Bot commented Sep 6, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot-devel-trz42 Bot commented Sep 6, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot-devel-trz42 Bot commented Sep 6, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot-devel-trz42 Bot commented Sep 6, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

trz42 commented Sep 7, 2022

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

eessi-bot-devel-trz42 Bot commented Aug 26, 2022 •

edited

Loading

eessi-bot-devel-trz42 Bot commented Aug 26, 2022 •

edited

Loading

eessi-bot-devel-trz42 Bot commented Aug 26, 2022 •

edited

Loading

eessi-bot-devel-trz42 Bot commented Aug 26, 2022 •

edited

Loading

eessi-bot-devel-trz42 Bot commented Aug 26, 2022 •

edited

Loading

eessi-bot-devel-trz42 Bot commented Aug 27, 2022 •

edited

Loading

eessi-bot-devel-trz42 Bot commented Aug 27, 2022 •

edited

Loading

eessi-bot-devel-trz42 Bot commented Sep 1, 2022 •

edited

Loading

eessi-bot-devel-trz42 Bot commented Sep 1, 2022 •

edited

Loading

eessi-bot-devel-trz42 Bot commented Sep 6, 2022 •

edited

Loading

eessi-bot-devel-trz42 Bot commented Sep 6, 2022 •

edited

Loading

eessi-bot-devel-trz42 Bot commented Sep 6, 2022 •

edited

Loading

eessi-bot-devel-trz42 Bot commented Sep 6, 2022 •

edited

Loading

eessi-bot-devel-trz42 Bot commented Sep 6, 2022 •

edited

Loading

eessi-bot-devel-trz42 Bot commented Sep 6, 2022 •

edited

Loading

eessi-bot-devel-trz42 Bot commented Sep 6, 2022 •

edited

Loading

eessi-bot-devel-trz42 Bot commented Sep 6, 2022 •

edited

Loading

eessi-bot-devel-trz42 Bot commented Sep 6, 2022 •

edited

Loading