Add possibility to ignore certain hooks on local modules by casparvl · Pull Request #530 · EESSI/software-layer

casparvl · 2024-04-03T10:59:33Z

We don't want to be prevented from loading local CUDA modules because of the EESSI hook. See #523

This PR makes sense that the CUDA hooks are only applied if the module being loaded comes from the EESSI prefix.

I.e. before this change:

# Module from local software stack:
{EESSI 2023.06} [casparl@gcn6 software-layer]$ module load CUDA/11.7.0
Lmod has detected the following error:
You requested to load CUDA  but while the module file exists, the actual software is not entirely shipped with EESSI due to licencing.
You will need to install a full copy of the CUDA SDK where EESSI can find it.
For more information on how to do this, see https://www.eessi.io/docs/gpu/.

While processing the following module(s):
    Module fullname  Module Filename
    ---------------  ---------------
    CUDA/11.7.0      /sw/arch/RHEL8/EB_production/2022/modulefiles/system/CUDA/11.7.0.lua

After this change:

{EESSI 2023.06} [casparl@gcn6 software-layer]$ module load CUDA/11.7.0
{EESSI 2023.06} [casparl@gcn6 software-layer]$

Fixes #523

…'t want to be prevented from loading local CUDA modules because of the EESSI hook. See #523

eessi-bot · 2024-04-03T10:59:36Z

Instance eessi-bot-mc-aws is configured to build:

arch x86_64/generic for repo eessi-hpc.org-2023.06-compat
arch x86_64/generic for repo eessi-hpc.org-2023.06-software
arch x86_64/generic for repo eessi.io-2023.06-compat
arch x86_64/generic for repo eessi.io-2023.06-software
arch x86_64/intel/haswell for repo eessi-hpc.org-2023.06-compat
arch x86_64/intel/haswell for repo eessi-hpc.org-2023.06-software
arch x86_64/intel/haswell for repo eessi.io-2023.06-compat
arch x86_64/intel/haswell for repo eessi.io-2023.06-software
arch x86_64/intel/skylake_avx512 for repo eessi-hpc.org-2023.06-compat
arch x86_64/intel/skylake_avx512 for repo eessi-hpc.org-2023.06-software
arch x86_64/intel/skylake_avx512 for repo eessi.io-2023.06-compat
arch x86_64/intel/skylake_avx512 for repo eessi.io-2023.06-software
arch x86_64/amd/zen2 for repo eessi-hpc.org-2023.06-compat
arch x86_64/amd/zen2 for repo eessi-hpc.org-2023.06-software
arch x86_64/amd/zen2 for repo eessi.io-2023.06-compat
arch x86_64/amd/zen2 for repo eessi.io-2023.06-software
arch x86_64/amd/zen3 for repo eessi-hpc.org-2023.06-compat
arch x86_64/amd/zen3 for repo eessi-hpc.org-2023.06-software
arch x86_64/amd/zen3 for repo eessi.io-2023.06-compat
arch x86_64/amd/zen3 for repo eessi.io-2023.06-software
arch aarch64/generic for repo eessi-hpc.org-2023.06-compat
arch aarch64/generic for repo eessi-hpc.org-2023.06-software
arch aarch64/generic for repo eessi.io-2023.06-compat
arch aarch64/generic for repo eessi.io-2023.06-software
arch aarch64/neoverse_n1 for repo eessi-hpc.org-2023.06-compat
arch aarch64/neoverse_n1 for repo eessi-hpc.org-2023.06-software
arch aarch64/neoverse_n1 for repo eessi.io-2023.06-compat
arch aarch64/neoverse_n1 for repo eessi.io-2023.06-software
arch aarch64/neoverse_v1 for repo eessi-hpc.org-2023.06-compat
arch aarch64/neoverse_v1 for repo eessi-hpc.org-2023.06-software
arch aarch64/neoverse_v1 for repo eessi.io-2023.06-compat
arch aarch64/neoverse_v1 for repo eessi.io-2023.06-software

…tensions in /home/casparl/eessi/...

…uture

casparvl · 2024-05-07T09:12:45Z

Just to confirm, I've tested again after Alan's latest changes. On a module from EESSI:

{EESSI 2023.06} [casparl@tcn1 software-layer]$ module load CUDA/12.1.1
Lmod has detected the following error:
You requested to load CUDA  but while the module file exists, the actual software is not entirely shipped with EESSI due to licencing.
You will need to install a full copy of the CUDA SDK where EESSI can find it.
For more information on how to do this, see https://www.eessi.io/docs/gpu/.

While processing the following module(s):
    Module fullname  Module Filename
    ---------------  ---------------
    CUDA/12.1.1      /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/amd/zen2/modules/all/CUDA/12.1.1.lua

On a local CUDA module:

{EESSI 2023.06} [casparl@tcn1 software-layer]$ module load CUDA/11.6.0
{EESSI 2023.06} [casparl@tcn1 software-layer]$

So still works as intended :)

I think this is ready to be merged, but... since it's my own PR it's not really up to me :D @ocaisa did you want @trz42 do a final check? They already merged it in NorESSI. @trz42 it should be easy to test: just initialize the EESSI environment, load the CUDA module from EESSI (you should get the warning). Then, load any CUDA module from a local module environment, and that should not give you the warning.

trz42 · 2024-05-07T09:34:36Z

This has been already deployed to NESSI. A test (not yet taking locations as definable in #371 into account) succeeded (see below). Therefore, we can trigger the builds and deploy updated SitePackage.lua files.

[login-2.BETZY ~]$ source /cvmfs/pilot.nessi.no/versions/2023.06/init/bash
Found NESSI repo @ /cvmfs/pilot.nessi.no/versions/2023.06!
archdetect says x86_64/amd/zen2
Using x86_64/amd/zen2 as software subdirectory.
Found Lmod configuration file at /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/amd/zen2/.lmod/lmodrc.lua
Found Lmod SitePackage.lua file at /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/amd/zen2/.lmod/SitePackage.lua
Using /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/amd/zen2/modules/all as the directory to be added to MODULEPATH.
Initializing Lmod...
Prepending /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/amd/zen2/modules/all to $MODULEPATH...
Environment set up to use NESSI (2023.06), have fun!
{NESSI 2023.06} [login-2.BETZY ~]$ ml av CUDA/

----------------------- /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/amd/zen2/modules/all -----------------------
   CUDA/12.1.1 (D)

--------------------------------------------------- /cluster/modulefiles/all ----------------------------------------------------
   CUDA/11.1.1-GCC-10.2.0             CUDA/11.4.1    fosscuda/2020b
   CUDA/11.1.1-iccifort-2020.4.304    CUDA/11.7.0    gcccuda/2020b
   CUDA/11.3.1                        CUDA/12.0.0    UCX-CUDA/1.10.0-GCCcore-10.3.0-CUDA-11.3.1

  Where:
   D:  Default Module

If the avail list is too long consider trying:

"module --default avail" or "ml -d av" to just list the default modules.
"module overview" or "ml ov" to display the number of modules for each name.

Use "module spider" to find all possible modules and extensions.
Use "module keyword key1 key2 ..." to search for all possible modules matching any of the "keys".


{NESSI 2023.06} [login-2.BETZY ~]$ ml CUDA/12.1.1
Lmod has detected the following error:
You requested to load CUDA  but while the module file exists, the actual software is not entirely shipped with EESSI due to
licencing. You will need to install a full copy of the CUDA SDK where EESSI can find it.
For more information on how to do this, see https://www.eessi.io/docs/gpu/.

While processing the following module(s):
    Module fullname  Module Filename
    ---------------  ---------------
    CUDA/12.1.1      /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/amd/zen2/modules/all/CUDA/12.1.1.lua

{NESSI 2023.06} [login-2.BETZY ~]$ ml CUDA/12.0.0
{NESSI 2023.06} [login-2.BETZY ~]$

trz42 · 2024-05-07T09:59:08Z

bot: build repo:eessi.io-2023.06-software arch:x86_64/generic
bot: build repo:eessi.io-2023.06-software arch:x86_64/intel/haswell
bot: build repo:eessi.io-2023.06-software arch:x86_64/intel/skylake_avx512
bot: build repo:eessi.io-2023.06-software arch:x86_64/amd/zen2
bot: build repo:eessi.io-2023.06-software arch:x86_64/amd/zen3
bot: build repo:eessi.io-2023.06-software arch:aarch64/generic
bot: build repo:eessi.io-2023.06-software arch:aarch64/neoverse_n1
bot: build repo:eessi.io-2023.06-software arch:aarch64/neoverse_v1

eessi-bot · 2024-05-07T09:59:11Z

Updates by the bot instance eessi-bot-mc-aws (click for details)

received bot command build repo:eessi.io-2023.06-software arch:x86_64/generic from trz42
- expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/generic
received bot command build repo:eessi.io-2023.06-software arch:x86_64/intel/haswell from trz42
- expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/intel/haswell
received bot command build repo:eessi.io-2023.06-software arch:x86_64/intel/skylake_avx512 from trz42
- expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/intel/skylake_avx512
received bot command build repo:eessi.io-2023.06-software arch:x86_64/amd/zen2 from trz42
- expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen2
received bot command build repo:eessi.io-2023.06-software arch:x86_64/amd/zen3 from trz42
- expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen3
received bot command build repo:eessi.io-2023.06-software arch:aarch64/generic from trz42
- expanded format: build repository:eessi.io-2023.06-software architecture:aarch64/generic
received bot command build repo:eessi.io-2023.06-software arch:aarch64/neoverse_n1 from trz42
- expanded format: build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_n1
received bot command build repo:eessi.io-2023.06-software arch:aarch64/neoverse_v1 from trz42
- expanded format: build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_v1
handling command build repository:eessi.io-2023.06-software architecture:x86_64/generic resulted in:
- submitted job 10278, for details & status see Add possibility to ignore certain hooks on local modules #530 (comment)
handling command build repository:eessi.io-2023.06-software architecture:x86_64/intel/haswell resulted in:
- submitted job 10279, for details & status see Add possibility to ignore certain hooks on local modules #530 (comment)
handling command build repository:eessi.io-2023.06-software architecture:x86_64/intel/skylake_avx512 resulted in:
- submitted job 10280, for details & status see Add possibility to ignore certain hooks on local modules #530 (comment)
handling command build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen2 resulted in:
- submitted job 10281, for details & status see Add possibility to ignore certain hooks on local modules #530 (comment)
handling command build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen3 resulted in:
- submitted job 10282, for details & status see Add possibility to ignore certain hooks on local modules #530 (comment)
handling command build repository:eessi.io-2023.06-software architecture:aarch64/generic resulted in:
- submitted job 10283, for details & status see Add possibility to ignore certain hooks on local modules #530 (comment)
handling command build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_n1 resulted in:
- submitted job 10284, for details & status see Add possibility to ignore certain hooks on local modules #530 (comment)
handling command build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_v1 resulted in:
- submitted job 10285, for details & status see Add possibility to ignore certain hooks on local modules #530 (comment)

eessi-bot · 2024-05-07T09:59:11Z

Updates by the bot instance eessi-bot-mc-azure (click for details)

received bot command build repo:eessi.io-2023.06-software arch:x86_64/generic from trz42
- expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/generic
received bot command build repo:eessi.io-2023.06-software arch:x86_64/intel/haswell from trz42
- expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/intel/haswell
received bot command build repo:eessi.io-2023.06-software arch:x86_64/intel/skylake_avx512 from trz42
- expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/intel/skylake_avx512
received bot command build repo:eessi.io-2023.06-software arch:x86_64/amd/zen2 from trz42
- expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen2
received bot command build repo:eessi.io-2023.06-software arch:x86_64/amd/zen3 from trz42
- expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen3
received bot command build repo:eessi.io-2023.06-software arch:aarch64/generic from trz42
- expanded format: build repository:eessi.io-2023.06-software architecture:aarch64/generic
received bot command build repo:eessi.io-2023.06-software arch:aarch64/neoverse_n1 from trz42
- expanded format: build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_n1
received bot command build repo:eessi.io-2023.06-software arch:aarch64/neoverse_v1 from trz42
- expanded format: build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_v1
handling command build repository:eessi.io-2023.06-software architecture:x86_64/generic resulted in:
- no jobs were submitted
handling command build repository:eessi.io-2023.06-software architecture:x86_64/intel/haswell resulted in:
- no jobs were submitted
handling command build repository:eessi.io-2023.06-software architecture:x86_64/intel/skylake_avx512 resulted in:
- no jobs were submitted
handling command build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen2 resulted in:
- no jobs were submitted
handling command build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen3 resulted in:
- no jobs were submitted
handling command build repository:eessi.io-2023.06-software architecture:aarch64/generic resulted in:
- no jobs were submitted
handling command build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_n1 resulted in:
- no jobs were submitted
handling command build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_v1 resulted in:
- no jobs were submitted

eessi-bot · 2024-05-07T09:59:15Z

New job on instance eessi-bot-mc-aws for architecture x86_64-generic for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.05/pr_530/10278

date	job status	comment
May 07 09:59:14 UTC 2024	submitted	job id `10278` awaits release by job manager
May 07 09:59:30 UTC 2024	released	job awaits launch by Slurm scheduler
May 07 10:00:45 UTC 2024	running	job `10278` is running
May 07 10:18:22 UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-10278.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-generic-1715075986.tar.gz` size: 0 MiB (3113 bytes) entries: 2 modules under 2023.06/software/linux/x86_64/generic/modules/all no module files in tarball software under 2023.06/software/linux/x86_64/generic/software no software packages in tarball other under 2023.06/software/linux/x86_64/generic `2023.06/init/arch_specs/eessi_arch_x86.spec` `.lmod/SitePackage.lua`
May 07 10:18:22 UTC 2024	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-10278.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`
May 07 10:45:30 UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-x86_64-generic-1715075986.tar.gz` to S3 bucket succeeded

eessi-bot · 2024-05-07T09:59:19Z

New job on instance eessi-bot-mc-aws for architecture x86_64-intel-haswell for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.05/pr_530/10279

date	job status	comment
May 07 09:59:18 UTC 2024	submitted	job id `10279` awaits release by job manager
May 07 09:59:32 UTC 2024	released	job awaits launch by Slurm scheduler
May 07 10:00:46 UTC 2024	running	job `10279` is running
May 07 10:18:24 UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-10279.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-intel-haswell-1715075987.tar.gz` size: 0 MiB (3108 bytes) entries: 2 modules under 2023.06/software/linux/x86_64/intel/haswell/modules/all no module files in tarball software under 2023.06/software/linux/x86_64/intel/haswell/software no software packages in tarball other under 2023.06/software/linux/x86_64/intel/haswell `2023.06/init/arch_specs/eessi_arch_x86.spec` `.lmod/SitePackage.lua`
May 07 10:18:24 UTC 2024	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-10279.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`
May 07 10:45:49 UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-x86_64-intel-haswell-1715075987.tar.gz` to S3 bucket succeeded

eessi-bot · 2024-05-07T09:59:23Z

New job on instance eessi-bot-mc-aws for architecture x86_64-intel-skylake_avx512 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.05/pr_530/10280

date	job status	comment
May 07 09:59:22 UTC 2024	submitted	job id `10280` awaits release by job manager
May 07 09:59:34 UTC 2024	released	job awaits launch by Slurm scheduler
May 07 10:00:48 UTC 2024	running	job `10280` is running
May 07 10:17:06 UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-10280.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1715075987.tar.gz` size: 0 MiB (3115 bytes) entries: 2 modules under 2023.06/software/linux/x86_64/intel/skylake_avx512/modules/all no module files in tarball software under 2023.06/software/linux/x86_64/intel/skylake_avx512/software no software packages in tarball other under 2023.06/software/linux/x86_64/intel/skylake_avx512 `2023.06/init/arch_specs/eessi_arch_x86.spec` `.lmod/SitePackage.lua`
May 07 10:17:06 UTC 2024	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-10280.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`
May 07 10:46:09 UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1715075987.tar.gz` to S3 bucket succeeded

eessi-bot · 2024-05-07T09:59:27Z

New job on instance eessi-bot-mc-aws for architecture x86_64-amd-zen2 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.05/pr_530/10281

date	job status	comment
May 07 09:59:26 UTC 2024	submitted	job id `10281` awaits release by job manager
May 07 09:59:28 UTC 2024	released	job awaits launch by Slurm scheduler
May 07 10:00:43 UTC 2024	running	job `10281` is running
May 07 10:20:55 UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-10281.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-amd-zen2-1715075979.tar.gz` size: 0 MiB (3109 bytes) entries: 2 modules under 2023.06/software/linux/x86_64/amd/zen2/modules/all no module files in tarball software under 2023.06/software/linux/x86_64/amd/zen2/software no software packages in tarball other under 2023.06/software/linux/x86_64/amd/zen2 `2023.06/init/arch_specs/eessi_arch_x86.spec` `.lmod/SitePackage.lua`
May 07 10:20:55 UTC 2024	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-10281.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`
May 07 10:46:28 UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-x86_64-amd-zen2-1715075979.tar.gz` to S3 bucket succeeded

eessi-bot · 2024-05-07T09:59:31Z

New job on instance eessi-bot-mc-aws for architecture x86_64-amd-zen3 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.05/pr_530/10282

date	job status	comment
May 07 09:59:30 UTC 2024	submitted	job id `10282` awaits release by job manager
May 07 10:00:41 UTC 2024	released	job awaits launch by Slurm scheduler
May 07 10:01:57 UTC 2024	running	job `10282` is running
May 07 10:14:48 UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-10282.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-amd-zen3-1715076050.tar.gz` size: 0 MiB (3111 bytes) entries: 2 modules under 2023.06/software/linux/x86_64/amd/zen3/modules/all no module files in tarball software under 2023.06/software/linux/x86_64/amd/zen3/software no software packages in tarball other under 2023.06/software/linux/x86_64/amd/zen3 `2023.06/init/arch_specs/eessi_arch_x86.spec` `.lmod/SitePackage.lua`
May 07 10:14:48 UTC 2024	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-10282.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`
May 07 10:46:48 UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-x86_64-amd-zen3-1715076050.tar.gz` to S3 bucket succeeded

eessi-bot · 2024-05-07T09:59:35Z

New job on instance eessi-bot-mc-aws for architecture aarch64-generic for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.05/pr_530/10283

date	job status	comment
May 07 09:59:34 UTC 2024	submitted	job id `10283` awaits release by job manager
May 07 10:00:36 UTC 2024	released	job awaits launch by Slurm scheduler
May 07 10:01:51 UTC 2024	running	job `10283` is running
May 07 10:14:45 UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-10283.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-aarch64-generic-1715076049.tar.gz` size: 0 MiB (3122 bytes) entries: 2 modules under 2023.06/software/linux/aarch64/generic/modules/all no module files in tarball software under 2023.06/software/linux/aarch64/generic/software no software packages in tarball other under 2023.06/software/linux/aarch64/generic `2023.06/init/arch_specs/eessi_arch_x86.spec` `.lmod/SitePackage.lua`
May 07 10:14:45 UTC 2024	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-10283.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`
May 07 10:47:07 UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-aarch64-generic-1715076049.tar.gz` to S3 bucket succeeded

eessi-bot · 2024-05-07T09:59:38Z

New job on instance eessi-bot-mc-aws for architecture aarch64-neoverse_n1 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.05/pr_530/10284

date	job status	comment
May 07 09:59:38 UTC 2024	submitted	job id `10284` awaits release by job manager
May 07 10:00:37 UTC 2024	released	job awaits launch by Slurm scheduler
May 07 10:01:53 UTC 2024	running	job `10284` is running
May 07 10:14:46 UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-10284.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-aarch64-neoverse_n1-1715076061.tar.gz` size: 0 MiB (3123 bytes) entries: 2 modules under 2023.06/software/linux/aarch64/neoverse_n1/modules/all no module files in tarball software under 2023.06/software/linux/aarch64/neoverse_n1/software no software packages in tarball other under 2023.06/software/linux/aarch64/neoverse_n1 `2023.06/init/arch_specs/eessi_arch_x86.spec` `.lmod/SitePackage.lua`
May 07 10:14:46 UTC 2024	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-10284.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`
May 07 10:47:26 UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-aarch64-neoverse_n1-1715076061.tar.gz` to S3 bucket succeeded

eessi-bot · 2024-05-07T09:59:43Z

New job on instance eessi-bot-mc-aws for architecture aarch64-neoverse_v1 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.05/pr_530/10285

date	job status	comment
May 07 09:59:42 UTC 2024	submitted	job id `10285` awaits release by job manager
May 07 10:00:39 UTC 2024	released	job awaits launch by Slurm scheduler
May 07 10:01:54 UTC 2024	running	job `10285` is running
May 07 10:10:59 UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-10285.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-aarch64-neoverse_v1-1715076060.tar.gz` size: 0 MiB (3126 bytes) entries: 2 modules under 2023.06/software/linux/aarch64/neoverse_v1/modules/all no module files in tarball software under 2023.06/software/linux/aarch64/neoverse_v1/software no software packages in tarball other under 2023.06/software/linux/aarch64/neoverse_v1 `2023.06/init/arch_specs/eessi_arch_x86.spec` `.lmod/SitePackage.lua`
May 07 10:10:59 UTC 2024	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-10285.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`
May 07 10:47:46 UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-aarch64-neoverse_v1-1715076060.tar.gz` to S3 bucket succeeded

casparvl · 2024-05-07T10:20:15Z

The 2023.06/init/arch_specs/eessi_arch_x86.spec file comes from #451 which was merged without deploying. Not a big deal, it should be deployed anyway, might as well be deployed with this PR.

casparvl · 2024-05-07T10:26:46Z

Hm, no wait, it can't, since I didn't sync this branch with develop (yet). I'm actually not sure why it's redeploying this file :\ I do know that @boegel should have deployed it in his PR...

casparvl · 2024-05-07T10:30:02Z

And yet if I look in the bot's tarball, I see:

# x86_64 CPU architecture specifications
# Software path in EESSI        | Vendor ID     | List of defining CPU features
"x86_64/intel/haswell"          "GenuineIntel"  "avx2 fma"                                              # Intel Haswell, Broadwell
"x86_64/intel/skylake_avx512"   "GenuineIntel"  "avx2 fma avx512f avx512bw avx512cd avx512dq avx512vl"  # Intel Skylake, Cascade Lake
"x86_64/amd/zen2"               "AuthenticAMD"  "avx2 fma"                                              # AMD Rome
"x86_64/amd/zen3"               "AuthenticAMD"  "avx2 fma vaes"                                         # AMD Milan, Milan-X
"x86_64/amd/zen4"               "AuthenticAMD"  "avx2 fma vaes avx512f avx512ifma"                      # AMD Genoa, Genoa-X

That's the updated version of the eessi_arch_x86.spec file. Well... I guess that means we're good to go. This will just deploy the thin that was forgotten in #451 , I just still don't understand why that happens without me having merged this branch with the release branch...

boegel · 2024-05-07T10:30:07Z

Hm, no wait, it can't, since I didn't sync this branch with develop (yet). I'm actually not sure why it's redeploying this file :\ I do know that @boegel should have deployed it in his PR...

The bot merges your PR with current version of target branch, so you're essentially also doing the "build" for the changes in #451 here, indeed...

casparvl · 2024-05-07T10:30:44Z

Ah ok. Well, that's fine. Then we can just deploy :) As long as we understand what's happening :D

boegel · 2024-05-07T11:58:41Z

bot: build repo:eessi.io-2023.06-software arch:x86_64/generic
bot: build repo:eessi.io-2023.06-software arch:x86_64/intel/haswell
bot: build repo:eessi.io-2023.06-software arch:x86_64/intel/skylake_avx512
bot: build repo:eessi.io-2023.06-software arch:x86_64/amd/zen2
bot: build repo:eessi.io-2023.06-software arch:x86_64/amd/zen3
bot: build repo:eessi.io-2023.06-software arch:x86_64/amd/zen4
bot: build repo:eessi.io-2023.06-software arch:aarch64/generic
bot: build repo:eessi.io-2023.06-software arch:aarch64/neoverse_n1
bot: build repo:eessi.io-2023.06-software arch:aarch64/neoverse_v1

eessi-bot · 2024-05-07T11:58:44Z

Updates by the bot instance eessi-bot-mc-azure (click for details)

received bot command build repo:eessi.io-2023.06-software arch:x86_64/generic from boegel
- expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/generic
received bot command build repo:eessi.io-2023.06-software arch:x86_64/intel/haswell from boegel
- expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/intel/haswell
received bot command build repo:eessi.io-2023.06-software arch:x86_64/intel/skylake_avx512 from boegel
- expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/intel/skylake_avx512
received bot command build repo:eessi.io-2023.06-software arch:x86_64/amd/zen2 from boegel
- expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen2
received bot command build repo:eessi.io-2023.06-software arch:x86_64/amd/zen3 from boegel
- expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen3
received bot command build repo:eessi.io-2023.06-software arch:x86_64/amd/zen4 from boegel
- expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen4
received bot command build repo:eessi.io-2023.06-software arch:aarch64/generic from boegel
- expanded format: build repository:eessi.io-2023.06-software architecture:aarch64/generic
received bot command build repo:eessi.io-2023.06-software arch:aarch64/neoverse_n1 from boegel
- expanded format: build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_n1
received bot command build repo:eessi.io-2023.06-software arch:aarch64/neoverse_v1 from boegel
- expanded format: build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_v1
handling command build repository:eessi.io-2023.06-software architecture:x86_64/generic resulted in:
- no jobs were submitted
handling command build repository:eessi.io-2023.06-software architecture:x86_64/intel/haswell resulted in:
- no jobs were submitted
handling command build repository:eessi.io-2023.06-software architecture:x86_64/intel/skylake_avx512 resulted in:
- no jobs were submitted
handling command build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen2 resulted in:
- no jobs were submitted
handling command build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen3 resulted in:
- no jobs were submitted
handling command build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen4 resulted in:
- submitted job 69, for details & status see Add possibility to ignore certain hooks on local modules #530 (comment)
handling command build repository:eessi.io-2023.06-software architecture:aarch64/generic resulted in:
- no jobs were submitted
handling command build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_n1 resulted in:
- no jobs were submitted
handling command build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_v1 resulted in:
- no jobs were submitted

eessi-bot · 2024-05-07T11:58:44Z

Updates by the bot instance eessi-bot-mc-aws (click for details)

received bot command build repo:eessi.io-2023.06-software arch:x86_64/generic from boegel
- expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/generic
received bot command build repo:eessi.io-2023.06-software arch:x86_64/intel/haswell from boegel
- expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/intel/haswell
received bot command build repo:eessi.io-2023.06-software arch:x86_64/intel/skylake_avx512 from boegel
- expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/intel/skylake_avx512
received bot command build repo:eessi.io-2023.06-software arch:x86_64/amd/zen2 from boegel
- expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen2
received bot command build repo:eessi.io-2023.06-software arch:x86_64/amd/zen3 from boegel
- expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen3
received bot command build repo:eessi.io-2023.06-software arch:x86_64/amd/zen4 from boegel
- expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen4
received bot command build repo:eessi.io-2023.06-software arch:aarch64/generic from boegel
- expanded format: build repository:eessi.io-2023.06-software architecture:aarch64/generic
received bot command build repo:eessi.io-2023.06-software arch:aarch64/neoverse_n1 from boegel
- expanded format: build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_n1
received bot command build repo:eessi.io-2023.06-software arch:aarch64/neoverse_v1 from boegel
- expanded format: build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_v1
handling command build repository:eessi.io-2023.06-software architecture:x86_64/generic resulted in:
- submitted job 10296, for details & status see Add possibility to ignore certain hooks on local modules #530 (comment)
handling command build repository:eessi.io-2023.06-software architecture:x86_64/intel/haswell resulted in:
- submitted job 10297, for details & status see Add possibility to ignore certain hooks on local modules #530 (comment)
handling command build repository:eessi.io-2023.06-software architecture:x86_64/intel/skylake_avx512 resulted in:
- submitted job 10298, for details & status see Add possibility to ignore certain hooks on local modules #530 (comment)
handling command build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen2 resulted in:
- submitted job 10299, for details & status see Add possibility to ignore certain hooks on local modules #530 (comment)
handling command build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen3 resulted in:
- submitted job 10300, for details & status see Add possibility to ignore certain hooks on local modules #530 (comment)
handling command build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen4 resulted in:
- no jobs were submitted
handling command build repository:eessi.io-2023.06-software architecture:aarch64/generic resulted in:
- submitted job 10301, for details & status see Add possibility to ignore certain hooks on local modules #530 (comment)
handling command build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_n1 resulted in:
- submitted job 10302, for details & status see Add possibility to ignore certain hooks on local modules #530 (comment)
handling command build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_v1 resulted in:
- submitted job 10303, for details & status see Add possibility to ignore certain hooks on local modules #530 (comment)

eessi-bot · 2024-05-07T11:58:48Z

New job on instance eessi-bot-mc-aws for architecture x86_64-generic for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.05/pr_530/10296

date	job status	comment
May 07 11:58:47 UTC 2024	submitted	job id `10296` awaits release by job manager
May 07 11:59:55 UTC 2024	released	job awaits launch by Slurm scheduler
May 07 12:09:21 UTC 2024	running	job `10296` is running
May 07 12:27:16 UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-10296.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-generic-1715083733.tar.gz` size: 0 MiB (2789 bytes) entries: 1 modules under 2023.06/software/linux/x86_64/generic/modules/all no module files in tarball software under 2023.06/software/linux/x86_64/generic/software no software packages in tarball other under 2023.06/software/linux/x86_64/generic `.lmod/SitePackage.lua`
May 07 12:27:16 UTC 2024	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-10296.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`
May 07 12:50:36 UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-x86_64-generic-1715083733.tar.gz` to S3 bucket succeeded

eessi-bot · 2024-05-07T11:58:52Z

New job on instance eessi-bot-mc-aws for architecture x86_64-intel-haswell for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.05/pr_530/10297

date	job status	comment
May 07 11:58:51 UTC 2024	submitted	job id `10297` awaits release by job manager
May 07 11:59:57 UTC 2024	released	job awaits launch by Slurm scheduler
May 07 12:09:23 UTC 2024	running	job `10297` is running
May 07 12:27:18 UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-10297.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-intel-haswell-1715083760.tar.gz` size: 0 MiB (2791 bytes) entries: 1 modules under 2023.06/software/linux/x86_64/intel/haswell/modules/all no module files in tarball software under 2023.06/software/linux/x86_64/intel/haswell/software no software packages in tarball other under 2023.06/software/linux/x86_64/intel/haswell `.lmod/SitePackage.lua`
May 07 12:27:18 UTC 2024	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-10297.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`
May 07 12:50:56 UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-x86_64-intel-haswell-1715083760.tar.gz` to S3 bucket succeeded

eessi-bot · 2024-05-07T11:58:53Z

New job on instance eessi-bot-mc-azure for architecture x86_64-amd-zen4 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.05/pr_530/69

the build step failed because the CUDA Lmod hook prevented the sanity check of the CUDA installation (into host_injections on the build host) succeed
the test step failed because ReFrame is not yet available in the software stack
anyhow the tarball including the updated SitePackage.lua was created and uploaded to the S3 bucket

date	job status	comment
May 07 11:58:52 UTC 2024	submitted	job id `69` awaits release by job manager
May 07 11:59:39 UTC 2024	released	job awaits launch by Slurm scheduler
May 07 12:04:42 UTC 2024	running	job `69` is running
May 07 12:11:52 UTC 2024	finished	😢 FAILURE (click triangle for details) Details ✅ job output file `slurm-69.out` ❌ found message matching `ERROR:` ❌ found message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-amd-zen4-1715083834.tar.gz` size: 0 MiB (2784 bytes) entries: 1 modules under 2023.06/software/linux/x86_64/amd/zen4/modules/all no module files in tarball software under 2023.06/software/linux/x86_64/amd/zen4/software no software packages in tarball other under 2023.06/software/linux/x86_64/amd/zen4 `.lmod/SitePackage.lua`
May 07 12:11:52 UTC 2024	test result	😢 FAILURE (click triangle for details) Reason EESSI test suite was not run, test step itself failed to execute. Details ✅ job output file `slurm-69.out` ❌ found message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`
May 07 12:50:35 UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-x86_64-amd-zen4-1715083834.tar.gz` to S3 bucket succeeded

eessi-bot · 2024-05-07T11:58:56Z

New job on instance eessi-bot-mc-aws for architecture x86_64-intel-skylake_avx512 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.05/pr_530/10298

date	job status	comment
May 07 11:58:55 UTC 2024	submitted	job id `10298` awaits release by job manager
May 07 11:59:59 UTC 2024	released	job awaits launch by Slurm scheduler
May 07 12:09:25 UTC 2024	running	job `10298` is running
May 07 12:25:11 UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-10298.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1715083756.tar.gz` size: 0 MiB (2798 bytes) entries: 1 modules under 2023.06/software/linux/x86_64/intel/skylake_avx512/modules/all no module files in tarball software under 2023.06/software/linux/x86_64/intel/skylake_avx512/software no software packages in tarball other under 2023.06/software/linux/x86_64/intel/skylake_avx512 `.lmod/SitePackage.lua`
May 07 12:25:11 UTC 2024	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-10298.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`
May 07 12:51:15 UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1715083756.tar.gz` to S3 bucket succeeded

eessi-bot · 2024-05-07T11:59:00Z

New job on instance eessi-bot-mc-aws for architecture x86_64-amd-zen2 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.05/pr_530/10299

date	job status	comment
May 07 11:58:59 UTC 2024	submitted	job id `10299` awaits release by job manager
May 07 11:59:51 UTC 2024	released	job awaits launch by Slurm scheduler
May 07 12:09:17 UTC 2024	running	job `10299` is running
May 07 12:29:21 UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-10299.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-amd-zen2-1715083732.tar.gz` size: 0 MiB (2782 bytes) entries: 1 modules under 2023.06/software/linux/x86_64/amd/zen2/modules/all no module files in tarball software under 2023.06/software/linux/x86_64/amd/zen2/software no software packages in tarball other under 2023.06/software/linux/x86_64/amd/zen2 `.lmod/SitePackage.lua`
May 07 12:29:21 UTC 2024	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-10299.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`
May 07 12:51:35 UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-x86_64-amd-zen2-1715083732.tar.gz` to S3 bucket succeeded

eessi-bot · 2024-05-07T11:59:04Z

New job on instance eessi-bot-mc-aws for architecture x86_64-amd-zen3 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.05/pr_530/10300

date	job status	comment
May 07 11:59:03 UTC 2024	submitted	job id `10300` awaits release by job manager
May 07 11:59:53 UTC 2024	released	job awaits launch by Slurm scheduler
May 07 12:09:19 UTC 2024	running	job `10300` is running
May 07 12:23:01 UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-10300.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-amd-zen3-1715083729.tar.gz` size: 0 MiB (2784 bytes) entries: 1 modules under 2023.06/software/linux/x86_64/amd/zen3/modules/all no module files in tarball software under 2023.06/software/linux/x86_64/amd/zen3/software no software packages in tarball other under 2023.06/software/linux/x86_64/amd/zen3 `.lmod/SitePackage.lua`
May 07 12:23:01 UTC 2024	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-10300.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`
May 07 12:51:55 UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-x86_64-amd-zen3-1715083729.tar.gz` to S3 bucket succeeded

eessi-bot · 2024-05-07T11:59:09Z

New job on instance eessi-bot-mc-aws for architecture aarch64-generic for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.05/pr_530/10301

date	job status	comment
May 07 11:59:08 UTC 2024	submitted	job id `10301` awaits release by job manager
May 07 11:59:44 UTC 2024	released	job awaits launch by Slurm scheduler
May 07 12:07:02 UTC 2024	running	job `10301` is running
May 07 12:20:49 UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-10301.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-aarch64-generic-1715083618.tar.gz` size: 0 MiB (2794 bytes) entries: 1 modules under 2023.06/software/linux/aarch64/generic/modules/all no module files in tarball software under 2023.06/software/linux/aarch64/generic/software no software packages in tarball other under 2023.06/software/linux/aarch64/generic `.lmod/SitePackage.lua`
May 07 12:20:49 UTC 2024	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-10301.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`
May 07 12:52:15 UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-aarch64-generic-1715083618.tar.gz` to S3 bucket succeeded

eessi-bot · 2024-05-07T11:59:13Z

New job on instance eessi-bot-mc-aws for architecture aarch64-neoverse_n1 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.05/pr_530/10302

date	job status	comment
May 07 11:59:12 UTC 2024	submitted	job id `10302` awaits release by job manager
May 07 11:59:47 UTC 2024	released	job awaits launch by Slurm scheduler
May 07 12:07:05 UTC 2024	running	job `10302` is running
May 07 12:19:41 UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-10302.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-aarch64-neoverse_n1-1715083614.tar.gz` size: 0 MiB (2795 bytes) entries: 1 modules under 2023.06/software/linux/aarch64/neoverse_n1/modules/all no module files in tarball software under 2023.06/software/linux/aarch64/neoverse_n1/software no software packages in tarball other under 2023.06/software/linux/aarch64/neoverse_n1 `.lmod/SitePackage.lua`
May 07 12:19:41 UTC 2024	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-10302.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`
May 07 12:52:34 UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-aarch64-neoverse_n1-1715083614.tar.gz` to S3 bucket succeeded

eessi-bot · 2024-05-07T11:59:17Z

New job on instance eessi-bot-mc-aws for architecture aarch64-neoverse_v1 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.05/pr_530/10303

date	job status	comment
May 07 11:59:16 UTC 2024	submitted	job id `10303` awaits release by job manager
May 07 11:59:49 UTC 2024	released	job awaits launch by Slurm scheduler
May 07 12:07:07 UTC 2024	running	job `10303` is running
May 07 12:16:18 UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-10303.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-aarch64-neoverse_v1-1715083621.tar.gz` size: 0 MiB (2797 bytes) entries: 1 modules under 2023.06/software/linux/aarch64/neoverse_v1/modules/all no module files in tarball software under 2023.06/software/linux/aarch64/neoverse_v1/software no software packages in tarball other under 2023.06/software/linux/aarch64/neoverse_v1 `.lmod/SitePackage.lua`
May 07 12:16:18 UTC 2024	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-10303.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`
May 07 12:52:54 UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-aarch64-neoverse_v1-1715083621.tar.gz` to S3 bucket succeeded

Add possibility to ignore certain hooks on local modules. E.g. we don…

3ccecf9

…'t want to be prevented from loading local CUDA modules because of the EESSI hook. See #523

ocaisa reviewed Apr 3, 2024

View reviewed changes

Comment thread create_lmodsitepackage.py

Caspar van Leeuwen added 2 commits April 3, 2024 16:36

Also use hooks for site extensions in host_injections AND for user ex…

bb20ab2

…tensions in /home/casparl/eessi/...

Leave breadcrumb to notify that paths may need to be changed in the f…

838920b

…uture

boegel added the 2023.06-software.eessi.io 2023.06 version of software.eessi.io label Apr 4, 2024

ocaisa reviewed Apr 4, 2024

View reviewed changes

Comment thread create_lmodsitepackage.py Outdated

trz42 mentioned this pull request Apr 29, 2024

DON'T MERGE -- Ignore cuda hooks outside nessi trz42/software-layer#75

Open

Update create_lmodsitepackage.py

d0229cc

trz42 mentioned this pull request May 5, 2024

add possibility to ignore certain hooks NorESSI/software-layer#352

Merged

casparvl mentioned this pull request May 7, 2024

add support for detecting zen4 in archdetect #451

Merged

trz42 added the bot:deploy Ask bot to deploy missing software installations to EESSI label May 7, 2024

trz42 removed the bot:deploy Ask bot to deploy missing software installations to EESSI label May 7, 2024

ocaisa approved these changes May 7, 2024

View reviewed changes

boegel added the bot:deploy Ask bot to deploy missing software installations to EESSI label May 7, 2024

trz42 merged commit e729115 into EESSI:2023.06-software.eessi.io May 7, 2024

trz42 mentioned this pull request May 7, 2024

Easyconfig that can extend EESSI #371

Merged

casparvl deleted the ignore_eessi_hooks_on_local_modules branch August 15, 2024 15:03

Conversation

casparvl commented Apr 3, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot Bot commented Apr 3, 2024

Uh oh!

Uh oh!

Uh oh!

casparvl commented May 7, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

trz42 commented May 7, 2024

Uh oh!

trz42 commented May 7, 2024

Uh oh!

eessi-bot Bot commented May 7, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot Bot commented May 7, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot Bot commented May 7, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot Bot commented May 7, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot Bot commented May 7, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot Bot commented May 7, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot Bot commented May 7, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot Bot commented May 7, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot Bot commented May 7, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot Bot commented May 7, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

casparvl commented May 7, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

casparvl commented May 7, 2024

Uh oh!

casparvl commented May 7, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

boegel commented May 7, 2024

Uh oh!

casparvl commented May 7, 2024

Uh oh!

boegel commented May 7, 2024

Uh oh!

eessi-bot Bot commented May 7, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot Bot commented May 7, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot Bot commented May 7, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot Bot commented May 7, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot Bot commented May 7, 2024 • edited by trz42 Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot Bot commented May 7, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot Bot commented May 7, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

casparvl commented Apr 3, 2024 •

edited

Loading

casparvl commented May 7, 2024 •

edited

Loading

eessi-bot Bot commented May 7, 2024 •

edited

Loading

eessi-bot Bot commented May 7, 2024 •

edited

Loading

eessi-bot Bot commented May 7, 2024 •

edited

Loading

eessi-bot Bot commented May 7, 2024 •

edited

Loading

eessi-bot Bot commented May 7, 2024 •

edited

Loading

eessi-bot Bot commented May 7, 2024 •

edited

Loading

eessi-bot Bot commented May 7, 2024 •

edited

Loading

eessi-bot Bot commented May 7, 2024 •

edited

Loading

eessi-bot Bot commented May 7, 2024 •

edited

Loading

eessi-bot Bot commented May 7, 2024 •

edited

Loading

casparvl commented May 7, 2024 •

edited

Loading

casparvl commented May 7, 2024 •

edited

Loading

eessi-bot Bot commented May 7, 2024 •

edited

Loading

eessi-bot Bot commented May 7, 2024 •

edited

Loading

eessi-bot Bot commented May 7, 2024 •

edited

Loading

eessi-bot Bot commented May 7, 2024 •

edited

Loading

eessi-bot Bot commented May 7, 2024 •

edited by trz42

Loading

eessi-bot Bot commented May 7, 2024 •

edited

Loading

eessi-bot Bot commented May 7, 2024 •

edited

Loading

eessi-bot Bot commented May 7, 2024 •

edited

Loading

eessi-bot Bot commented May 7, 2024 •

edited

Loading

eessi-bot Bot commented May 7, 2024 •

edited

Loading

eessi-bot Bot commented May 7, 2024 •

edited

Loading