Fix test_suite not being able to retrieve memory on systems that use cgroups v2 by casparvl · Pull Request #670 · EESSI/software-layer

casparvl · 2024-08-14T15:33:57Z

Fixes https://gitlab.com/eessi/support/-/issues/86

…cgroups v2

eessi-bot · 2024-08-14T15:34:01Z

Instance eessi-bot-mc-aws is configured to build for:

architectures: x86_64/generic, x86_64/intel/haswell, x86_64/intel/skylake_avx512, x86_64/amd/zen2, x86_64/amd/zen3, aarch64/generic, aarch64/neoverse_n1, aarch64/neoverse_v1
repositories: eessi.io-2023.06-compat, eessi-hpc.org-2023.06-software, eessi-hpc.org-2023.06-compat, eessi.io-2023.06-software

eessi-bot · 2024-08-14T15:34:02Z

Instance eessi-bot-mc-azure is configured to build for:

architectures: x86_64/amd/zen4
repositories: eessi.io-2023.06-compat, eessi-hpc.org-2023.06-compat, eessi-hpc.org-2023.06-software, eessi.io-2023.06-software

eessi-build-deploy-bot-deucalion · 2024-08-14T15:34:08Z

Instance boegel-bot-deucalion is configured to build for:

architectures: aarch64/a64fx
repositories: eessi.io-2023.06-software

casparvl · 2024-08-14T15:37:06Z

bot: build repo:eessi.io-2023.06-software arch:zen4

eessi-bot · 2024-08-14T15:37:10Z

Updates by the bot instance eessi-bot-mc-aws (click for details)

received bot command build repo:eessi.io-2023.06-software arch:zen4 from casparvl
- expanded format: build repository:eessi.io-2023.06-software architecture:zen4
handling command build repository:eessi.io-2023.06-software architecture:zen4 resulted in:
- no jobs were submitted

eessi-bot · 2024-08-14T15:37:10Z

Updates by the bot instance eessi-bot-mc-azure (click for details)

received bot command build repo:eessi.io-2023.06-software arch:zen4 from casparvl
- expanded format: build repository:eessi.io-2023.06-software architecture:zen4
handling command build repository:eessi.io-2023.06-software architecture:zen4 resulted in:
- submitted job 199, for details & status see Fix test_suite not being able to retrieve memory on systems that use cgroups v2 #670 (comment)

eessi-bot · 2024-08-14T15:37:14Z

New job on instance eessi-bot-mc-azure for architecture x86_64-amd-zen4 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.08/pr_670/199

date	job status	comment
Aug 14 15:37:13 UTC 2024	submitted	job id `199` awaits release by job manager
Aug 14 15:37:48 UTC 2024	released	job awaits launch by Slurm scheduler
Aug 14 15:38:51 UTC 2024	running	job `199` is running
Aug 14 15:39:52 UTC 2024	finished	😢 FAILURE (click triangle for details) Details ✅ job output file `slurm-199.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts Details No artefacts were created or found.
Aug 14 15:39:52 UTC 2024	test result	😢 FAILURE (click triangle for details) Reason Failed for unknown reason Details ✅ job output file `slurm-199.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`

eessi-build-deploy-bot-deucalion · 2024-08-14T15:37:16Z

Updates by the bot instance boegel-bot-deucalion (click for details)

account casparvl has NO permission to send commands to the bot

casparvl · 2024-08-14T15:41:28Z

bot: build repo:eessi.io-2023.06-software arch:zen4

eessi-bot · 2024-08-14T15:41:31Z

Updates by the bot instance eessi-bot-mc-aws (click for details)

received bot command build repo:eessi.io-2023.06-software arch:zen4 from casparvl
- expanded format: build repository:eessi.io-2023.06-software architecture:zen4
handling command build repository:eessi.io-2023.06-software architecture:zen4 resulted in:
- no jobs were submitted

eessi-bot · 2024-08-14T15:41:31Z

Updates by the bot instance eessi-bot-mc-azure (click for details)

received bot command build repo:eessi.io-2023.06-software arch:zen4 from casparvl
- expanded format: build repository:eessi.io-2023.06-software architecture:zen4
handling command build repository:eessi.io-2023.06-software architecture:zen4 resulted in:
- submitted job 200, for details & status see Fix test_suite not being able to retrieve memory on systems that use cgroups v2 #670 (comment)

eessi-bot · 2024-08-14T15:41:35Z

New job on instance eessi-bot-mc-azure for architecture x86_64-amd-zen4 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.08/pr_670/200

date	job status	comment
Aug 14 15:41:34 UTC 2024	submitted	job id `200` awaits release by job manager
Aug 14 15:41:55 UTC 2024	released	job awaits launch by Slurm scheduler
Aug 14 15:42:58 UTC 2024	running	job `200` is running
Aug 14 16:16:42 UTC 2024	finished	😢 FAILURE (click triangle for details) Details ✅ job output file `slurm-200.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts Details No artefacts were created or found.
Aug 14 16:16:42 UTC 2024	test result	😢 FAILURE (click triangle for details) Reason EESSI test suite produced failures. ReFrame Summary [ FAILED ] Ran 10/18 test case(s) from 18 check(s) (1 failure(s), 8 skipped, 0 aborted) Details ✅ job output file `slurm-200.out` ❌ found message matching `ERROR:` ❌ found message matching `[\sFAILED\s].Ran . test case`

eessi-build-deploy-bot-deucalion · 2024-08-14T15:41:36Z

Updates by the bot instance boegel-bot-deucalion (click for details)

account casparvl has NO permission to send commands to the bot

casparvl · 2024-08-14T15:46:58Z

Ok, need to debug further, it seems to get a memory limit of 0 now...

[ RUN      ] EESSI_CP2K %benchmark_info=QS/H2O-32 %module_name=CP2K/2023.1-foss-2023a %scale=1_node /ae4db8cc @BotBuildTests:default+default
[     SKIP ] ( 1/18) Skipping test: nodes in this partition only have 0 MiB memory available (per node) accodring to the current ReFrame configuration, but 4198.4 MiB is needed
[ RUN      ] EESSI_ESPRESSO_LJ_PARTICLES %module_name=ESPResSo/4.2.2-foss-2023b %device_type=cpu %scale=1_node /adc964f6 @BotBuildTests:default+default
[     SKIP ] ( 2/18) Skipping test: nodes in this partition only have 0 MiB memory available (per node) accodring to the current ReFrame configuration, but 7372.799999999999 MiB is needed
[ RUN      ] EESSI_ESPRESSO_LJ_PARTICLES %module_name=ESPResSo/4.2.2-foss-2023a %device_type=cpu %scale=1_node /3b8b8926 @BotBuildTests:default+default
[     SKIP ] ( 3/18) Skipping test: nodes in this partition only have 0 MiB memory available (per node) accodring to the current ReFrame configuration, but 7372.799999999999 MiB is needed
[ RUN      ] EESSI_ESPRESSO_LJ_PARTICLES %module_name=ESPResSo/4.2.1-foss-2023a %device_type=cpu %scale=1_node /fdd6aced @BotBuildTests:default+default
[     SKIP ] ( 4/18) Skipping test: nodes in this partition only have 0 MiB memory available (per node) accodring to the current ReFrame configuration, but 7372.799999999999 MiB is needed
[ RUN      ] EESSI_ESPRESSO_P3M_IONIC_CRYSTALS %module_name=ESPResSo/4.2.2-foss-2023b %device_type=cpu %scale=1_node /3b90ffd6 @BotBuildTests:default+default
[     SKIP ] ( 5/18) Skipping test: nodes in this partition only have 0 MiB memory available (per node) accodring to the current ReFrame configuration, but 22118.4 MiB is needed
[ RUN      ] EESSI_ESPRESSO_P3M_IONIC_CRYSTALS %module_name=ESPResSo/4.2.2-foss-2023a %device_type=cpu %scale=1_node /f1621689 @BotBuildTests:default+default
[     SKIP ] ( 6/18) Skipping test: nodes in this partition only have 0 MiB memory available (per node) accodring to the current ReFrame configuration, but 22118.4 MiB is needed
[ RUN      ] EESSI_ESPRESSO_P3M_IONIC_CRYSTALS %module_name=ESPResSo/4.2.1-foss-2023a %device_type=cpu %scale=1_node /4a9e965c @BotBuildTests:default+default
[     SKIP ] ( 7/18) Skipping test: nodes in this partition only have 0 MiB memory available (per node) accodring to the current ReFrame configuration, but 22118.4 MiB is needed
[ RUN      ] EESSI_GROMACS %benchmark_info=HECBioSim/Crambin %nb_impl=cpu %scale=1_node %module_name=GROMACS/2024.1-foss-2023b /02920241 @BotBuildTests:default+default
[ RUN      ] EESSI_LAMMPS_lj %scale=1_node %device_type=cpu %module_name=LAMMPS/2Aug2023_update2-foss-2023a-kokkos /04ff9ece @BotBuildTests:default+default
[     SKIP ] ( 8/18) Skipping test: nodes in this partition only have 0 MiB memory available (per node) accodring to the current ReFrame configuration, but 2232.32 MiB is needed

casparvl · 2024-08-15T09:48:48Z

bot: build repo:eessi.io-2023.06-software arch:zen4

eessi-bot · 2024-08-15T09:48:52Z

Updates by the bot instance eessi-bot-mc-aws (click for details)

received bot command build repo:eessi.io-2023.06-software arch:zen4 from casparvl
- expanded format: build repository:eessi.io-2023.06-software architecture:zen4
handling command build repository:eessi.io-2023.06-software architecture:zen4 resulted in:
- no jobs were submitted

eessi-bot · 2024-08-15T09:48:52Z

Updates by the bot instance eessi-bot-mc-azure (click for details)

received bot command build repo:eessi.io-2023.06-software arch:zen4 from casparvl
- expanded format: build repository:eessi.io-2023.06-software architecture:zen4
handling command build repository:eessi.io-2023.06-software architecture:zen4 resulted in:
- submitted job 202, for details & status see Fix test_suite not being able to retrieve memory on systems that use cgroups v2 #670 (comment)

eessi-build-deploy-bot-deucalion · 2024-08-15T09:48:55Z

Updates by the bot instance boegel-bot-deucalion (click for details)

account casparvl has NO permission to send commands to the bot

eessi-bot · 2024-08-15T09:48:56Z

New job on instance eessi-bot-mc-azure for architecture x86_64-amd-zen4 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.08/pr_670/202

date	job status	comment
Aug 15 09:48:55 UTC 2024	submitted	job id `202` awaits release by job manager
Aug 15 09:49:21 UTC 2024	released	job awaits launch by Slurm scheduler
Aug 15 10:13:25 UTC 2024	running	job `202` is running
Aug 15 10:14:27 UTC 2024	finished	😢 FAILURE (click triangle for details) Details ✅ job output file `slurm-202.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts Details No artefacts were created or found.
Aug 15 10:14:27 UTC 2024	test result	😢 FAILURE (click triangle for details) Reason EESSI test suite was not run, test step itself failed to execute. Details ✅ job output file `slurm-202.out` ❌ found message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`

casparvl · 2024-08-15T11:05:12Z

bot: build repo:eessi.io-2023.06-software arch:zen4

eessi-bot · 2024-08-15T11:05:15Z

Updates by the bot instance eessi-bot-mc-aws (click for details)

received bot command build repo:eessi.io-2023.06-software arch:zen4 from casparvl
- expanded format: build repository:eessi.io-2023.06-software architecture:zen4
handling command build repository:eessi.io-2023.06-software architecture:zen4 resulted in:
- no jobs were submitted

eessi-bot · 2024-08-15T11:05:16Z

Updates by the bot instance eessi-bot-mc-azure (click for details)

received bot command build repo:eessi.io-2023.06-software arch:zen4 from casparvl
- expanded format: build repository:eessi.io-2023.06-software architecture:zen4
handling command build repository:eessi.io-2023.06-software architecture:zen4 resulted in:
- submitted job 204, for details & status see Fix test_suite not being able to retrieve memory on systems that use cgroups v2 #670 (comment)

eessi-bot · 2024-08-15T11:05:20Z

New job on instance eessi-bot-mc-azure for architecture x86_64-amd-zen4 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.08/pr_670/204

date	job status	comment
Aug 15 11:05:18 UTC 2024	submitted	job id `204` awaits release by job manager
Aug 15 11:05:35 UTC 2024	released	job awaits launch by Slurm scheduler
Aug 15 11:48:43 UTC 2024	running	job `204` is running
Aug 15 11:50:48 UTC 2024	finished	😢 FAILURE (click triangle for details) Details ✅ job output file `slurm-204.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts Details No artefacts were created or found.
Aug 15 11:50:48 UTC 2024	test result	😢 FAILURE (click triangle for details) Reason Failed for unknown reason Details ✅ job output file `slurm-204.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`

eessi-build-deploy-bot-deucalion · 2024-08-15T11:05:21Z

Updates by the bot instance boegel-bot-deucalion (click for details)

account casparvl has NO permission to send commands to the bot

eessi-build-deploy-bot-deucalion · 2024-08-15T16:33:00Z

Updates by the bot instance boegel-bot-deucalion (click for details)

account casparvl has NO permission to send commands to the bot

eessi-bot · 2024-08-15T16:33:01Z

New job on instance eessi-bot-mc-azure for architecture x86_64-amd-zen4 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.08/pr_670/210

date	job status	comment
Aug 15 16:33:00 UTC 2024	submitted	job id `210` awaits release by job manager
Aug 15 16:33:48 UTC 2024	released	job awaits launch by Slurm scheduler
Aug 15 16:37:51 UTC 2024	running	job `210` is running
Aug 15 16:39:54 UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-210.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-amd-zen4-1723739912.tar.gz` size: 43 MiB (46091978 bytes) entries: 9382 modules under 2023.06/software/linux/x86_64/amd/zen4/modules/all `ReFrame/4.3.3.lua` software under 2023.06/software/linux/x86_64/amd/zen4/software `ReFrame/4.3.3` other under 2023.06/software/linux/x86_64/amd/zen4 no other files in tarball
Aug 15 16:39:54 UTC 2024	test result	😢 FAILURE (click triangle for details) Reason EESSI test suite was not run, test step itself failed to execute. Details ✅ job output file `slurm-210.out` ❌ found message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`

casparvl · 2024-08-15T16:42:22Z

I'm confused. In the test step of the bot:

Checking if ReFrame module exists:
ls: cannot access '/cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/amd/zen4/modules/all/ReFrame/4.3.3.lua': No such file or directory

How can that not exist, I just installed it didn't I? And the test step resumes from the correct tempdir:

./eessi_container.sh --verbose --access rw --mode run --container docker://ghcr.io/eessi/build-node:debian11 --repository eessi.io-2023.06-software --save /project/60006/SHARED/jobs/2024.08/pr_670/event_05f02830-5b24-11ef-8f2d-cbb6fa9c
f255/run_000/linux_x86_64_amd_zen4/eessi.io-2023.06-software/previous_tmp/build_step --storage /tmp/bot/EESSI --nvidia install --host-injections /project/def-users/bot/shared/host-injections
                     -- ./install_software_layer.sh "--build-logs-dir /project/def-users/SHARED/build-logs --shared-fs-path /project/def-users/bot/shared" "" 2>&1 | tee -a build.outerr.r9Yc
checking for duplicates: 'eessi.io-2023.06-software' and 'eessi.io-2023.06-software'
repo 'eessi.io-2023.06-software' is not an EESSI CVMFS repository...
Using /tmp/bot/EESSI/eessi.XvUflydXGA as tmp directory (to resume session add '--resume /tmp/bot/EESSI/eessi.XvUflydXGA').
...
./eessi_container.sh --verbose --access ro --mode run --container docker://ghcr.io/eessi/build-node:debian11 --repository eessi.io-2023.06-software --save /project/60006/SHARED/jobs/2024.08/pr_670/event_05f02830-5b24-11ef-8f2d-cbb6fa9c
f255/run_000/linux_x86_64_amd_zen4/eessi.io-2023.06-software/previous_tmp/test_step --resume /tmp/bot/EESSI/eessi.XvUflydXGA --extra-bind-paths /sys/fs/cgroup:/hostsys/fs/cgroup:ro
                     -- ./run_tests.sh "" "" 2>&1 | tee -a test.outerr.J1vQ

What's going on here?

casparvl · 2024-08-15T22:01:03Z

Tried manually, got:

Apptainer> ls /tmp/overlay-upper/versions/2023.06/software/linux/x86_64/amd/zen4/modules/all/ReFrame/4.3.3.lua
/tmp/overlay-upper/versions/2023.06/software/linux/x86_64/amd/zen4/modules/all/ReFrame/4.3.3.lua
Apptainer> ls /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/amd/zen4/modules/all/ReFrame/4.3.3.lua
ls: cannot access '/cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/amd/zen4/modules/all/ReFrame/4.3.3.lua': No such file or directory

casparvl · 2024-08-19T09:48:38Z

bot: build repo:eessi.io-2023.06-software arch:zen4

eessi-bot · 2024-08-19T09:48:40Z

Updates by the bot instance eessi-bot-mc-aws (click for details)

received bot command build repo:eessi.io-2023.06-software arch:zen4 from casparvl
- expanded format: build repository:eessi.io-2023.06-software architecture:zen4
handling command build repository:eessi.io-2023.06-software architecture:zen4 resulted in:
- no jobs were submitted

eessi-bot · 2024-08-19T09:48:41Z

Updates by the bot instance eessi-bot-mc-azure (click for details)

received bot command build repo:eessi.io-2023.06-software arch:zen4 from casparvl
- expanded format: build repository:eessi.io-2023.06-software architecture:zen4
handling command build repository:eessi.io-2023.06-software architecture:zen4 resulted in:
- submitted job 215, for details & status see Fix test_suite not being able to retrieve memory on systems that use cgroups v2 #670 (comment)

eessi-bot · 2024-08-19T09:48:45Z

New job on instance eessi-bot-mc-azure for architecture x86_64-amd-zen4 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.08/pr_670/215

date	job status	comment
Aug 19 09:48:44 UTC 2024	submitted	job id `215` awaits release by job manager
Aug 19 09:49:18 UTC 2024	released	job awaits launch by Slurm scheduler
Aug 19 09:52:21 UTC 2024	running	job `215` is running
Aug 19 09:55:27 UTC 2024	finished	😢 FAILURE (click triangle for details) Details ✅ job output file `slurm-215.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts Details No artefacts were created or found.
Aug 19 09:55:27 UTC 2024	test result	😢 FAILURE (click triangle for details) Reason Failed for unknown reason Details ✅ job output file `slurm-215.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`

casparvl · 2024-08-19T10:05:51Z

bot: build repo:eessi.io-2023.06-software arch:zen4

eessi-bot · 2024-08-19T10:05:53Z

Updates by the bot instance eessi-bot-mc-aws (click for details)

received bot command build repo:eessi.io-2023.06-software arch:zen4 from casparvl
- expanded format: build repository:eessi.io-2023.06-software architecture:zen4
handling command build repository:eessi.io-2023.06-software architecture:zen4 resulted in:
- no jobs were submitted

eessi-bot · 2024-08-19T10:05:54Z

Updates by the bot instance eessi-bot-mc-azure (click for details)

received bot command build repo:eessi.io-2023.06-software arch:zen4 from casparvl
- expanded format: build repository:eessi.io-2023.06-software architecture:zen4
handling command build repository:eessi.io-2023.06-software architecture:zen4 resulted in:
- submitted job 216, for details & status see Fix test_suite not being able to retrieve memory on systems that use cgroups v2 #670 (comment)

eessi-bot · 2024-08-19T10:05:58Z

New job on instance eessi-bot-mc-azure for architecture x86_64-amd-zen4 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.08/pr_670/216

date	job status	comment
Aug 19 10:05:57 UTC 2024	submitted	job id `216` awaits release by job manager
Aug 19 10:06:32 UTC 2024	released	job awaits launch by Slurm scheduler
Aug 19 10:07:35 UTC 2024	running	job `216` is running
Aug 19 10:36:38 UTC 2024	finished	😢 FAILURE (click triangle for details) Details ✅ job output file `slurm-216.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts Details No artefacts were created or found.
Aug 19 10:36:38 UTC 2024	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ PASSED ] Ran 13/13 test case(s) from 13 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-216.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`

casparvl · 2024-08-19T12:31:13Z

This looks the way it should be:

Running tests: reframe --tag CI --tag 1_node --nocolor --run
[ReFrame Setup]
  version:           4.3.3
  command:           '/cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/amd/zen4/software/ReFrame/4.3.3/bin/reframe --tag CI --tag 1_node --nocolor --run'
  launched by:       bot@x86-64-amd-zen4-node1.int.azure-almalinux93-202403.eessi.io
  working directory: '/project/60006/SHARED/jobs/2024.08/pr_670/event_9db398f0-5e12-11ef-9aef-c19e8c12e4b6/run_000/linux_x86_64_amd_zen4/eessi.io-2023.06-software'
  settings files:    '<builtin>', '/project/60006/SHARED/jobs/2024.08/pr_670/event_9db398f0-5e12-11ef-9aef-c19e8c12e4b6/run_000/linux_x86_64_amd_zen4/eessi.io-2023.06-software/reframe_config_bot.py'
  check search path: (R) '/project/60006/SHARED/jobs/2024.08/pr_670/event_9db398f0-5e12-11ef-9aef-c19e8c12e4b6/run_000/linux_x86_64_amd_zen4/eessi.io-2023.06-software/EESSI-test-suite/eessi/testsuite/tests'
  stage directory:   '/project/60006/SHARED/jobs/2024.08/pr_670/event_9db398f0-5e12-11ef-9aef-c19e8c12e4b6/run_000/linux_x86_64_amd_zen4/eessi.io-2023.06-software/reframe_runs/stage'
  output directory:  '/project/60006/SHARED/jobs/2024.08/pr_670/event_9db398f0-5e12-11ef-9aef-c19e8c12e4b6/run_000/linux_x86_64_amd_zen4/eessi.io-2023.06-software/reframe_runs/output'
  log files:         '/project/60006/SHARED/jobs/2024.08/pr_670/event_9db398f0-5e12-11ef-9aef-c19e8c12e4b6/run_000/linux_x86_64_amd_zen4/eessi.io-2023.06-software/reframe_runs/logs/reframe_20240819_100712.log'

ESC[33mWARNING: skipping test 'EESSI_PyTorch_torchvision_CPU': test has one or more undefined parametersESC[0m
ESC[33mWARNING: skipping test 'EESSI_PyTorch_torchvision_GPU': test has one or more undefined parametersESC[0m
ESC[33mWARNING: skipping test file '/project/60006/SHARED/jobs/2024.08/pr_670/event_9db398f0-5e12-11ef-9aef-c19e8c12e4b6/run_000/linux_x86_64_amd_zen4/eessi.io-2023.06-software/EESSI-test-suite/eessi/testsuite/tests/apps/QuantumESPRESSO.py': module not found error: EESSI-test-suite/ees
si/testsuite/tests/apps/QuantumESPRESSO.py:32: No module named 'hpctestlib.sciapps.qespresso'
from hpctestlib.sciapps.qespresso.benchmarks import QEspressoPWCheck
 (rerun with '-v' for more information)ESC[0m
ESC[33mWARNING: skipping test 'EESSI_LAMMPS_lj': test has one or more undefined parametersESC[0m
ESC[33mWARNING: skipping test 'EESSI_LAMMPS_rhodo': test has one or more undefined parametersESC[0m
[==========] Running 13 check(s)
[==========] Started on Mon Aug 19 10:07:34 2024

[----------] start processing checks
[ RUN      ] EESSI_CP2K %benchmark_info=QS/H2O-32 %module_name=CP2K/2023.1-foss-2023a %scale=1_node /ae4db8cc @BotBuildTests:default+default
ESC[33mWARNING: hooks.req_memory_per_node does not support the scheduler you configured (local). The test will run, but since it doesn't request the required amount of memory explicitely, it may result in an out-of-memory error. Please expand the functionality of hooks.req_memory_per_node for your scheduler.ESC[0m
[ RUN      ] EESSI_ESPRESSO_LJ_PARTICLES %module_name=ESPResSo/4.2.2-foss-2023b %device_type=cpu %scale=1_node /adc964f6 @BotBuildTests:default+default
ESC[33mWARNING: hooks.req_memory_per_node does not support the scheduler you configured (local). The test will run, but since it doesn't request the required amount of memory explicitely, it may result in an out-of-memory error. Please expand the functionality of hooks.req_memory_per_node for your scheduler.ESC[0m
[ RUN      ] EESSI_ESPRESSO_LJ_PARTICLES %module_name=ESPResSo/4.2.2-foss-2023a %device_type=cpu %scale=1_node /3b8b8926 @BotBuildTests:default+default
ESC[33mWARNING: hooks.req_memory_per_node does not support the scheduler you configured (local). The test will run, but since it doesn't request the required amount of memory explicitely, it may result in an out-of-memory error. Please expand the functionality of hooks.req_memory_per_node for your scheduler.ESC[0m
[ RUN      ] EESSI_ESPRESSO_LJ_PARTICLES %module_name=ESPResSo/4.2.1-foss-2023a %device_type=cpu %scale=1_node /fdd6aced @BotBuildTests:default+default
ESC[33mWARNING: hooks.req_memory_per_node does not support the scheduler you configured (local). The test will run, but since it doesn't request the required amount of memory explicitely, it may result in an out-of-memory error. Please expand the functionality of hooks.req_memory_per_node for your scheduler.ESC[0m
[ RUN      ] EESSI_ESPRESSO_P3M_IONIC_CRYSTALS %module_name=ESPResSo/4.2.2-foss-2023b %device_type=cpu %scale=1_node /3b90ffd6 @BotBuildTests:default+default
ESC[33mWARNING: hooks.req_memory_per_node does not support the scheduler you configured (local). The test will run, but since it doesn't request the required amount of memory explicitely, it may result in an out-of-memory error. Please expand the functionality of hooks.req_memory_per_node for your scheduler.ESC[0m
[ RUN      ] EESSI_ESPRESSO_P3M_IONIC_CRYSTALS %module_name=ESPResSo/4.2.2-foss-2023a %device_type=cpu %scale=1_node /f1621689 @BotBuildTests:default+default
ESC[33mWARNING: hooks.req_memory_per_node does not support the scheduler you configured (local). The test will run, but since it doesn't request the required amount of memory explicitely, it may result in an out-of-memory error. Please expand the functionality of hooks.req_memory_per_node for your scheduler.ESC[0m
[ RUN      ] EESSI_ESPRESSO_P3M_IONIC_CRYSTALS %module_name=ESPResSo/4.2.1-foss-2023a %device_type=cpu %scale=1_node /4a9e965c @BotBuildTests:default+default
ESC[33mWARNING: hooks.req_memory_per_node does not support the scheduler you configured (local). The test will run, but since it doesn't request the required amount of memory explicitely, it may result in an out-of-memory error. Please expand the functionality of hooks.req_memory_per_node for your scheduler.ESC[0m
[ RUN      ] EESSI_GROMACS %benchmark_info=HECBioSim/Crambin %nb_impl=cpu %scale=1_node %module_name=GROMACS/2024.1-foss-2023b /02920241 @BotBuildTests:default+default
[ RUN      ] EESSI_OSU_Micro_Benchmarks_coll %benchmark_info=mpi.collective.osu_allreduce %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /31ac6ab9 @BotBuildTests:default+default
[ RUN      ] EESSI_OSU_Micro_Benchmarks_coll %benchmark_info=mpi.collective.osu_alltoall %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /10e66fba @BotBuildTests:default+default
[ RUN      ] EESSI_OSU_Micro_Benchmarks_pt2pt %benchmark_info=mpi.pt2pt.osu_latency %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /c8c9aff5 @BotBuildTests:default+default
[ RUN      ] EESSI_OSU_Micro_Benchmarks_pt2pt %benchmark_info=mpi.pt2pt.osu_bw %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /48da21c5 @BotBuildTests:default+default
[ RUN      ] EESSI_TensorFlow %scale=1_node %module_name=TensorFlow/2.13.0-foss-2023a %device_type=cpu /9864d0f5 @BotBuildTests:default+default
[       OK ] ( 1/13) EESSI_CP2K %benchmark_info=QS/H2O-32 %module_name=CP2K/2023.1-foss-2023a %scale=1_node /ae4db8cc @BotBuildTests:default+default
P: time: 13.353 s (r:0, l:None, u:None)
[       OK ] ( 2/13) EESSI_ESPRESSO_LJ_PARTICLES %module_name=ESPResSo/4.2.2-foss-2023b %device_type=cpu %scale=1_node /adc964f6 @BotBuildTests:default+default
P: perf: 0.001418 s/step (r:0, l:None, u:None)
[       OK ] ( 3/13) EESSI_ESPRESSO_LJ_PARTICLES %module_name=ESPResSo/4.2.2-foss-2023a %device_type=cpu %scale=1_node /3b8b8926 @BotBuildTests:default+default
P: perf: 0.001405 s/step (r:0, l:None, u:None)
[       OK ] ( 4/13) EESSI_ESPRESSO_LJ_PARTICLES %module_name=ESPResSo/4.2.1-foss-2023a %device_type=cpu %scale=1_node /fdd6aced @BotBuildTests:default+default
P: perf: 0.001399 s/step (r:0, l:None, u:None)
[       OK ] ( 5/13) EESSI_ESPRESSO_P3M_IONIC_CRYSTALS %module_name=ESPResSo/4.2.2-foss-2023b %device_type=cpu %scale=1_node /3b90ffd6 @BotBuildTests:default+default
P: perf: 2.691 s/step (r:0, l:None, u:None)
[       OK ] ( 6/13) EESSI_ESPRESSO_P3M_IONIC_CRYSTALS %module_name=ESPResSo/4.2.2-foss-2023a %device_type=cpu %scale=1_node /f1621689 @BotBuildTests:default+default
P: perf: 2.711 s/step (r:0, l:None, u:None)
[       OK ] ( 7/13) EESSI_ESPRESSO_P3M_IONIC_CRYSTALS %module_name=ESPResSo/4.2.1-foss-2023a %device_type=cpu %scale=1_node /4a9e965c @BotBuildTests:default+default
P: perf: 2.604 s/step (r:0, l:None, u:None)
[       OK ] ( 8/13) EESSI_GROMACS %benchmark_info=HECBioSim/Crambin %nb_impl=cpu %scale=1_node %module_name=GROMACS/2024.1-foss-2023b /02920241 @BotBuildTests:default+default
P: perf: 166.451 ns/day (r:0, l:None, u:None)
[       OK ] ( 9/13) EESSI_OSU_Micro_Benchmarks_coll %benchmark_info=mpi.collective.osu_allreduce %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /31ac6ab9 @BotBuildTests:default+default
P: latency: 3.47 us (r:0, l:None, u:None)
[       OK ] (10/13) EESSI_OSU_Micro_Benchmarks_coll %benchmark_info=mpi.collective.osu_alltoall %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /10e66fba @BotBuildTests:default+default
P: latency: 10.54 us (r:0, l:None, u:None)
[       OK ] (11/13) EESSI_OSU_Micro_Benchmarks_pt2pt %benchmark_info=mpi.pt2pt.osu_latency %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /c8c9aff5 @BotBuildTests:default+default
P: latency: 0.28 us (r:0, l:None, u:None)
[       OK ] (12/13) EESSI_OSU_Micro_Benchmarks_pt2pt %benchmark_info=mpi.pt2pt.osu_bw %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /48da21c5 @BotBuildTests:default+default
P: bandwidth: 48238.08 MB/s (r:0, l:None, u:None)
[       OK ] (13/13) EESSI_TensorFlow %scale=1_node %module_name=TensorFlow/2.13.0-foss-2023a %device_type=cpu /9864d0f5 @BotBuildTests:default+default
P: perf: 58239.572363745974 img/s (r:0, l:None, u:None)
[----------] all spawned checks have finished

[  PASSED  ] Ran 13/13 test case(s) from 13 check(s) (0 failure(s), 0 skipped, 0 aborted)
[==========] Finished on Mon Aug 19 10:35:46 2024
Log file(s) saved in '/project/60006/SHARED/jobs/2024.08/pr_670/event_9db398f0-5e12-11ef-9aef-c19e8c12e4b6/run_000/linux_x86_64_amd_zen4/eessi.io-2023.06-software/reframe_runs/logs/reframe_20240819_100712.log'

…statements that were inserted just to debug this particular issue

casparvl · 2024-08-19T12:39:57Z

Try once more, after some more changes for easier debugging in the future...

casparvl · 2024-08-19T12:40:00Z

bot: build repo:eessi.io-2023.06-software arch:zen4

eessi-bot · 2024-08-19T12:40:03Z

Updates by the bot instance eessi-bot-mc-aws (click for details)

received bot command build repo:eessi.io-2023.06-software arch:zen4 from casparvl
- expanded format: build repository:eessi.io-2023.06-software architecture:zen4
handling command build repository:eessi.io-2023.06-software architecture:zen4 resulted in:
- no jobs were submitted

eessi-bot · 2024-08-19T12:40:03Z

Updates by the bot instance eessi-bot-mc-azure (click for details)

received bot command build repo:eessi.io-2023.06-software arch:zen4 from casparvl
- expanded format: build repository:eessi.io-2023.06-software architecture:zen4
handling command build repository:eessi.io-2023.06-software architecture:zen4 resulted in:
- submitted job 217, for details & status see Fix test_suite not being able to retrieve memory on systems that use cgroups v2 #670 (comment)

eessi-bot · 2024-08-19T12:40:08Z

New job on instance eessi-bot-mc-azure for architecture x86_64-amd-zen4 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.08/pr_670/217

date	job status	comment
Aug 19 12:40:06 UTC 2024	submitted	job id `217` awaits release by job manager
Aug 19 12:40:53 UTC 2024	released	job awaits launch by Slurm scheduler
Aug 19 12:44:57 UTC 2024	running	job `217` is running
Aug 19 13:17:08 UTC 2024	finished	😢 FAILURE (click triangle for details) Details ✅ job output file `slurm-217.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts Details No artefacts were created or found.
Aug 19 13:17:08 UTC 2024	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ PASSED ] Ran 13/13 test case(s) from 13 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-217.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`

casparvl · 2024-08-19T13:43:10Z

Ok, this is better, we now also print the detected parameters and final config file. That makes for much easier debugging:

Collecting system-specific input for the ReFrame configuration file
Detected CPU count: 24
Detected socket count: 2
Detected threads per core: 1
Detected cores per socket: 12
Detected available memory: 773514 MiB
Replacing detected system information in template ReFrame config file...
Final config file (after replacements):
# WARNING: this file is intended as template and the __X__ template variables need to be replaced
# before it can act as a configuration file
# Once replaced, this is a config file for running tests after the build phase, by the bot

from eessi.testsuite.common_config import common_logging_config
from eessi.testsuite.constants import *  # noqa: F403


site_configuration = {
    'systems': [
        {
            'name': 'BotBuildTests',
            'descr': 'Software-layer bot',
            'hostnames': ['.*'],
            'modules_system': 'lmod',
            'partitions': [
                {
                    'name': 'default',
                    'scheduler': 'local',
                    'launcher': 'mpirun',
                    'environs': ['default'],
                    'features': [
                        FEATURES[CPU]
                    ] + list(SCALES.keys()),
                    'processor': {
                        'num_cpus': 24,
                        'num_sockets': 2,
                        'num_cpus_per_core': 1,
                        'num_cpus_per_socket': 12,
                    },
                    'resources': [
                        {
                            'name': 'memory',
                            'options': ['--mem={size}'],
                        }
                    ],
                    'extras': {
                        # Make sure to round down, otherwise a job might ask for more mem than is available
                        # per node
                        'mem_per_node': 773514,
                    },
                    'max_jobs': 1
                    }
                ]
            }
        ],
    'environments': [
        {
            'name': 'default',
            'cc': 'cc',
            'cxx': '',
            'ftn': ''
            }
        ],
    'general': [
        {
            'purge_environment': True,
            'resolve_module_conflicts': False,  # avoid loading the module before submitting the job
            # disable automatic detection of CPU architecture (since we're using local scheduler)
            'remote_detect': False,
        }
    ],
    'logging': common_logging_config(),
}

casparvl · 2024-08-19T13:44:03Z

And the actual test step for this one looks perfect:

[----------] start processing checks
[ RUN      ] EESSI_CP2K %benchmark_info=QS/H2O-32 %module_name=CP2K/2023.1-foss-2023a %scale=1_node /ae4db8cc @BotBuildTests:default+default
ESC[33mWARNING: hooks.req_memory_per_node does not support the scheduler you configured (local). The test will run, but since it doesn't request the required amount of memory explicitely, it may result in an out-of-memory error. Please expand the functionality of hooks.req_memory_per_n
ode for your scheduler.ESC[0m
[ RUN      ] EESSI_ESPRESSO_LJ_PARTICLES %module_name=ESPResSo/4.2.2-foss-2023b %device_type=cpu %scale=1_node /adc964f6 @BotBuildTests:default+default
ESC[33mWARNING: hooks.req_memory_per_node does not support the scheduler you configured (local). The test will run, but since it doesn't request the required amount of memory explicitely, it may result in an out-of-memory error. Please expand the functionality of hooks.req_memory_per_n
ode for your scheduler.ESC[0m
[ RUN      ] EESSI_ESPRESSO_LJ_PARTICLES %module_name=ESPResSo/4.2.2-foss-2023a %device_type=cpu %scale=1_node /3b8b8926 @BotBuildTests:default+default
ESC[33mWARNING: hooks.req_memory_per_node does not support the scheduler you configured (local). The test will run, but since it doesn't request the required amount of memory explicitely, it may result in an out-of-memory error. Please expand the functionality of hooks.req_memory_per_n
ode for your scheduler.ESC[0m
[ RUN      ] EESSI_ESPRESSO_LJ_PARTICLES %module_name=ESPResSo/4.2.1-foss-2023a %device_type=cpu %scale=1_node /fdd6aced @BotBuildTests:default+default
ESC[33mWARNING: hooks.req_memory_per_node does not support the scheduler you configured (local). The test will run, but since it doesn't request the required amount of memory explicitely, it may result in an out-of-memory error. Please expand the functionality of hooks.req_memory_per_n
ode for your scheduler.ESC[0m
[ RUN      ] EESSI_ESPRESSO_P3M_IONIC_CRYSTALS %module_name=ESPResSo/4.2.2-foss-2023b %device_type=cpu %scale=1_node /3b90ffd6 @BotBuildTests:default+default
ESC[33mWARNING: hooks.req_memory_per_node does not support the scheduler you configured (local). The test will run, but since it doesn't request the required amount of memory explicitely, it may result in an out-of-memory error. Please expand the functionality of hooks.req_memory_per_n
ode for your scheduler.ESC[0m
[ RUN      ] EESSI_ESPRESSO_P3M_IONIC_CRYSTALS %module_name=ESPResSo/4.2.2-foss-2023a %device_type=cpu %scale=1_node /f1621689 @BotBuildTests:default+default
ESC[33mWARNING: hooks.req_memory_per_node does not support the scheduler you configured (local). The test will run, but since it doesn't request the required amount of memory explicitely, it may result in an out-of-memory error. Please expand the functionality of hooks.req_memory_per_n
ode for your scheduler.ESC[0m
[ RUN      ] EESSI_ESPRESSO_P3M_IONIC_CRYSTALS %module_name=ESPResSo/4.2.1-foss-2023a %device_type=cpu %scale=1_node /4a9e965c @BotBuildTests:default+default
ESC[33mWARNING: hooks.req_memory_per_node does not support the scheduler you configured (local). The test will run, but since it doesn't request the required amount of memory explicitely, it may result in an out-of-memory error. Please expand the functionality of hooks.req_memory_per_n
ode for your scheduler.ESC[0m
[ RUN      ] EESSI_GROMACS %benchmark_info=HECBioSim/Crambin %nb_impl=cpu %scale=1_node %module_name=GROMACS/2024.1-foss-2023b /02920241 @BotBuildTests:default+default
[ RUN      ] EESSI_OSU_Micro_Benchmarks_coll %benchmark_info=mpi.collective.osu_allreduce %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /31ac6ab9 @BotBuildTests:default+default
[ RUN      ] EESSI_OSU_Micro_Benchmarks_coll %benchmark_info=mpi.collective.osu_alltoall %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /10e66fba @BotBuildTests:default+default
[ RUN      ] EESSI_OSU_Micro_Benchmarks_pt2pt %benchmark_info=mpi.pt2pt.osu_latency %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /c8c9aff5 @BotBuildTests:default+default
[ RUN      ] EESSI_OSU_Micro_Benchmarks_pt2pt %benchmark_info=mpi.pt2pt.osu_bw %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /48da21c5 @BotBuildTests:default+default
[ RUN      ] EESSI_TensorFlow %scale=1_node %module_name=TensorFlow/2.13.0-foss-2023a %device_type=cpu /9864d0f5 @BotBuildTests:default+default
[       OK ] ( 1/13) EESSI_CP2K %benchmark_info=QS/H2O-32 %module_name=CP2K/2023.1-foss-2023a %scale=1_node /ae4db8cc @BotBuildTests:default+default
P: time: 13.582 s (r:0, l:None, u:None)
[       OK ] ( 2/13) EESSI_ESPRESSO_LJ_PARTICLES %module_name=ESPResSo/4.2.2-foss-2023b %device_type=cpu %scale=1_node /adc964f6 @BotBuildTests:default+default
P: perf: 0.001411 s/step (r:0, l:None, u:None)
[       OK ] ( 3/13) EESSI_ESPRESSO_LJ_PARTICLES %module_name=ESPResSo/4.2.2-foss-2023a %device_type=cpu %scale=1_node /3b8b8926 @BotBuildTests:default+default
P: perf: 0.001363 s/step (r:0, l:None, u:None)
[       OK ] ( 4/13) EESSI_ESPRESSO_LJ_PARTICLES %module_name=ESPResSo/4.2.1-foss-2023a %device_type=cpu %scale=1_node /fdd6aced @BotBuildTests:default+default
P: perf: 0.001389 s/step (r:0, l:None, u:None)
[       OK ] ( 5/13) EESSI_ESPRESSO_P3M_IONIC_CRYSTALS %module_name=ESPResSo/4.2.2-foss-2023b %device_type=cpu %scale=1_node /3b90ffd6 @BotBuildTests:default+default
P: perf: 2.683 s/step (r:0, l:None, u:None)
[       OK ] ( 6/13) EESSI_ESPRESSO_P3M_IONIC_CRYSTALS %module_name=ESPResSo/4.2.2-foss-2023a %device_type=cpu %scale=1_node /f1621689 @BotBuildTests:default+default
P: perf: 2.596 s/step (r:0, l:None, u:None)
[       OK ] ( 7/13) EESSI_ESPRESSO_P3M_IONIC_CRYSTALS %module_name=ESPResSo/4.2.1-foss-2023a %device_type=cpu %scale=1_node /4a9e965c @BotBuildTests:default+default
P: perf: 2.628 s/step (r:0, l:None, u:None)
[       OK ] ( 8/13) EESSI_GROMACS %benchmark_info=HECBioSim/Crambin %nb_impl=cpu %scale=1_node %module_name=GROMACS/2024.1-foss-2023b /02920241 @BotBuildTests:default+default
P: perf: 166.709 ns/day (r:0, l:None, u:None)
[       OK ] ( 9/13) EESSI_OSU_Micro_Benchmarks_coll %benchmark_info=mpi.collective.osu_allreduce %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /31ac6ab9 @BotBuildTests:default+default
P: latency: 3.67 us (r:0, l:None, u:None)
[       OK ] (10/13) EESSI_OSU_Micro_Benchmarks_coll %benchmark_info=mpi.collective.osu_alltoall %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /10e66fba @BotBuildTests:default+default
P: latency: 10.48 us (r:0, l:None, u:None)
[       OK ] (11/13) EESSI_OSU_Micro_Benchmarks_pt2pt %benchmark_info=mpi.pt2pt.osu_latency %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /c8c9aff5 @BotBuildTests:default+default
P: latency: 0.3 us (r:0, l:None, u:None)
[       OK ] (12/13) EESSI_OSU_Micro_Benchmarks_pt2pt %benchmark_info=mpi.pt2pt.osu_bw %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /48da21c5 @BotBuildTests:default+default
P: bandwidth: 44334.1 MB/s (r:0, l:None, u:None)
[       OK ] (13/13) EESSI_TensorFlow %scale=1_node %module_name=TensorFlow/2.13.0-foss-2023a %device_type=cpu /9864d0f5 @BotBuildTests:default+default
P: perf: 59672.899852645496 img/s (r:0, l:None, u:None)
[----------] all spawned checks have finished

[  PASSED  ] Ran 13/13 test case(s) from 13 check(s) (0 failure(s), 0 skipped, 0 aborted)

boegel

lgtm

Fix test_suite not being able to retrieve memory on systems that use …

53d5e26

…cgroups v2

casparvl added the bug Something isn't working label Aug 14, 2024

Add something in order to prove that this fixes the test

936edb8

Fix if-else syntax

4e52f59

If max is specified in the cgroupsv2 file, just get the system memory

33a8a87

Correct bash test

e69642c

Caspar van Leeuwen added 3 commits August 19, 2024 11:35

Add gnuplot back in as test build

ab203e2

Remove ReFrame, as that was now build and deployed in a separate PR

cd0c6c6

These files belonged to another PR...

6f63aea

Remove gnuplot again, it was already present...

4fef822

Be a bit more verbose, for easier debugging of future issues. Remove …

634abb0

…statements that were inserted just to debug this particular issue

casparvl marked this pull request as ready for review August 19, 2024 13:44

boegel approved these changes Aug 19, 2024

View reviewed changes

boegel merged commit d813eda into EESSI:2023.06-software.eessi.io Aug 19, 2024

casparvl mentioned this pull request Aug 20, 2024

Fix failing test step on AWS #678

Merged

casparvl deleted the fix_testsuite_azure branch August 21, 2024 14:29

Conversation

casparvl commented Aug 14, 2024

Uh oh!

eessi-bot Bot commented Aug 14, 2024

Uh oh!

eessi-bot Bot commented Aug 14, 2024

Uh oh!

eessi-build-deploy-bot-deucalion Bot commented Aug 14, 2024

Uh oh!

casparvl commented Aug 14, 2024

Uh oh!

eessi-bot Bot commented Aug 14, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot Bot commented Aug 14, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot Bot commented Aug 14, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-build-deploy-bot-deucalion Bot commented Aug 14, 2024

Uh oh!

casparvl commented Aug 14, 2024

Uh oh!

eessi-bot Bot commented Aug 14, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot Bot commented Aug 14, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot Bot commented Aug 14, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-build-deploy-bot-deucalion Bot commented Aug 14, 2024

Uh oh!

casparvl commented Aug 14, 2024

Uh oh!

casparvl commented Aug 15, 2024

Uh oh!

eessi-bot Bot commented Aug 15, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot Bot commented Aug 15, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-build-deploy-bot-deucalion Bot commented Aug 15, 2024

Uh oh!

eessi-bot Bot commented Aug 15, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

casparvl commented Aug 15, 2024

Uh oh!

eessi-bot Bot commented Aug 15, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot Bot commented Aug 15, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot Bot commented Aug 15, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-build-deploy-bot-deucalion Bot commented Aug 15, 2024

Uh oh!

eessi-build-deploy-bot-deucalion Bot commented Aug 15, 2024

Uh oh!

eessi-bot Bot commented Aug 15, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

casparvl commented Aug 15, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

casparvl commented Aug 15, 2024

Uh oh!

casparvl commented Aug 19, 2024

Uh oh!

eessi-bot Bot commented Aug 19, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot Bot commented Aug 19, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

eessi-bot Bot commented Aug 14, 2024 •

edited

Loading

eessi-bot Bot commented Aug 14, 2024 •

edited

Loading

eessi-bot Bot commented Aug 14, 2024 •

edited

Loading

eessi-bot Bot commented Aug 14, 2024 •

edited

Loading

eessi-bot Bot commented Aug 14, 2024 •

edited

Loading

eessi-bot Bot commented Aug 14, 2024 •

edited

Loading

eessi-bot Bot commented Aug 15, 2024 •

edited

Loading

eessi-bot Bot commented Aug 15, 2024 •

edited

Loading

eessi-bot Bot commented Aug 15, 2024 •

edited

Loading

eessi-bot Bot commented Aug 15, 2024 •

edited

Loading

eessi-bot Bot commented Aug 15, 2024 •

edited

Loading

eessi-bot Bot commented Aug 15, 2024 •

edited

Loading

eessi-bot Bot commented Aug 15, 2024 •

edited

Loading

casparvl commented Aug 15, 2024 •

edited

Loading

eessi-bot Bot commented Aug 19, 2024 •

edited

Loading

eessi-bot Bot commented Aug 19, 2024 •

edited

Loading

eessi-bot Bot commented Aug 19, 2024 •

edited

Loading

eessi-bot Bot commented Aug 19, 2024 •

edited

Loading

eessi-bot Bot commented Aug 19, 2024 •

edited

Loading

eessi-bot Bot commented Aug 19, 2024 •

edited

Loading

eessi-bot Bot commented Aug 19, 2024 •

edited

Loading

eessi-bot Bot commented Aug 19, 2024 •

edited

Loading

eessi-bot Bot commented Aug 19, 2024 •

edited

Loading