testing PR #518: build something, remove something, ... by trz42 · Pull Request #519 · EESSI/software-layer

trz42 · 2024-03-27T09:56:08Z

We run the following scenarios for testing #518:

Build a new package pypmt-1.2.0-gfbf-2023a.eb
Remove and rebuild an existing package patchelf-0.18.0-GCCcore-12.3.0.eb
Remove and rebuild an existing package patchelf-0.18.0-GCCcore-12.3.0.eb AND build a new package pypmt-1.2.0-gfbf-2023a.eb

eessi-bot · 2024-03-27T09:56:12Z

Instance eessi-bot-mc-aws is configured to build:

arch x86_64/generic for repo eessi-hpc.org-2023.06-compat
arch x86_64/generic for repo eessi-hpc.org-2023.06-software
arch x86_64/generic for repo eessi.io-2023.06-compat
arch x86_64/generic for repo eessi.io-2023.06-software
arch x86_64/intel/haswell for repo eessi-hpc.org-2023.06-compat
arch x86_64/intel/haswell for repo eessi-hpc.org-2023.06-software
arch x86_64/intel/haswell for repo eessi.io-2023.06-compat
arch x86_64/intel/haswell for repo eessi.io-2023.06-software
arch x86_64/intel/skylake_avx512 for repo eessi-hpc.org-2023.06-compat
arch x86_64/intel/skylake_avx512 for repo eessi-hpc.org-2023.06-software
arch x86_64/intel/skylake_avx512 for repo eessi.io-2023.06-compat
arch x86_64/intel/skylake_avx512 for repo eessi.io-2023.06-software
arch x86_64/amd/zen2 for repo eessi-hpc.org-2023.06-compat
arch x86_64/amd/zen2 for repo eessi-hpc.org-2023.06-software
arch x86_64/amd/zen2 for repo eessi.io-2023.06-compat
arch x86_64/amd/zen2 for repo eessi.io-2023.06-software
arch x86_64/amd/zen3 for repo eessi-hpc.org-2023.06-compat
arch x86_64/amd/zen3 for repo eessi-hpc.org-2023.06-software
arch x86_64/amd/zen3 for repo eessi.io-2023.06-compat
arch x86_64/amd/zen3 for repo eessi.io-2023.06-software
arch aarch64/generic for repo eessi-hpc.org-2023.06-compat
arch aarch64/generic for repo eessi-hpc.org-2023.06-software
arch aarch64/generic for repo eessi.io-2023.06-compat
arch aarch64/generic for repo eessi.io-2023.06-software
arch aarch64/neoverse_n1 for repo eessi-hpc.org-2023.06-compat
arch aarch64/neoverse_n1 for repo eessi-hpc.org-2023.06-software
arch aarch64/neoverse_n1 for repo eessi.io-2023.06-compat
arch aarch64/neoverse_n1 for repo eessi.io-2023.06-software
arch aarch64/neoverse_v1 for repo eessi-hpc.org-2023.06-compat
arch aarch64/neoverse_v1 for repo eessi-hpc.org-2023.06-software
arch aarch64/neoverse_v1 for repo eessi.io-2023.06-compat
arch aarch64/neoverse_v1 for repo eessi.io-2023.06-software

trz42 · 2024-03-27T09:56:59Z

Running 1st test scenario Build a new package pypmt-1.2.0-gfbf-2023a.eb

bot: build repo:eessi.io-2023.06-software arch:zen3

eessi-bot · 2024-03-27T09:57:01Z

Updates by the bot instance eessi-bot-mc-aws (click for details)

received bot command build repo:eessi.io-2023.06-software arch:zen3 from trz42
- expanded format: build repository:eessi.io-2023.06-software architecture:zen3
handling command build repository:eessi.io-2023.06-software architecture:zen3 resulted in:
- submitted job 8661, for details & status see testing PR #518: build something, remove something, ... #519 (comment)

eessi-bot · 2024-03-27T09:57:05Z

New job on instance eessi-bot-mc-aws for architecture x86_64-amd-zen3 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.03/pr_519/8661

date	job status	comment
Mar 27 09:57:04 UTC 2024	submitted	job id `8661` awaits release by job manager
Mar 27 09:57:15 UTC 2024	released	job awaits launch by Slurm scheduler
Mar 27 10:01:17 UTC 2024	running	job `8661` is running
Mar 27 10:15:30 UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-8661.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-amd-zen3-1711533861.tar.gz` size: 0 MiB (586539 bytes) entries: 43 modules under 2023.06/software/linux/x86_64/amd/zen3/modules/all `pypmt/1.2.0-gfbf-2023a.lua` software under 2023.06/software/linux/x86_64/amd/zen3/software `pypmt/1.2.0-gfbf-2023a` other under 2023.06/software/linux/x86_64/amd/zen3 no other files in tarball
Mar 27 10:15:30 UTC 2024	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ PASSED ] Ran 9/9 test case(s) from 9 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-8661.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`

trz42 · 2024-03-27T10:38:18Z

Running 2nd test scenario: Remove and rebuild an existing package patchelf-0.18.0-GCCcore-12.3.0.eb

bot: build repo:eessi.io-2023.06-software arch:zen3

eessi-bot · 2024-03-27T10:38:21Z

Updates by the bot instance eessi-bot-mc-aws (click for details)

received bot command build repo:eessi.io-2023.06-software arch:zen3 from trz42
- expanded format: build repository:eessi.io-2023.06-software architecture:zen3
handling command build repository:eessi.io-2023.06-software architecture:zen3 resulted in:
- submitted job 8664, for details & status see testing PR #518: build something, remove something, ... #519 (comment)

eessi-bot · 2024-03-27T10:38:24Z

New job on instance eessi-bot-mc-aws for architecture x86_64-amd-zen3 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.03/pr_519/8664

date	job status	comment
Mar 27 10:38:24 UTC 2024	submitted	job id `8664` awaits release by job manager
Mar 27 10:38:34 UTC 2024	released	job awaits launch by Slurm scheduler
Mar 27 10:39:36 UTC 2024	running	job `8664` is running
Mar 27 10:51:48 UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-8664.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-amd-zen3-1711535996.tar.gz` size: 0 MiB (159920 bytes) entries: 27 modules under 2023.06/software/linux/x86_64/amd/zen3/modules/all `patchelf/0.18.0-GCCcore-12.3.0.lua` software under 2023.06/software/linux/x86_64/amd/zen3/software `patchelf/0.18.0-GCCcore-12.3.0` other under 2023.06/software/linux/x86_64/amd/zen3 no other files in tarball
Mar 27 10:51:48 UTC 2024	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ PASSED ] Ran 9/9 test case(s) from 9 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-8664.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`

trz42 · 2024-03-27T10:54:43Z

Running 3rd test scenario: Remove and rebuild an existing package patchelf-0.18.0-GCCcore-12.3.0.eb AND build a new package pypmt-1.2.0-gfbf-2023a.eb

bot: build repo:eessi.io-2023.06-software arch:zen3

eessi-bot · 2024-03-27T10:54:46Z

Updates by the bot instance eessi-bot-mc-aws (click for details)

received bot command build repo:eessi.io-2023.06-software arch:zen3 from trz42
- expanded format: build repository:eessi.io-2023.06-software architecture:zen3
handling command build repository:eessi.io-2023.06-software architecture:zen3 resulted in:
- submitted job 8665, for details & status see testing PR #518: build something, remove something, ... #519 (comment)

eessi-bot · 2024-03-27T10:54:49Z

New job on instance eessi-bot-mc-aws for architecture x86_64-amd-zen3 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.03/pr_519/8665

Failed because rebuilds were to be processed after new installations and the check for missing installations ran after the latter failed because the removed package was missing.

date	job status	comment
Mar 27 10:54:48 UTC 2024	submitted	job id `8665` awaits release by job manager
Mar 27 10:55:50 UTC 2024	released	job awaits launch by Slurm scheduler
Mar 27 10:56:52 UTC 2024	running	job `8665` is running
Mar 27 11:12:08 UTC 2024	finished	😢 FAILURE (click triangle for details) Details ✅ job output file `slurm-8665.out` ❌ found message matching `ERROR:` ✅ no message matching `FAILED:` ❌ found message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-amd-zen3-1711537200.tar.gz` size: 0 MiB (745988 bytes) entries: 70 modules under 2023.06/software/linux/x86_64/amd/zen3/modules/all `patchelf/0.18.0-GCCcore-12.3.0.lua` `pypmt/1.2.0-gfbf-2023a.lua` software under 2023.06/software/linux/x86_64/amd/zen3/software `patchelf/0.18.0-GCCcore-12.3.0` `pypmt/1.2.0-gfbf-2023a` other under 2023.06/software/linux/x86_64/amd/zen3 no other files in tarball
Mar 27 11:12:08 UTC 2024	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ PASSED ] Ran 9/9 test case(s) from 9 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-8665.out` ❌ found message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`

trz42 · 2024-03-27T13:07:20Z

Re-running 3rd test scenario after fixing processing order for easystack files (see 0d525bb): Remove and rebuild an existing package patchelf-0.18.0-GCCcore-12.3.0.eb AND build a new package pypmt-1.2.0-gfbf-2023a.eb

bot: build repo:eessi.io-2023.06-software arch:zen3

eessi-bot · 2024-03-27T13:07:23Z

Updates by the bot instance eessi-bot-mc-aws (click for details)

received bot command build repo:eessi.io-2023.06-software arch:zen3 from trz42
- expanded format: build repository:eessi.io-2023.06-software architecture:zen3
handling command build repository:eessi.io-2023.06-software architecture:zen3 resulted in:
- submitted job 8667, for details & status see testing PR #518: build something, remove something, ... #519 (comment)

eessi-bot · 2024-03-27T13:07:27Z

New job on instance eessi-bot-mc-aws for architecture x86_64-amd-zen3 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.03/pr_519/8667

date	job status	comment
Mar 27 13:07:26 UTC 2024	submitted	job id `8667` awaits release by job manager
Mar 27 13:07:54 UTC 2024	released	job awaits launch by Slurm scheduler
Mar 27 13:13:03 UTC 2024	running	job `8667` is running
Mar 27 13:24:26 UTC 2024	finished	😢 FAILURE (click triangle for details) Details ✅ job output file `slurm-8667.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ❌ no message matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts Details No artefacts were created or found.
Mar 27 13:24:26 UTC 2024	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ PASSED ] Ran 9/9 test case(s) from 9 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-8667.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`

trz42 · 2024-03-27T13:35:43Z

Re-running 3rd test scenario after fixing missing quotes: Remove and rebuild an existing package patchelf-0.18.0-GCCcore-12.3.0.eb AND build a new package pypmt-1.2.0-gfbf-2023a.eb

bot: build repo:eessi.io-2023.06-software arch:zen3

eessi-bot · 2024-03-27T13:35:45Z

Updates by the bot instance eessi-bot-mc-aws (click for details)

received bot command build repo:eessi.io-2023.06-software arch:zen3 from trz42
- expanded format: build repository:eessi.io-2023.06-software architecture:zen3
handling command build repository:eessi.io-2023.06-software architecture:zen3 resulted in:
- submitted job 8668, for details & status see testing PR #518: build something, remove something, ... #519 (comment)

eessi-bot · 2024-03-27T13:35:49Z

New job on instance eessi-bot-mc-aws for architecture x86_64-amd-zen3 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.03/pr_519/8668

date	job status	comment
Mar 27 13:35:48 UTC 2024	submitted	job id `8668` awaits release by job manager
Mar 27 13:36:44 UTC 2024	released	job awaits launch by Slurm scheduler
Mar 27 13:37:48 UTC 2024	running	job `8668` is running
Mar 27 13:52:19 UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-8668.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-amd-zen3-1711546851.tar.gz` size: 0 MiB (745591 bytes) entries: 70 modules under 2023.06/software/linux/x86_64/amd/zen3/modules/all `patchelf/0.18.0-GCCcore-12.3.0.lua` `pypmt/1.2.0-gfbf-2023a.lua` software under 2023.06/software/linux/x86_64/amd/zen3/software `patchelf/0.18.0-GCCcore-12.3.0` `pypmt/1.2.0-gfbf-2023a` other under 2023.06/software/linux/x86_64/amd/zen3 no other files in tarball
Mar 27 13:52:19 UTC 2024	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ PASSED ] Ran 9/9 test case(s) from 9 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-8668.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`

boegel · 2024-04-02T13:13:02Z

closing this, since #518 is merged & deployed

bedroge and others added 5 commits March 27, 2024 10:08

dont fail if grep doesnt find rebuild easystack files

547386f

add quotes around variable in if statement

c2fad00

use proper tmp dir for removal step

bce1067

let the tarball step resume from the right directory

4a9d9ae

testing PR EESSI#518: build something, remove something, ...

df84a75

trz42 added bug Something isn't working tests Related to software testing 2023.06-software.eessi.io 2023.06 version of software.eessi.io labels Mar 27, 2024

rebuild patchelf only

ffe4c58

build pypmt

a19a1de

first process rebuilds, then new installations

0d525bb

truib added 2 commits March 27, 2024 14:33

fixing missing quotes

2fe5291

use more quoting

dc261f3

trz42 mentioned this pull request Mar 27, 2024

Fix rebuild check in bot/build.sh script, and always resume from the correct temporary directory #518

Merged

boegel closed this Apr 2, 2024

Conversation

trz42 commented Mar 27, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot Bot commented Mar 27, 2024

Uh oh!

trz42 commented Mar 27, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot Bot commented Mar 27, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot Bot commented Mar 27, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

trz42 commented Mar 27, 2024

Uh oh!

eessi-bot Bot commented Mar 27, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot Bot commented Mar 27, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

trz42 commented Mar 27, 2024

Uh oh!

eessi-bot Bot commented Mar 27, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot Bot commented Mar 27, 2024 • edited by trz42 Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

trz42 commented Mar 27, 2024

Uh oh!

eessi-bot Bot commented Mar 27, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot Bot commented Mar 27, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

trz42 commented Mar 27, 2024

Uh oh!

eessi-bot Bot commented Mar 27, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot Bot commented Mar 27, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

boegel commented Apr 2, 2024

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

trz42 commented Mar 27, 2024 •

edited

Loading

trz42 commented Mar 27, 2024 •

edited

Loading

eessi-bot Bot commented Mar 27, 2024 •

edited

Loading

eessi-bot Bot commented Mar 27, 2024 •

edited

Loading

eessi-bot Bot commented Mar 27, 2024 •

edited

Loading

eessi-bot Bot commented Mar 27, 2024 •

edited

Loading

eessi-bot Bot commented Mar 27, 2024 •

edited

Loading

eessi-bot Bot commented Mar 27, 2024 •

edited by trz42

Loading

eessi-bot Bot commented Mar 27, 2024 •

edited

Loading

eessi-bot Bot commented Mar 27, 2024 •

edited

Loading

eessi-bot Bot commented Mar 27, 2024 •

edited

Loading

eessi-bot Bot commented Mar 27, 2024 •

edited

Loading