CI: Move Ubuntu 20.04 workflows to 22.04 by franzpoeschel · Pull Request #1731 · openPMD/openPMD-api

franzpoeschel · 2025-03-05T10:01:16Z

Ubuntu 20.04 runners shutting down April 1st

This reverts commit c290fc6.

.github/ci/spack-envs/clang12_py38_mpich_h5_ad2/spack.yaml

if you want it or not

This reverts commit 672570f.

ax3l · 2025-03-21T00:08:03Z

Oh, there is an MPICH bug marked as conflict for the exact MPICH and HDF5 combination we have here.
https://github.com/spack/spack/blob/c79b6207e88b765f9f01401f8145c17746457d09/var/spack/repos/builtin/packages/hdf5/package.py#L156

Let's go to Ubuntu 24.04 then for this runner?

ax3l · 2025-03-21T00:19:18Z

I will remove ICC as well with this PR, since it is EOL for 1.5 years or so :)
ICX is the new compiler.

MPICH alone seems hard enough

franzpoeschel · 2025-03-21T14:17:36Z

Wow, the last change definitely worked for my local docker attempt...

I feel your pain

ax3l · 2025-03-21T15:38:25Z

I simplified the test now to only test MPICH with GCC.

Currently it seems to work but the ParallelIO test fails with:

[Fri Mar 21 08:10:04 2025] [ADIOS2 EXCEPTION] <Toolkit>
  <format::BP5Deserializer> <InstallAttributeData> : Internal error or file
  corruption, no know format for Attribute Block

which I am not sure if it is a new MPICH issue or just a compiler build stack issue that we still need to solve in CI (more likely?)

ax3l · 2025-03-21T15:39:10Z

In doubt, if we cannot fix this today, we can exlcude this one runner and add a separate PR that adds again a regular system GCC + system MPICH test to have it (MPICH) covered.

franzpoeschel · 2025-03-21T15:48:39Z

Thank you for fixing the MPICH setup!
I don't think I ever saw this error. I can try investigating that next week, so let's maybe exlude the runner for the moment.

ax3l · 2025-03-21T21:40:22Z

Sounds good! Can you open a PR after this is merged that simply undo's the last commit I added here? :)

ax3l · 2025-03-21T22:25:58Z

Yeah MPICH coverage is pretty important because we use it on all Cray/HPE systems (Frontier, Perlmutter, etc.) So let us definitely try to add one or two versions we can cover for it (and be aware of the HDF5 with MPICH 4.0 issues that Spack documents, no need to support that combination then).

* RTD: Fix GA Integration (#1718) GA was dropped from RTD in early Oct, 2024. This adds it again. * CI: Move Ubuntu 20.04 workflows to 22.04 (#1731) * Reactivate MPICH runner (gcc13_py312_mpich_h5_ad2) (#1739) * Revert "CI: Disable MPICH for now" This reverts commit de9e7ad. * We shall try installin MPICH from Spack for now Ubuntu package broken https://bugs.launchpad.net/ubuntu/+source/mpich/+bug/2072338 * Take out version checks * Revert "Take out version checks" This reverts commit b22e4b3. * Revert "We shall try installin MPICH from Spack for now" This reverts commit 33b847f. * Alternative approach: self-compiled MPICH * Move MPICH installation to separate file * Fix broken CI: Support for old CMake versions (#1742) * Check for broken CI * Deactivate dependencies that are not yet compatible with CMake 4.0 * Fixes * Upgrade Spack * Fix warning * Fixes after upgrading spack --------- Co-authored-by: Axel Huebl <axel.huebl@plasma.ninja>

Move Ubuntu 20.04 workflows to 22.04

f6a19c5

franzpoeschel added the continuous integration label Mar 5, 2025

franzpoeschel added 5 commits March 5, 2025 11:51

Upgrade linux and tooling runs to newer compiler versions

894bde9

Use Cuda PPA for Ubuntu 22.04

fa73284

Raise spack to 0.23.1

c290fc6

Fix clangsanitizer

ddb7be2

Update spack envs

5a0355b

franzpoeschel force-pushed the ci-ubuntu-22.04 branch from ef49f6b to 5a0355b Compare March 5, 2025 11:35

Revert "Raise spack to 0.23.1"

8455ac9

This reverts commit c290fc6.

franzpoeschel force-pushed the ci-ubuntu-22.04 branch from 34da3d0 to abbb2a1 Compare March 5, 2025 16:13

Fixes

fe7ad38

franzpoeschel force-pushed the ci-ubuntu-22.04 branch 2 times, most recently from 4fd5250 to fc589e4 Compare March 5, 2025 17:09

Use mpicc/mpic++ in MPICH run

58bb445

franzpoeschel force-pushed the ci-ubuntu-22.04 branch from fc589e4 to 58bb445 Compare March 5, 2025 17:53

franzpoeschel commented Mar 5, 2025

View reviewed changes

.github/ci/spack-envs/clang12_py38_mpich_h5_ad2/spack.yaml Outdated Show resolved Hide resolved

franzpoeschel added 2 commits March 5, 2025 19:27

Update .github/ci/spack-envs/clang12_py38_mpich_h5_ad2/spack.yaml

9789d6d

You will accept clang as your MPI compiler

5a389d5

if you want it or not

franzpoeschel force-pushed the ci-ubuntu-22.04 branch from 6c91209 to 5a389d5 Compare March 6, 2025 13:38

franzpoeschel added 7 commits March 6, 2025 14:40

Remove debugging output from previous commit

cdfd785

Try sth

672570f

Fix clang-tidy

3158358

Revert "Try sth"

9a18aa8

This reverts commit 672570f.

Try sth else

29eb41a

Right place to disable clang-tidy checks

2da3e52

Try requiring MPI

2ab1f4b

franzpoeschel force-pushed the ci-ubuntu-22.04 branch from bc529e6 to f292b80 Compare March 6, 2025 16:29

????????????

7a94265

franzpoeschel force-pushed the ci-ubuntu-22.04 branch from f292b80 to 7a94265 Compare March 6, 2025 16:35

?

94336f8

ax3l added 2 commits March 20, 2025 16:37

Modernize CTest: Use --test-dir

1c007b8

Spack Spec: Add +mpi

5da0673

ax3l force-pushed the ci-ubuntu-22.04 branch from b37e136 to 90705c6 Compare March 21, 2025 00:12

Bump MPICH Runner to Ubuntu 24.04

f72f59b

ax3l force-pushed the ci-ubuntu-22.04 branch from 90705c6 to f72f59b Compare March 21, 2025 00:17

Remove ICC

10aaf80

ax3l force-pushed the ci-ubuntu-22.04 branch 3 times, most recently from 86cc5e0 to 87f1397 Compare March 21, 2025 06:43

More Clang14

92ff147

ax3l force-pushed the ci-ubuntu-22.04 branch from 87f1397 to 92ff147 Compare March 21, 2025 07:21

ax3l added 2 commits March 21, 2025 00:45

Clang -> GCC

b9c4243

MPICH alone seems hard enough

GH: 4 vcores on Linux Now

b9d5266

ax3l force-pushed the ci-ubuntu-22.04 branch from 3c3cf8f to b9d5266 Compare March 21, 2025 07:49

CI: Disable MPICH for now

de9e7ad

ax3l approved these changes Mar 21, 2025

View reviewed changes

ax3l enabled auto-merge (squash) March 21, 2025 22:24

ax3l merged commit a258128 into openPMD:dev Mar 21, 2025
30 checks passed

franzpoeschel mentioned this pull request Mar 24, 2025

Reactivate MPICH runner (gcc13_py312_mpich_h5_ad2) #1739

Merged

franzpoeschel added a commit that referenced this pull request Jun 3, 2025

CI: Move Ubuntu 20.04 workflows to 22.04 (#1731)

b800efd

franzpoeschel mentioned this pull request Jun 3, 2025

Release branch 0.16.2: Backport recent CI fixes #1758

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

CI: Move Ubuntu 20.04 workflows to 22.04#1731

CI: Move Ubuntu 20.04 workflows to 22.04#1731
ax3l merged 40 commits intoopenPMD:devfrom
franzpoeschel:ci-ubuntu-22.04

franzpoeschel commented Mar 5, 2025

Uh oh!

Uh oh!

ax3l commented Mar 21, 2025

Uh oh!

ax3l commented Mar 21, 2025

Uh oh!

franzpoeschel commented Mar 21, 2025

Uh oh!

ax3l commented Mar 21, 2025

Uh oh!

ax3l commented Mar 21, 2025

Uh oh!

franzpoeschel commented Mar 21, 2025

Uh oh!

ax3l commented Mar 21, 2025

Uh oh!

ax3l commented Mar 21, 2025 •

edited

Loading

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Conversation

franzpoeschel commented Mar 5, 2025

Uh oh!

Uh oh!

ax3l commented Mar 21, 2025

Uh oh!

ax3l commented Mar 21, 2025

Uh oh!

franzpoeschel commented Mar 21, 2025

Uh oh!

ax3l commented Mar 21, 2025

Uh oh!

ax3l commented Mar 21, 2025

Uh oh!

franzpoeschel commented Mar 21, 2025

Uh oh!

ax3l commented Mar 21, 2025

Uh oh!

ax3l commented Mar 21, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

ax3l commented Mar 21, 2025 •

edited

Loading