Skip to content

Add cylc-flow, cylc-rose, cylc-uiserver, bump Python to 3.10.13#894

Merged
climbfuji merged 76 commits intoJCSDA:developfrom
climbfuji:feature/add_cylc_flow
Dec 14, 2023
Merged

Add cylc-flow, cylc-rose, cylc-uiserver, bump Python to 3.10.13#894
climbfuji merged 76 commits intoJCSDA:developfrom
climbfuji:feature/add_cylc_flow

Conversation

@climbfuji
Copy link
Copy Markdown
Collaborator

@climbfuji climbfuji commented Dec 7, 2023

Summary

Necessary config and spack submodule pointer updates for adding cylc-flow, cylc-rose, cylc-uiserver.

Along with this, bump Python to version 3.10.13 (see JCSDA/spack#377 for some background information on why we can use newer Python versions than 3.9 with cylc in spack-stack. This Python version is also compatible with what is requested in #887.

I removed several legacy versions for Python packages as part of this process, since I ran into problems with duplicate packages.

Testing

  • Tested locally on @climbfuji's macOS: All three packages build, I could run a basic cylc suite and create a graph as png. I could also launch the cylc jupyterhub server and dashboard.
  • I repeated this on AWS ParallelCluster with Intel
  • CI tests pass
  • Todo @BenjaminRuston Is going to test the cylc installation for Intel on AWS ParallelCluster with his codes
  • @climbfuji ran the following jedi/skylab tests to make sure the updated versions of Python packages are ok
    • qg-fullDA.yaml
    • l95-fullDA.yaml
  • Todo? Does EPIC or EMC want to run tests with this code for UFS SRW App / UFS Weather Model / ... ? @ulmononian @AlexanderRichert-NOAA @DavidHuber-NOAA ?

Note When we install this on the HPCs, we will need to add sed as an external package, and possibly do the same in the instructions for generating new site configs for Linux (probably not macOS, because the spack package that asks for sed will want gnu-sed and not macOS-sed). See #904

Applications affected

n/a

Systems affected

All systems that use the unified-dev or skylab-dev templates.

Dependencies

Issue(s) addressed

Working towards #242
Resolves #887

Checklist

  • This PR addresses one issue/problem/enhancement, or has a very good reason for not doing so.
  • These changes have been tested on the affected systems and applications.
  • All dependency PRs/issues have been resolved and this PR can be merged.

Copy link
Copy Markdown
Collaborator

@RatkoVasic-NOAA RatkoVasic-NOAA left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approved (don't forget .gitmodules)

@DavidHuber-NOAA
Copy link
Copy Markdown
Collaborator

Thanks for the Python version bump!

@climbfuji climbfuji marked this pull request as ready for review December 13, 2023 16:39
Copy link
Copy Markdown

@BenjaminRuston BenjaminRuston left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

was able to use cylc8 for basic think,, register a suite and play it (not run) and also viewed status using both workflow-state and tui

the output of tui is shown below:
image

@climbfuji
Copy link
Copy Markdown
Collaborator Author

was able to use cylc8 for basic think,, register a suite and play it (not run) and also viewed status using both workflow-state and tui

the output of tui is shown below: image

Brilliant, thanks very much for testing @BenjaminRuston !

Copy link
Copy Markdown
Collaborator

@AlexanderRichert-NOAA AlexanderRichert-NOAA left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Concretizes fine on acorn & orion, tested a couple python-based packages and all looks good. Didn't test met/metplus.

@climbfuji climbfuji merged commit a5a5c11 into JCSDA:develop Dec 14, 2023
@climbfuji climbfuji deleted the feature/add_cylc_flow branch March 24, 2026 22:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

INFRA JEDI Infrastructure

Projects

No open projects

Development

Successfully merging this pull request may close these issues.

[INSTALL]: Python 3.10.12+

7 participants