Skip to content

Optionally add links to load_compass_env.sh in test cases#492

Merged
mark-petersen merged 10 commits intoMPAS-Dev:ocean/developfrom
xylar:add_load_compass_env_to_test_cases
Apr 10, 2020
Merged

Optionally add links to load_compass_env.sh in test cases#492
mark-petersen merged 10 commits intoMPAS-Dev:ocean/developfrom
xylar:add_load_compass_env_to_test_cases

Conversation

@xylar
Copy link
Collaborator

@xylar xylar commented Mar 26, 2020

This is specified either in the config file or at the command line.

Like #480, this involves changes to common COMPASS infrastructure and we should consider making a separate PR to develop instead of merging those changes to ocean/develop.

closes #490

Copy link

@sbrus89 sbrus89 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@xylar, I tested setting up cases with both the command line and config file options. In both cases, the load_compass_env.sh links worked for me (with the exception that compass_0.1.3 isn't available at this point).

I didn't test the changes in build_mesh.py, cull_mesh.py, and create_E3SM_coupling_file.py. Should these changes come in via a different PR?

Thanks for adding this feature!

@xylar
Copy link
Collaborator Author

xylar commented Apr 4, 2020

@sbrus89, thanks for testing! Yes, you're right, this will only work with compass_0.1.3, which is waiting for #480.

Also, the other file edits you mention are from #480, which this PR is based off of. Sorry for not mentioning that before.

xylar added 10 commits April 8, 2020 09:08
This merge moves soma/4km/32to4km and soma/8km/32to8km test cases
into a new subdirectory called "broken" since these test cases are
not working and won't be fixed anytime soon.  With this change,
`./list_testcases.py` and `./setup_testcases.py` won't pick up
these tests because their driver config files aren't at the
expected directory level.
The Maine, QU60 and SOQU60to15 test cases now have the links to
the python script for defining their vertical grids that they need
to be set up successfully.
We no longer define a path to metis in the config file, so the
version from the conda environment needs to be used instead.
Add support for a "conda_mpi" attribute to "step" tags. If this
attribute is set to "true" and MPI is present in the conda
environment, that command will be called with `mpirun` from
the conda envrionment.

This is needed to support compass conda enviornments with mpich.
Python scripts and modules that use the netcdf4 package with
mpich support don't work properly on many compute nodes (e.g.
Grizzly at LANL and Anvil at ANL) unless they are prefixed with
`mpirun -np 1`
The paraview extractor can now be called as a function rather
than a script, and this is done during base-mesh generation
and culling.

SCRIP files can now also be created with a function, so a script
call is replaced with a function here as well.

With these changes, calls to python scripts that use NetCDF in
the parallel conda enviornment will now work as long as they
are called with `mpirun -np 1`
Also rename the load script for convenience.
This will make sure the compatible version of MPI gets used.
Since we can't detect automatically that this is a python script,
(and that it needs to support compass mpi) we need to say so
explicitly
This is specified either in the config file or at the command
line.
@xylar xylar force-pushed the add_load_compass_env_to_test_cases branch from c6099b4 to 0c49222 Compare April 10, 2020 12:49
@xylar
Copy link
Collaborator Author

xylar commented Apr 10, 2020

@mark-petersen, this has been rebased onto #480 and should also now be ready for testing and merge.

@xylar xylar removed the in progress label Apr 10, 2020
Copy link
Contributor

@mark-petersen mark-petersen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good. Passes nightly test suite with new compass tag.

@mark-petersen mark-petersen merged commit 3d8d35c into MPAS-Dev:ocean/develop Apr 10, 2020
@xylar xylar deleted the add_load_compass_env_to_test_cases branch April 10, 2020 18:40
caozd999 pushed a commit to caozd999/MPAS-Model that referenced this pull request Jan 14, 2021
… ocean/develop

Optionally add links to load_compass_env.sh in test cases MPAS-Dev#492

This is specified either in the config file or at the command line.

Like MPAS-Dev#480, this involves changes to common COMPASS infrastructure and we
should consider making a separate PR to develop instead of merging those
changes to ocean/develop.

closes MPAS-Dev#490
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants