Skip to content

Allow rebuilding the module tree via some envvars#100

Closed
ocaisa wants to merge 12 commits intomainfrom
rebuild_module_tree
Closed

Allow rebuilding the module tree via some envvars#100
ocaisa wants to merge 12 commits intomainfrom
rebuild_module_tree

Conversation

@ocaisa
Copy link
Copy Markdown
Member

@ocaisa ocaisa commented Apr 26, 2021

@ocaisa
Copy link
Copy Markdown
Member Author

ocaisa commented Apr 26, 2021

Some example usages:

EESSI_REBUILD_PATH=/project/def-sponsor00/ocaisa/easybuild bash EESSI-pilot-install-software.sh
EESSI_REBUILD_PATH=/project/def-sponsor00/ocaisa/easybuild EESSI_REBUILD_MODULEPATH=$EESSI_REBUILD_PATH/modules/all/Core EESSI_REBUILD_MNS=HierarchicalMNS bash EESSI-pilot-install-software.sh

@ocaisa ocaisa mentioned this pull request Apr 26, 2021
Comment thread EESSI-pilot-install-software.sh Outdated

echo ">> Checking for EasyBuild module..."
REQ_EB_VERSION='4.3.4'
echo ">> Checking for EasyBuild module (required version is ${REQ_EB_VERSION})..."
Copy link
Copy Markdown
Member Author

@ocaisa ocaisa May 6, 2021

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

To be honest, since a specific version is required we should be trying to load that version, not the default. If we fail, we should get eb to install the latest release, and if that is too recent use the latest version to install the required version.

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We can do that in this block with module avail easybuild/${REQ_EB_VERSION}, then using a temporary pip installation to either give us the required version or the latest release if that is not available.

Copy link
Copy Markdown
Collaborator

@bedroge bedroge May 6, 2021

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

#89 is probably also relevant here

Copy link
Copy Markdown
Member Author

@ocaisa ocaisa May 6, 2021

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@bedroge You are right, I will fix this and use module show instead

Alan O'Cais added 2 commits May 6, 2021 10:53
Be more specific about what version of eb we check for and install
Comment thread EESSI-pilot-install-software.sh Outdated
@ocaisa
Copy link
Copy Markdown
Member Author

ocaisa commented Sep 23, 2021

This (also) covered what was merged in #134, before I go to the effort of resolving the (current) conflict is there a chance it will be merged anytime soon? @bedroge @boegel

module avail 2>&1 | grep -i easybuild/${REQ_EB_VERSION} &> ${ml_av_easybuild_out}
echo ">> Checking for ${EB_MODULE_NAME} module (required version is ${REQ_EB_VERSION})..."
ml_show_easybuild_out=$TMPDIR/ml_show_easybuild.out
module show ${EB_MODULE_NAME}/${REQ_EB_VERSION} &> ${ml_show_easybuild_out}
Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@boegel I see you used grep to get around #89, this approach also works, not sure which is better...

@ocaisa
Copy link
Copy Markdown
Member Author

ocaisa commented Dec 3, 2021

@bedroge @boegel Kicking the tyres on this again, I will soon have to update it again, it would be nice if it got included soon...

@ocaisa
Copy link
Copy Markdown
Member Author

ocaisa commented Dec 3, 2021

I think I would like to change where we install modules to actually use the naming scheme in the path, so modules/EasyBuildMNS rather than modules as the default. This will allow us to easily ship multiple schemes and have a simple setting for our initialisation script.

trz42 pushed a commit to trz42/software-layer that referenced this pull request Apr 23, 2023
@boegel
Copy link
Copy Markdown
Contributor

boegel commented Jun 5, 2023

@ocaisa Is this still relevant?

I've just introduced 2021.12 and 2023.04 branches, and would like to get rid of the main branch.

@ocaisa
Copy link
Copy Markdown
Member Author

ocaisa commented Jun 6, 2023

@boegel Yes, still relevant but requires yet another update at this point.

@ocaisa
Copy link
Copy Markdown
Member Author

ocaisa commented Jun 4, 2024

Closing this, can return to it at some point

@ocaisa ocaisa closed this Jun 4, 2024
@ocaisa ocaisa deleted the rebuild_module_tree branch June 4, 2024 10:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

module avail always returns 0 for an existing module dir but non-existing module

3 participants