Create a session directory with suffix "-1", "-2", etc if it already exists

[bouweandela]

Description

If the output directory already exists the tool would stop. Now it will try several alternatives by adding a suffix -1, -2,, etc before giving up. This problem occurs when you try to run multiple recipes with the same name in parallel.

Closes #1817

---

Before you get started

• ☝ Create an issue to discuss what you are going to do

Checklist

It is the responsibility of the author to make sure the pull request is ready to review. The icons indicate whether the item will be subject to the 🛠 Technical or 🧪 Scientific review.

• 🧪 The new functionality is relevant and scientifically sound
• 🛠 This pull request has a descriptive title and labels
• 🛠 Code is written according to the code quality guidelines
• 🧪 and 🛠 Documentation is available
• 🛠 Unit tests have been added
• 🛠 Changes are backward compatible
• 🛠 The list of authors is up to date
• 🛠 All checks below this pull request were successful

---

To help with the number pull requests:

• 🙏 We kindly ask you to review two other open pull requests in this repository

[codecov]

Codecov Report

Merging #1818 (d91ab50) into main (9a2a318) will increase coverage by 0.00%.
The diff coverage is 100.00%.

@@           Coverage Diff           @@
##             main    #1818   +/-   ##
=======================================
  Coverage   91.49%   91.50%           
=======================================
  Files         202      202           
  Lines       10908    10918   +10     
=======================================
+ Hits         9980     9990   +10     
  Misses        928      928           

Impacted Files	Coverage Δ
esmvalcore/_main.py	91.06% <100.00%> (+0.39%)	⬆️

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

[bouweandela]

Question to reviewer: is additional documentation needed here?

[bouweandela]

@schlunma and @valeriupredoi Maybe this is interesting for you since we recently discussed this in #1769.

[schlunma]

Looks good! I have one small comment.

About the doc: I don't think it is necessary to add documentation on this.

[schlunma]

Nice!

[bouweandela]

@ESMValGroup/technical-lead-development-team Could someone please do a final check and merge?

[valeriupredoi]

@ESMValGroup/technical-lead-development-team Could someone please do a final check and merge?

on it now, bud!

[valeriupredoi]

thanks @bouweandela and @schlunma - looking swanky! I'd put a debug message when new output dirs are created but that's just me being a bit verbose 😁