Running all our tests on drupal.org

[finnlewis]

Here on github, we run a custom ci script to run tests against all localgov_* projetcs.

We're going to want to do the same on drupal.org.

@millnut @stephen-cox can you help us work out how best to do this?

My first through is to include the standard drupal.org gitlab ci.

https://git.drupalcode.org/project/localgov_project/-/blob/3.x/.gitlab-ci.yml?ref_type=heads

Then to extend / override with some custom lines to run the tests against all our folders.

Q: is there any way to inject a different value for $DRUPAL_PROJECT_FOLDER in https://git.drupalcode.org/project/gitlab_templates/-/blob/main/includes/include.drupalci.main.yml#L720 ?

If we could just set that to ./web/modules/contrib/localgov* that would be great!

[finnlewis]

CC @tonypaulbarker @andybroomfield , let's hive our minds on this one!

[millnut]

Hi @finnlewis I don't think drupal.org GitLab CI is set up that way, I've checked the most popular distributions Open Social, Provus, farmOS and Thunder; and none have testing at the "project" level.

I believe GitLab CI on Drupal.org only supports testing themes, profiles and modules, as they first start with a base Drupal project and then install those on top. I don't believe you can override this, might be a question for the DA.

Instead it might be better to have the profile, modules and themes testing in GitLab CI but leave the actual project that tests everything in GitHub.

As the whole project takes a while to test on PHPUnit, I also believe there are timeouts on tests on drupal.org GitLab CI.

[finnlewis]

Thanks @millnut - we were thinking of this as an option, keep the full tests to Github.

I will also as the Drupal Association Infrastructure team as you suggest, it would be nice if there was a way.

[tonypaulbarker]

Drupal CMS development project does this so it seems possible https://git.drupalcode.org/project/drupal_cms/-/blob/2.x/.gitlab-ci.yml?ref_type=heads

It also has a tugboat folder https://www.tugboatqa.com/

[stephen-cox]

I have created a MR in Drupal GitLab that adapts something that Agile Collective use for running PHPUnit tests in GitLab: https://git.drupalcode.org/project/localgov_project/-/merge_requests/4

Tests are running, but failing, which I expect is due to the PHPUnit or Drupal config.