[sunbeam][tests] Add product tests for sunbeam

[arif-ali]

• Move the juju tests now to sunbeam, now that we deploy using juju here, no
  need to mock the configuration files.
• Include plugins that are associated here
  • kubernetes
  • ovn_host
  • juju
• Allow the product test for sunbeam to be allowed to fail, as the sucecss rate
  is not that high with all the components that will be shipped with the
  product, the moving parts and the time taken to run the tests.

Related: #3622

---

Please place an 'X' inside each '[]' to confirm you adhere to our Contributor Guidelines

• Is the commit message split over multiple lines and hard-wrapped at 72 characters?
• Is the subject and message clear and concise?
• Does the subject start with [plugin_name] if submitting a plugin patch or a [section_name] if part of the core sosreport code?
• Does the commit contain a Signed-off-by: First Lastname email@example.com?
• Are any related Issues or existing PRs properly referenced via a Closes (Issue) or Resolved (PR) line?
• Are all passwords or private data gathered by this PR obfuscated?

[arif-ali]

This is an initial preview of the work on new stageone tests for sunbeam, Canonical's new OpenStack

Need to add some more stuff, but wanted to fer an initial pass from everyone

[packit-as-a-service]

Congratulations! One of the builds has completed. 🍾

You can install the built RPMs by following these steps:

• sudo yum install -y dnf-plugins-core on RHEL 8
• sudo dnf install -y dnf-plugins-core on Fedora
• dnf copr enable packit/sosreport-sos-3837
• And now you can install the packages.

Please note that the RPMs should be used only in a testing environment.

[arif-ali]

The failure is known, I forgot to bring that fix back onto my system, from my test system.

All in all working ok, I think; I'll crack on to add other tests that we need, and close to a final update next week.

e2-medium-4 machine taking 1h 5, which is bigger and at least 3 times longer than the other Integration test, hopefully the slowness is not of concern

[arif-ali]

I have left this here, as we need to add this to functional tests. We need to now figure out what happened in my previous PR on adding these commands, as we should be capturing this.

Once that is resolved, we can enable this section.

[arif-ali]

Bringing this back as draft, as new Canonical K8s is going to be used, and I don't want future runs to start suddenly failing

[arif-ali]

hmm, took more than 1200 seconds to get a sos report.

In my lab it took <900 seconds (see below), maybe I need to increase the size of the VM on GCE to get better performance 🤷🏽

 (34/55) tests/product_tests/sunbeam/sunbeam_tests.py:SunbeamBasicTest.test_plugins_ran: STARTED
 (34/55) tests/product_tests/sunbeam/sunbeam_tests.py:SunbeamBasicTest.test_plugins_ran:  PASS (885.91 s)
 (35/55) tests/product_tests/sunbeam/sunbeam_tests.py:SunbeamBasicTest.test_sunbeam_keys_skipped: STARTED
 (35/55) tests/product_tests/sunbeam/sunbeam_tests.py:SunbeamBasicTest.test_sunbeam_keys_skipped:  PASS (0.09 s)

[arif-ali]

Cirrus + gce is too unstable for openstack to be mocked. I'm ditching this.

[arif-ali]

After speaking to Engineering, it seems like a part of the product changed that could be causing failures. 2 changes were made, one to go to LTS of juju, and the Canonical k8s, so once this stabilises, I'll try this again

[pmoravec]

Sounds good to me.