Test in-cluster console for e2e tests #1197

spadgett · 2019-02-18T20:51:59Z

Previously we were running the bridge binary locally. Instead test the in-cluster console, which tests the built console image.

/cc @jcaianirh @alecmerdler @benjaminapetersen

https://jira.coreos.com/browse/CONSOLE-1267
https://jira.coreos.com/browse/CONSOLE-1266

alecmerdler

/lgtm

jcaianirh

lgtm

benjaminapetersen · 2019-02-18T22:14:24Z

level=info msg="Waiting up to 30m0s for the cluster to initialize..."
level=fatal msg="failed to initialize the cluster: Cluster operator network has not yet reported success"

benjaminapetersen · 2019-02-18T22:14:29Z

/retest

spadgett · 2019-02-18T22:49:38Z

/retest

level=info msg="Creating cluster..."
level=error
level=error msg="Error: Error applying plan:"
level=error
level=error msg="1 error occurred:"
level=error msg="\t* module.vpc.aws_route_table_association.route_net[3]: 1 error occurred:"
level=error msg="\t* aws_route_table_association.route_net.3: timeout while waiting for state to become 'success' (timeout: 5m0s)"

spadgett · 2019-02-19T00:10:03Z

+ ./test-gui.sh e2e
+ copyArtifacts
++ pwd
+ echo 'Copying artifacts from /go/src/github.com/openshift/console...'
Copying artifacts from /go/src/github.com/openshift/console...
+ cp -rv ./frontend/gui_test_screenshots /tmp/artifacts/gui_test_screenshots
cp: cannot stat './frontend/gui_test_screenshots': No such file or directory

Not sure what failed in this run. It looks like the e2e tests didn't start.

I added a guard in copyArtifacts to avoid that error and added set -x to test-gui.sh for better logging.

alecmerdler

/lgtm

spadgett · 2019-02-19T01:19:16Z

level=fatal msg="failed to initialize the cluster: Cluster operator network has not yet reported success"

/retest

spadgett · 2019-02-19T01:23:17Z

/retest

spadgett · 2019-02-19T02:18:10Z

Looks like the call to yarn run webdriver-update is failing. We send output to /dev/null so it's not clear why.

spadgett · 2019-02-19T02:40:00Z

Ah, I forgot to add yarn install since we removed build-frontend.sh

alecmerdler

/lgtm

spadgett · 2019-02-19T03:30:32Z

/retest

spadgett · 2019-02-19T04:46:36Z

/retest

spadgett · 2019-02-22T00:44:50Z

/retest

spadgett · 2019-02-22T02:41:57Z

Got all the way to the etcd operator tests

Interacting with the etcd OCS creates etcd Operator `Deployment` 1m41s
Error: Timeout - Async callback was not invoked within timeout specified by jasmine.DEFAULT_TIMEOUT_INTERVAL.

/retest

spadgett · 2019-02-22T03:31:33Z

/retest

spadgett · 2019-02-22T04:23:41Z

/retest

kyoto · 2019-02-22T06:55:02Z

/retest

kyoto · 2019-02-22T07:21:48Z

/retest

kyoto · 2019-02-22T08:31:48Z

/retest

kyoto · 2019-02-22T09:34:39Z

/retest

kyoto · 2019-02-22T10:56:06Z

/retest

kyoto · 2019-02-22T12:06:25Z

/retest

kyoto · 2019-02-22T13:03:26Z

/retest

spadgett · 2019-02-22T13:33:05Z

@kyoto Thanks for helping me retest this 👍

spadgett · 2019-02-22T13:36:46Z

@alecmerdler OLM etcd scenario has failed 3 times. Can you help? Wondering if there's a real bug here:

https://openshift-gce-devel.appspot.com/build/origin-ci-test/pr-logs/pull/openshift_console/1197/pull-ci-openshift-console-master-console-e2e/673/

https://openshift-gce-devel.appspot.com/build/origin-ci-test/pr-logs/pull/openshift_console/1197/pull-ci-openshift-console-master-console-e2e/675/

https://openshift-gce-devel.appspot.com/build/origin-ci-test/pr-logs/pull/openshift_console/1197/pull-ci-openshift-console-master-console-e2e/678/

I don't see the etcd deployment in the screenshots:

https://storage.googleapis.com/origin-ci-test/pr-logs/pull/openshift_console/1197/pull-ci-openshift-console-master-console-e2e/673/artifacts/console-e2e/gui_test_screenshots/463125ea270e98ddf6d549a19bd5c35f.png

Pod logs should be in the artifacts if we need them. I might try to increase the timeout in case we're just not waiting long enough.

spadgett · 2019-02-22T14:18:05Z

/retest

Previously we were running the bridge binary locally. Instead test the in-cluster console, which tests the built console image.

spadgett · 2019-02-22T14:42:50Z

Rate limited

/retest

level=fatal msg="failed to fetch Terraform Variables: failed to fetch dependency of \"Terraform Variables\": failed to fetch dependency of \"Bootstrap Ignition Config\": failed to fetch dependency of \"Common Manifests\": failed to generate asset \"DNS Config\": getting public zone for \"origin-ci-int-aws.dev.rhcloud.com\": listing hosted zones: Throttling: Rate exceeded\n\tstatus code: 400, request id: 329198a7-36af-11e9-8cbf-abfcb2fdb5d0"

alecmerdler

/lgtm

spadgett · 2019-02-22T15:17:05Z

backend/frontend failures were infrastructure flakes (test-bin pod was evicted)

spadgett · 2019-02-22T16:36:32Z

/test backend

spadgett · 2019-02-22T16:40:01Z

/refresh

openshift-ci-robot requested review from alecmerdler, benjaminapetersen and jcaianirh February 18, 2019 20:52

openshift-ci-robot added the size/M Denotes a PR that changes 30-99 lines, ignoring generated files. label Feb 18, 2019

alecmerdler approved these changes Feb 18, 2019

View reviewed changes

openshift-ci-robot assigned alecmerdler Feb 18, 2019

openshift-ci-robot added the lgtm Indicates that a PR is ready to be merged. label Feb 18, 2019

benjaminapetersen approved these changes Feb 18, 2019

View reviewed changes

jcaianirh approved these changes Feb 18, 2019

View reviewed changes

spadgett force-pushed the test-in-cluster-console branch from 1090ad3 to 8e49b16 Compare February 19, 2019 00:06

openshift-ci-robot removed the lgtm Indicates that a PR is ready to be merged. label Feb 19, 2019

openshift-ci-robot added the lgtm Indicates that a PR is ready to be merged. label Feb 19, 2019

alecmerdler approved these changes Feb 19, 2019

View reviewed changes

spadgett force-pushed the test-in-cluster-console branch from 8e49b16 to cb77dd2 Compare February 19, 2019 02:16

openshift-ci-robot removed the lgtm Indicates that a PR is ready to be merged. label Feb 19, 2019

spadgett changed the title ~~Tests in-cluster console for e2e tests~~ Test in-cluster console for e2e tests Feb 19, 2019

spadgett force-pushed the test-in-cluster-console branch from cb77dd2 to a007524 Compare February 19, 2019 02:37

spadgett mentioned this pull request Feb 19, 2019

Monitoring: The "DeadMansSwitch" alert has been renamed to "Watchdog" #1189

Merged

openshift-ci-robot added the lgtm Indicates that a PR is ready to be merged. label Feb 19, 2019

alecmerdler approved these changes Feb 19, 2019

View reviewed changes

spadgett closed this Feb 22, 2019

spadgett reopened this Feb 22, 2019

spadgett force-pushed the test-in-cluster-console branch from 0194cb9 to 85b8d6d Compare February 22, 2019 14:02

openshift-ci-robot removed the lgtm Indicates that a PR is ready to be merged. label Feb 22, 2019

spadgett added 2 commits February 22, 2019 09:21

Test in-cluster console for e2e tests

c18197d

Previously we were running the bridge binary locally. Instead test the in-cluster console, which tests the built console image.

Integration tests: increase resource timing buffer size

427060a

spadgett force-pushed the test-in-cluster-console branch from 85b8d6d to 427060a Compare February 22, 2019 14:21

Integration tests: temporarily disable OLM etcd scenario

eeeb4eb

alecmerdler approved these changes Feb 22, 2019

View reviewed changes

openshift-ci-robot added the lgtm Indicates that a PR is ready to be merged. label Feb 22, 2019

openshift-merge-robot merged commit afb2707 into openshift:master Feb 22, 2019

spadgett deleted the test-in-cluster-console branch February 22, 2019 16:43

Test in-cluster console for e2e tests #1197

Test in-cluster console for e2e tests #1197

Uh oh!

Conversation

spadgett commented Feb 18, 2019 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

alecmerdler left a comment

Choose a reason for hiding this comment

Uh oh!

jcaianirh left a comment

Choose a reason for hiding this comment

Uh oh!

benjaminapetersen commented Feb 18, 2019

Uh oh!

benjaminapetersen commented Feb 18, 2019

Uh oh!

spadgett commented Feb 18, 2019

Uh oh!

spadgett commented Feb 19, 2019

Uh oh!

alecmerdler left a comment

Choose a reason for hiding this comment

Uh oh!

spadgett commented Feb 19, 2019

Uh oh!

spadgett commented Feb 19, 2019

Uh oh!

spadgett commented Feb 19, 2019

Uh oh!

spadgett commented Feb 19, 2019

Uh oh!

alecmerdler left a comment

Choose a reason for hiding this comment

Uh oh!

spadgett commented Feb 19, 2019

Uh oh!

spadgett commented Feb 19, 2019

Uh oh!

spadgett commented Feb 22, 2019

Uh oh!

spadgett commented Feb 22, 2019

Uh oh!

spadgett commented Feb 22, 2019

Uh oh!

spadgett commented Feb 22, 2019

Uh oh!

kyoto commented Feb 22, 2019

Uh oh!

kyoto commented Feb 22, 2019

Uh oh!

kyoto commented Feb 22, 2019

Uh oh!

kyoto commented Feb 22, 2019

Uh oh!

kyoto commented Feb 22, 2019

Uh oh!

kyoto commented Feb 22, 2019

Uh oh!

kyoto commented Feb 22, 2019

Uh oh!

spadgett commented Feb 22, 2019

Uh oh!

spadgett commented Feb 22, 2019

Uh oh!

spadgett commented Feb 22, 2019

Uh oh!

spadgett commented Feb 22, 2019

Uh oh!

alecmerdler left a comment

Choose a reason for hiding this comment

Uh oh!

spadgett commented Feb 22, 2019

Uh oh!

spadgett commented Feb 22, 2019

Uh oh!

spadgett commented Feb 22, 2019

Uh oh!

Reviewers

Assignees

spadgett commented Feb 18, 2019 •

edited

Loading