Skip to content

stop running e2e tests after three upgrades because we hit timeouts a…#12436

Merged
openshift-merge-robot merged 1 commit intoopenshift:masterfrom
deads2k:focus-upgrade-on-upgrade
Oct 6, 2020
Merged

stop running e2e tests after three upgrades because we hit timeouts a…#12436
openshift-merge-robot merged 1 commit intoopenshift:masterfrom
deads2k:focus-upgrade-on-upgrade

Conversation

@deads2k
Copy link
Copy Markdown
Contributor

@deads2k deads2k commented Oct 5, 2020

…nd lose upgrade signal

@deads2k
Copy link
Copy Markdown
Contributor Author

deads2k commented Oct 5, 2020

/retest

@openshift-ci-robot openshift-ci-robot added the lgtm Indicates that a PR is ready to be merged. label Oct 6, 2020
@openshift-ci-robot
Copy link
Copy Markdown
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: deads2k, petr-muller

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci-robot openshift-ci-robot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Oct 6, 2020
@openshift-merge-robot openshift-merge-robot merged commit ab04669 into openshift:master Oct 6, 2020
@openshift-ci-robot
Copy link
Copy Markdown
Contributor

@deads2k: Updated the following 2 configmaps:

  • job-config-4.6 configmap in namespace ci at cluster api.ci using the following files:
    • key openshift-release-release-4.6-periodics.yaml using file ci-operator/jobs/openshift/release/openshift-release-release-4.6-periodics.yaml
  • job-config-4.6 configmap in namespace ci at cluster app.ci using the following files:
    • key openshift-release-release-4.6-periodics.yaml using file ci-operator/jobs/openshift/release/openshift-release-release-4.6-periodics.yaml
Details

In response to this:

…nd lose upgrade signal

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

wking added a commit to wking/openshift-release that referenced this pull request Oct 22, 2020
Using the 'upgrade-all' precedent from cfcd60f (release:
Standardize all ci-chat-bot jobs, 2020-04-27, openshift#8594).  I'm not clear
on why we are joining with a newline instead of '&&'; presumably this
is getting wrapped in a 'set -e' or equivalent.  But I'm sticking with
newline to match precedent.

This increases the risk that we time out these slow jobs (e.g. [1]
took 3h42m), but we really want to exercise tests like
openshift/origin@9f7fe0089d (Add test for scaling machineSets,
2019-04-11, openshift/origin#22564), which is in
openshift/conformance/serial, because machines launch with the born-in
boot images until we get [2].

And in fact, the reason why we didn't have this post-update suite in
4.6 was because of 3bc9d8e (stop running e2e tests after three
upgrades because we hit timeouts and lose upgrade signal, 2020-10-05, openshift#12436).
But since 3c915e2 (ci-operator/step-registry/openshift/e2e/test:
Add 2h active_deadline_seconds, 2020-10-09, openshift#12647), we no longer have
to worry about getting logs when that step is slow.  So we might not
pass if we're slow, but we'll still get logs to debug why we're slow.

Only for 4.6 and later, because 4.5 is live and if we had problems
there we'd probably have already heard about them from customers.

[1]: https://prow.ci.openshift.org/view/gs/origin-ci-test/logs/release-openshift-origin-installer-e2e-aws-upgrade-4.3-to-4.4-to-4.5-to-4.6-ci/1318709056830967808
[2]: openshift/enhancements#201
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by an approver from all required OWNERS files. lgtm Indicates that a PR is ready to be merged.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants