Skip to content

Conversation

@vrutkovs
Copy link
Contributor

@vrutkovs vrutkovs commented Oct 14, 2020

This updates e2e-agnostic-upgrade tests to do rollback tests in 4.5+ branches to verify that updated version can be rolled back to the original

@openshift-ci-robot openshift-ci-robot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Oct 14, 2020
@vrutkovs
Copy link
Contributor Author

GCP quota issues
/retest

@vrutkovs
Copy link
Contributor Author

/retest

4.7 passed, but crashed on gather-loki stage

@openshift-ci-robot
Copy link
Contributor

openshift-ci-robot commented Oct 14, 2020

@vrutkovs: The following tests failed, say /retest to rerun all failed tests:

Test name Commit Details Rerun command
ci/rehearse/openshift/cluster-version-operator/master/e2e-rollback 437fefa00164de948c8dc6519a5f91fc1a33d6b4 link /test pj-rehearse
ci/prow/pj-rehearse 437fefa00164de948c8dc6519a5f91fc1a33d6b4 link /test pj-rehearse

Full PR test history. Your PR dashboard.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@vrutkovs vrutkovs force-pushed the cvo-rollbacktests branch 2 times, most recently from 8d1e0b6 to 42cd8c7 Compare October 20, 2020 12:44
@vrutkovs vrutkovs force-pushed the cvo-rollbacktests branch 5 times, most recently from 72d75ff to bfa2d6f Compare October 22, 2020 14:57
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't think we need to set this explicitly, since it's the default:

$ git --no-pager grep TEST_COMMAND ci-operator/step-registry/openshift/upgrade/gcp/loki/
ci-operator/step-registry/openshift/upgrade/gcp/loki/openshift-upgrade-gcp-loki-workflow.yaml:      TEST_COMMAND: "run-upgrade"

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

env section completely overwrites existing one, so all parameters have to duplicated here.

I filed https://issues.redhat.com/browse/DPTP-1644 to investigate templating in step workflows

This adds `e2e-rollback` tests to 4.6+ branches to verify that updated version can be rolled back to the original
@openshift-merge-robot
Copy link
Contributor

openshift-merge-robot commented Oct 23, 2020

@vrutkovs: The following tests failed, say /retest to rerun all failed tests:

Test name Commit Details Rerun command
ci/rehearse/openshift/kubernetes/master/e2e-aws-selfupgrade 691beccb3cf70b2b58684c6f6fec78a79eb9f395 link /test pj-rehearse
ci/rehearse/openshift/installer/master/e2e-gcp-upi 691beccb3cf70b2b58684c6f6fec78a79eb9f395 link /test pj-rehearse
ci/rehearse/openshift/installer/master/e2e-gcp-upi-xpn 691beccb3cf70b2b58684c6f6fec78a79eb9f395 link /test pj-rehearse
ci/rehearse/openshift/cluster-network-operator/master/e2e-ovn-hybrid-step-registry 691beccb3cf70b2b58684c6f6fec78a79eb9f395 link /test pj-rehearse
ci/rehearse/openshift/installer/master/e2e-vsphere-upi 691beccb3cf70b2b58684c6f6fec78a79eb9f395 link /test pj-rehearse
ci/rehearse/openshift/cluster-image-registry-operator/master/e2e-vsphere 691beccb3cf70b2b58684c6f6fec78a79eb9f395 link /test pj-rehearse
ci/rehearse/openshift/cluster-kube-apiserver-operator/master/e2e-aws-serial 691beccb3cf70b2b58684c6f6fec78a79eb9f395 link /test pj-rehearse
ci/rehearse/openshift/origin/master/e2e-aws-proxy 691beccb3cf70b2b58684c6f6fec78a79eb9f395 link /test pj-rehearse
ci/rehearse/openshift/installer/master/e2e-aws-proxy 691beccb3cf70b2b58684c6f6fec78a79eb9f395 link /test pj-rehearse
ci/rehearse/openshift/cluster-network-operator/master/e2e-ovn-step-registry 691beccb3cf70b2b58684c6f6fec78a79eb9f395 link /test pj-rehearse
ci/rehearse/openshift/cluster-image-registry-operator/master/e2e-vsphere-operator 691beccb3cf70b2b58684c6f6fec78a79eb9f395 link /test pj-rehearse
ci/rehearse/openshift/cluster-network-operator/master/e2e-azure-ovn 691beccb3cf70b2b58684c6f6fec78a79eb9f395 link /test pj-rehearse
ci/rehearse/openshift/cluster-version-operator/release-4.6/e2e-rollback bfa2d6f0b4b03feb1d916de14f39f8cb92a7c7e5 link /test pj-rehearse
ci/rehearse/openshift/cluster-network-operator/master/e2e-aws-sdn-multi 691beccb3cf70b2b58684c6f6fec78a79eb9f395 link /test pj-rehearse
ci/rehearse/openshift/cloud-credential-operator/master/e2e-upgrade 691beccb3cf70b2b58684c6f6fec78a79eb9f395 link /test pj-rehearse
ci/rehearse/openshift/cluster-version-operator/release-4.5/e2e-upgrade a3515af9202cb6308bf6240c776abaa844e2583c link /test pj-rehearse

Full PR test history. Your PR dashboard.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@wking
Copy link
Member

wking commented Oct 26, 2020

/lgtm

@openshift-ci-robot openshift-ci-robot added the lgtm Indicates that a PR is ready to be merged. label Oct 26, 2020
@openshift-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: vrutkovs, wking

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-merge-robot openshift-merge-robot merged commit 3185ecf into openshift:master Oct 26, 2020
@openshift-ci-robot
Copy link
Contributor

@vrutkovs: Updated the following 6 configmaps:

  • ci-operator-master-configs configmap in namespace ci at cluster app.ci using the following files:
    • key openshift-cluster-version-operator-master.yaml using file ci-operator/config/openshift/cluster-version-operator/openshift-cluster-version-operator-master.yaml
  • ci-operator-4.5-configs configmap in namespace ci at cluster app.ci using the following files:
    • key openshift-cluster-version-operator-release-4.5.yaml using file ci-operator/config/openshift/cluster-version-operator/openshift-cluster-version-operator-release-4.5.yaml
  • ci-operator-4.6-configs configmap in namespace ci at cluster app.ci using the following files:
    • key openshift-cluster-version-operator-release-4.6.yaml using file ci-operator/config/openshift/cluster-version-operator/openshift-cluster-version-operator-release-4.6.yaml
  • ci-operator-4.7-configs configmap in namespace ci at cluster app.ci using the following files:
    • key openshift-cluster-version-operator-release-4.7.yaml using file ci-operator/config/openshift/cluster-version-operator/openshift-cluster-version-operator-release-4.7.yaml
  • job-config-4.5 configmap in namespace ci at cluster api.ci using the following files:
    • key openshift-cluster-version-operator-release-4.5-presubmits.yaml using file ci-operator/jobs/openshift/cluster-version-operator/openshift-cluster-version-operator-release-4.5-presubmits.yaml
  • job-config-4.5 configmap in namespace ci at cluster app.ci using the following files:
    • key openshift-cluster-version-operator-release-4.5-presubmits.yaml using file ci-operator/jobs/openshift/cluster-version-operator/openshift-cluster-version-operator-release-4.5-presubmits.yaml
Details

In response to this:

This updates e2e-agnostic-upgrade tests to do rollback tests in 4.5+ branches to verify that updated version can be rolled back to the original

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

wking added a commit to wking/openshift-release that referenced this pull request Mar 17, 2021
… AWS update jobs

Like the cluster-version operator has been doing since db0d358
(CVO: add rollback tests for 4.6+, 2020-10-14, openshift#12789), and which we
used to do much more broadly until 6663962 (upgrade workflows:
remove abort-at from default TEST_OPTIONS, 2020-10-08, openshift#12544).  I'm
personally in favor of the broad approach, because we want minor
rollbacks to work, so if we break master->PR rollback, we're in big
trouble.  But even with the narrow scoping for rollback jobs, origin's
test are implementing and monitoring the rollback functionality, so
they deserve to have a local test excercising it.

I've added this to the AWS update job, because Clayton wants it to be
optional, and the AWS update job has been optional and not always-run
since it was born in bd85872 (add optional e2e-aws-upgrade job,
2020-08-10, openshift#10785).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by an approver from all required OWNERS files. lgtm Indicates that a PR is ready to be merged.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants