Skip to content

Eventing upgrade tests#530

Merged
openshift-merge-robot merged 21 commits into
openshift-knative:masterfrom
cardil:feature/SRVKE-475-eventing-upgrade-tests
Nov 2, 2020
Merged

Eventing upgrade tests#530
openshift-merge-robot merged 21 commits into
openshift-knative:masterfrom
cardil:feature/SRVKE-475-eventing-upgrade-tests

Conversation

@cardil
Copy link
Copy Markdown
Member

@cardil cardil commented Oct 8, 2020

Introducing an Eventing upgrade tests to be executed withing a CI.

@openshift-ci-robot
Copy link
Copy Markdown

Skipping CI for Draft Pull Request.
If you want CI signal for your change, please convert it to an actual PR.
You can still manually trigger a test run with /test all

@cardil
Copy link
Copy Markdown
Member Author

cardil commented Oct 9, 2020

/test all

@cardil cardil force-pushed the feature/SRVKE-475-eventing-upgrade-tests branch from 8914d4c to 5047f4c Compare October 9, 2020 10:34
@cardil
Copy link
Copy Markdown
Member Author

cardil commented Oct 9, 2020

/retest

Copy link
Copy Markdown
Contributor

@mgencur mgencur left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overall, looks good! Just a few minor things.
I'd also like to see the tests in action. AFAIK, this PR now runs only the Serving upgrade tests, right?

Comment thread hack/lib/common.bash
Comment thread test/lib.bash Outdated
Comment thread test/serving.bash Outdated
Comment thread test/upstream-e2e-tests.sh Outdated
@cardil
Copy link
Copy Markdown
Member Author

cardil commented Oct 9, 2020

/test all

Comment thread test/lib.bash Outdated
@cardil cardil changed the title Eventing upgrade tests [WIP] Eventing upgrade tests Oct 9, 2020
@cardil
Copy link
Copy Markdown
Member Author

cardil commented Oct 9, 2020

/test all

@mgencur
Copy link
Copy Markdown
Contributor

mgencur commented Oct 15, 2020

@cardil The PR looks good to me but the upgrade tests have a failure in the logs:

panic: test timed out after 30m0s

But they still report success.

@cardil
Copy link
Copy Markdown
Member Author

cardil commented Oct 15, 2020

Yeah. I know. The error reporting is still not working well for some reason.

…-eventing-upgrade-tests

Conflicts fixed:
* hack/lib/serverless.bash
* test/upstream-e2e-tests.sh
…-eventing-upgrade-tests

Conflicts fixed:
 * hack/lib/catalogsource.bash
 * hack/lib/vars.bash
 * test/upstream-e2e-tests.sh
@mgencur
Copy link
Copy Markdown
Contributor

mgencur commented Oct 22, 2020

/retest

Comment thread test/lib.bash Outdated
…-eventing-upgrade-tests

Conflicts fixes:
 * hack/lib/serverless.bash
 * test/serving.bash
 * test/upstream-e2e-tests.sh
@cardil
Copy link
Copy Markdown
Member Author

cardil commented Oct 27, 2020

/test all

@cardil
Copy link
Copy Markdown
Member Author

cardil commented Nov 1, 2020

/test all

@cardil
Copy link
Copy Markdown
Member Author

cardil commented Nov 1, 2020

/retest

Comment thread test/eventing.bash Outdated
To avoid loosing events and most notably "finished" event, I'm lowering
interval between sent event to 50 ms from previously used 2 ms.
@cardil cardil marked this pull request as ready for review November 1, 2020 23:10
@mgencur
Copy link
Copy Markdown
Contributor

mgencur commented Nov 2, 2020

/lgtm

@openshift-ci-robot
Copy link
Copy Markdown

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: cardil, mgencur

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-merge-robot openshift-merge-robot merged commit 6e8003b into openshift-knative:master Nov 2, 2020
@cardil cardil deleted the feature/SRVKE-475-eventing-upgrade-tests branch November 2, 2020 10:22
cardil added a commit to cardil/serverless-operator that referenced this pull request Nov 2, 2020
Eventing upgrade tests

* Splitting upgrade test to accommodate Eventing
* Add an image template
* Upgrade tests with Eventing by default
* Proper error reporting from shell scripts
* Remove serving & eventing ns at teardown
* Adding missing return statements + prober end idempotency
* Declare a waited PIDs array
* Rely on PID directory instead of Bash arrays
* Eventing test bits deploy properly
* Proper waiting on prober's end
* Creating a namespaces for previous release
* Add env vars to configure upgrade tests
* Lowering interval from 2ms to 50ms

To avoid loosing events and most notably "finished" event, I'm lowering
interval between sent event to 50 ms from previously used 2 ms.
openshift-merge-robot pushed a commit that referenced this pull request Nov 2, 2020
Eventing upgrade tests

* Splitting upgrade test to accommodate Eventing
* Add an image template
* Upgrade tests with Eventing by default
* Proper error reporting from shell scripts
* Remove serving & eventing ns at teardown
* Adding missing return statements + prober end idempotency
* Declare a waited PIDs array
* Rely on PID directory instead of Bash arrays
* Eventing test bits deploy properly
* Proper waiting on prober's end
* Creating a namespaces for previous release
* Add env vars to configure upgrade tests
* Lowering interval from 2ms to 50ms

To avoid loosing events and most notably "finished" event, I'm lowering
interval between sent event to 50 ms from previously used 2 ms.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants