Skip to content

Point tests to the latest nightly eventing-sources#719

Closed
bbrowning wants to merge 2 commits into
knative:masterfrom
bbrowning:patch-1
Closed

Point tests to the latest nightly eventing-sources#719
bbrowning wants to merge 2 commits into
knative:masterfrom
bbrowning:patch-1

Conversation

@bbrowning
Copy link
Copy Markdown
Contributor

Fixes #718

@googlebot googlebot added the cla: yes Indicates the PR's author has signed the CLA. label Jan 11, 2019
@knative-prow-robot knative-prow-robot added the size/XS Denotes a PR that changes 0-9 lines, ignoring generated files. label Jan 11, 2019
@evankanderson
Copy link
Copy Markdown
Member

/lgtm
/approve

I wonder if we should be using the latest release, rather than the latest nightly, but either seems better than a random release a month ago.

@knative-prow-robot knative-prow-robot added the lgtm Indicates that a PR is ready to be merged. label Jan 11, 2019
@knative-prow-robot
Copy link
Copy Markdown
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: bbrowning, evankanderson

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@knative-prow-robot knative-prow-robot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Jan 11, 2019
@grantr
Copy link
Copy Markdown
Contributor

grantr commented Jan 11, 2019

The pin was originally done because eventing-sources was causing the eventing e2e tests to fail every time, and that was blocking all eventing PRs (#683). I investigated for a while but eventually got pulled away without a solution. I also tried to copy the eventing e2e tests to eventing-sources (knative/eventing-contrib#121) but never got those working either.

This temporary unblocker should not have stuck around so long and I take responsibility for never coming back to fix it (it should have been added to the 0.3.0 milestone as a blocker). As @bbrowning points out, it probably means that CI has never tested 0.3 eventing and 0.3 eventing-sources together.

The root cause is probably knative/eventing-contrib#137. Unfortunately the eventing e2e tests are really hard to debug so I never found out exactly what the issue was. It's likely that the quickest way forward is attempting to back out those changes - they don't add any functionality, just refactor the existing stuff. There will be conflicts because some later sources rely on the new signature.

@grantr
Copy link
Copy Markdown
Contributor

grantr commented Jan 11, 2019

It's likely that the quickest way forward is attempting to back out those changes - they don't add any functionality, just refactor the existing stuff. There will be conflicts because some later sources rely on the new signature.

I'm attempting this now.

@bbrowning
Copy link
Copy Markdown
Contributor Author

@grantr Thanks for jumping in. We all missed reverting this so don't fret about that.

It's not obvious why this integration test failed, but given the reports we've see with k8sevents in 0.3 from a couple of people already on knative/docs#733, we may have a similar issue.

I'm pushing on with the E2E test work in eventing-sources as knative/eventing-contrib#178 in an effort to get something going there to help prevent this from happening again.

@grantr
Copy link
Copy Markdown
Contributor

grantr commented Jan 11, 2019

knative/eventing-contrib#179 reverts most eventing-sources (the k8s source in particular) to use the old GetSinkURI implementation. If the eventing e2e tests pass with this change, it seems likely that knative/eventing-contrib#137 is causing the failures.

@grantr
Copy link
Copy Markdown
Contributor

grantr commented Jan 12, 2019

I created #720 which pins eventing-sources to the state of knative/eventing-contrib#179. It passes for me when I run the tests from my command line (with a GKE cluster). I'm pretty certain now that the failure stems from knative/eventing-contrib#137 (though I don't know why).

We had an odd mix of defaultNamespaceName and pkgTest.Flags.Namespace
in the e2e tests. The defaultNamespaceName is meant to supply the
default value for pkgTest.Flags.Namespace, but we should have been
referencing pkgTest.Flags.Namespace everywhere as it may not be the
same as the default value when running in CI.
@knative-prow-robot
Copy link
Copy Markdown
Contributor

New changes are detected. LGTM label has been removed.

@knative-prow-robot knative-prow-robot added size/S Denotes a PR that changes 10-29 lines, ignoring generated files. and removed lgtm Indicates that a PR is ready to be merged. size/XS Denotes a PR that changes 0-9 lines, ignoring generated files. labels Jan 12, 2019
@bbrowning
Copy link
Copy Markdown
Contributor Author

So, knative/eventing-contrib#178 got the Kubernetes event source E2E test passing in the eventing-sources repo. Which is odd, since that same test failed here when pointing at a recent eventing-sources release. Doing some digging, there were some slight differences in how the eventing test mixes direct usage of defaultNamespaceName with usage of pkgTest.Flags.Namespace which could result in unintentionally crossing namespace boundaries during the test. Perhaps this namespace difference somehow comes into play when switching between the dynamic and controller clients that @grantr mentioned above?

At any rate, I added a commit here to fix the namespace references and we'll see if that gets this test passing or if it's something else that allows eventing-sources to pass this test but eventing to not.

@bbrowning
Copy link
Copy Markdown
Contributor Author

That had no difference. So, I'm a bit stumped as to how this test passes in eventing-sources but not in eventing.

@knative-prow-robot
Copy link
Copy Markdown
Contributor

@bbrowning: The following test failed, say /retest to rerun them all:

Test name Commit Details Rerun command
pull-knative-eventing-integration-tests a29e9d2 link /test pull-knative-eventing-integration-tests

Full PR test history. Your PR dashboard.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@vaikas
Copy link
Copy Markdown
Contributor

vaikas commented Jan 17, 2019

This can now be closed because we no longer have a dependency on the eventing-sources? @bbrowning that's right, yes?

@grantr grantr closed this Jan 17, 2019
@grantr
Copy link
Copy Markdown
Contributor

grantr commented Jan 17, 2019

Closing as superseded by #726. @bbrowning reopen if desired.

@bbrowning
Copy link
Copy Markdown
Contributor Author

Not depending on eventing-sources is even better 👍

@bbrowning bbrowning deleted the patch-1 branch January 22, 2019 03:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by an approver from all required OWNERS files. cla: yes Indicates the PR's author has signed the CLA. size/S Denotes a PR that changes 10-29 lines, ignoring generated files.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants