Skip to content

Reproduction of bug #5442#5443

Closed
cardil wants to merge 6 commits into
knative:mainfrom
cardil:reproduce/5442
Closed

Reproduction of bug #5442#5443
cardil wants to merge 6 commits into
knative:mainfrom
cardil:reproduce/5442

Conversation

@cardil
Copy link
Copy Markdown
Contributor

@cardil cardil commented May 27, 2021

@knative-prow-robot knative-prow-robot added the size/M Denotes a PR that changes 30-99 lines, ignoring generated files. label May 27, 2021
@google-cla google-cla Bot added the cla: yes Indicates the PR's author has signed the CLA. label May 27, 2021
@knative-prow-robot knative-prow-robot added the area/test-and-release Test infrastructure, tests or release label May 27, 2021
@codecov
Copy link
Copy Markdown

codecov Bot commented May 27, 2021

Codecov Report

Merging #5443 (907edb1) into main (38bfba7) will not change coverage.
The diff coverage is n/a.

Impacted file tree graph

@@           Coverage Diff           @@
##             main    #5443   +/-   ##
=======================================
  Coverage   82.68%   82.68%           
=======================================
  Files         200      200           
  Lines        6261     6261           
=======================================
  Hits         5177     5177           
  Misses        750      750           
  Partials      334      334           

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 38bfba7...907edb1. Read the comment docs.

Comment thread test/e2e/trigger_no_subscriber_test.go Outdated
@cardil cardil changed the title Reproduce of knative/eventing#5442 Reproduce of bug #5442 May 27, 2021
@cardil cardil changed the title Reproduce of bug #5442 Reproduction of bug #5442 May 27, 2021
@mgencur
Copy link
Copy Markdown
Contributor

mgencur commented May 31, 2021

@cardil thanks for the reproducer but is this supposed to be merged? I don't think so...

@cardil
Copy link
Copy Markdown
Contributor Author

cardil commented May 31, 2021

Why do not merge?

Failing test is skipped, so when it gets fixed one could just remove the skip.

@mgencur
Copy link
Copy Markdown
Contributor

mgencur commented May 31, 2021

I think it would be better to attach the reproducer to the bug and merge it together with the fix. Merging this now doesn't bring any benefits.

@cardil
Copy link
Copy Markdown
Contributor Author

cardil commented Jun 14, 2021

I think it would be better to attach the reproducer to the bug and merge it together with the fix. Merging this now doesn't bring any benefits.

The bug was fixed in knative/pkg#2149, so the way you mentioned isn't possible.

@knative-prow-robot
Copy link
Copy Markdown
Contributor

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: cardil
To complete the pull request process, please assign chaodaig after the PR has been reviewed.
You can assign the PR to them by writing /assign @chaodaig in a comment when ready.

The full list of commands accepted by this bot can be found here.

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@lionelvillard
Copy link
Copy Markdown
Contributor

@cardil are you still working on this?

@cardil
Copy link
Copy Markdown
Contributor Author

cardil commented Sep 3, 2021

It should be now fixed (a while back, in fact - 0.24+), judging by #5442 (comment).

I'll double-check that.

@cardil
Copy link
Copy Markdown
Contributor Author

cardil commented Sep 3, 2021

Hmm, we could add those negative tests to test suite - they will ensure that trigger will not be ready without valid subscriber.

The problem with that is that, when testing for negative things, we need to wait for timeout on the tested method. That has 2 problems:

  • It adds quite a long time to the suite. In this case, that's about 2min being added. We could battle that time to make it less, for example by allowing to pass context.Context (see test/lib/creation.go funcs should accept context.Context #5322) to methods like duck.WaitForResourceReady, but it will always adds some time.
  • It's hard to choose a proper, safe, timeout. Let's say I choose 5min as timeout, and test passes as trigger haven't became ready in that time, but maybe it will became ready in 5m1s. I can't be sure about it.

I'm seeing two solutions for this problem:

  • create a seperate test suite for negative testing, and run all tests in parallel, if possible, setting a large timeout - like 1h, and run such suite on nightly tests
  • don't bother to test for negative cases at all

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Dec 3, 2021

This Pull Request is stale because it has been open for 90 days with
no activity. It will automatically close after 30 more days of
inactivity. Reopen with /reopen. Mark as fresh by adding the
comment /remove-lifecycle stale.

@github-actions github-actions Bot added the lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. label Dec 3, 2021
@github-actions github-actions Bot closed this Jan 2, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/test-and-release Test infrastructure, tests or release cla: yes Indicates the PR's author has signed the CLA. lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. size/M Denotes a PR that changes 30-99 lines, ignoring generated files.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants