-
-
Notifications
You must be signed in to change notification settings - Fork 748
[DNM] Lower connect timeout only for local test execution #5791
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
Interesting, the failure rate increased dramatically |
|
What's even the benefit of reducing the timeout locally? Shouldn't we just remove the whole thing? |
Sounds like they may be all tests that expect the connection to fail before the gen_test 30s timeout expires. I think they should be all reviewed. Actually, I would like to set the connection timeout to 240s temporarily and see if more tests start falling over or become unreasonably slow to complete. |
If anything it's about having faster tests. However, I do dislike this approach quite a bit and think that tests should be selective with this. Most tests should not care at all and those who do should be explicit
I'll push a commit and we'll see 👀 |
Unit Test Results 12 files ± 0 12 suites ±0 7h 48m 24s ⏱️ + 41m 52s For more details on these failures, see this check. Results for commit c69bff1. ± Comparison against base commit fb8484e. ♻️ This comment has been updated with latest results. |
fde433c to
c1f853d
Compare
e481f00 to
c69bff1
Compare
Not entirely sure if this is connected to our stability issues but I don't see a reason why we would want to lower the connect timeout other than decreasing test runtimes. On CI I'm not too worried about a few seconds more runtime considering this should increase test robustness.
Tests which are actively relying on this timeout to expire (e.g. dead workers are part of the test) should specifically lower this and make their intention clear.
I'm also open to removing this entirely but I could see the point of having smaller timeouts when running locally.