(Flaky-tests) Reduce flakiness of tests - attempt 3 #6395
Closed
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Increased timeouts for state tests. apache#6200 apache#6198 Increased timeouts to testSimpleConsumerEventsWithoutPartition and introduced await to poll on assertions to eliminate use of Thread.sleep in several places. (apache#6014) Attempting to fix testPulsarKafkaProducerWithSerializer issue by adding await to test. (apache#6137) Attempt to fix apache#6207 and add more debugging information by pruning docker containers. Fixed typo in docker commands for getting debug info. apache#6207. Removing timeouts as per comments in apache#5333. This is for apache#6202. Fixed timeout issues for CPP tests. apache#6202 and apache#6137 Increased more timeouts. apache#6202 and apache#6137 Fixed typo in CPP test timeout fix. apache#6202 apache#4884 Edited comment to trigger build apache#6202 Rolled back changes to PulsarSpoutTest because fixing some instability broke two of the tests that depend on timeout configurations. Those changes will require more investigation. apache#6202 Added timeouts back in places where required. Increased timeouts though. apache#6202 Fixed timeouts for Storm and Kafka tests. Also removed debug block that was accidentially included in ReaderTest. apache#6202 Editing comment to trigger new build. apache#6202 Attempt to workaround test failure. apache#6202 Adding some timeouts back to get beyond hanging tests. apache#6202 Increased sleep value as temporary workaround for thread timeout. apache#6202 Added back timeouts to fix hang but increased timeouts from 1s to 5s. apache#6202 Added back timeout (but made it longer) to prevent hanging test. apache#6202 Fixed formatting since it was breaking the build. apache#6202 Increased more test timeouts to get them to pass on slow hardware. apache#6202 Increased more test timeouts to get them to pass on slow hardware. apache#6202 Edited more test timeouts to get them to pass on slow hardware. apache#6202 Triggering tests due to 'Could not transfer artifact' maven issue. apache#6202 Increased or edited timeouts to get more tests to pass. apache#6202 Triggering new build by changing comment. apache#6202 Fixed timeouts (to short timeouts) when null message is expected. apache#6202 Triggering new build by changing comment. apache#6202 Increased timeout. apache#6202 Increased sleep as temporary workaround. apache#6202 Tuned timeouts more. apache#6202 Widening time to force timeout in timeout test. apache#6202 Fixed spelling typo. apache#6202 Added randomization of namespace name. apache#6202 Added random name generator to names of producers, subscriptions, and topics in ClientDeduplicationTest to fix duplicate name conflicts. apache#6202 Fixed issues with duplicate namespaces with repeated test runs. apache#6202 Added randomization to topic name to prevent potential conflicts that might be causing non-determinism in test. apache#6202 Added randomization to namespace name to prevent issues with topics not clearing out before second run of tests. apache#6202 Attempt to get C++ test fixed. It's not clear if this commit will build though... apache#6202 Replaced snake_case with camelCase to try to get c++ format to pass the build. apache#6202 Adding random name to subscription to see if that resolves the fact that this test only fails on the second subsequent run. apache#6202 Fixed timeout issues. apache#6202 Attempting fix of testPerTopicStats() by addressing race condition. apache#6202 Adding some debugging to help troubleshoot flaky test. apache#6202 Removing code that wasn't building anyway. apache#6202 Changed how we're testing Prometheus by filtering the topic name to fix race conditions between test runs and sharing broker state. apache#6202 Added more debugging information and fixed assertion apache#6202 Trigger new build apache#6202 Added long timeouts to ensure that broker tests do timeout instead of hanging but without timing out too soon apache#6202 Fixed imports for TimeUnit apache#6202 Fixed imports for TimeUnit apache#6202 Pushing changes to allow discussion on what's happening. apache#6202 Fixed timeouts for the testSharedSingleAckedPartitionedTopic() test. apache#6202 Fixed issue with Prometheus test. apache#6202 Can't use receive with timeout, if the queue size is 0. Fixed InterceptorsTest. apache#6202 Can't use receive with timeout, if the queue size is 0. apache#6202 Fixed Can't use receive with timeout, if the queue size is 0. apache#6202 Edited comment to trigger re-run of all tests to find more flaky tests. apache#6202 Fixed more of the concurrency issue in testPerTopicStats that was causing namespace conflicts. apache#6202 Fixed something I missed during rebasing. apache#6202 Fixed issues with Prometheus tests. apache#6256 Changed MessageId.latest to MessageId.earliest to fix apache#6224 Fixes issue apache#6352 Triggering build to inspect test results. apache#6202 Added timeouts to fix hanging tests. apache#6202 Triggering new build. apache#6202 Updating Github workflow to build surefire artifacts if previous step was cancelled, not just failed. apache#6202 Changing CI Unit Action to always build surefire artifacts to help with debugging hanging test. apache#6202 Triggering new build with arbitrary edit. apache#6202 Triggering build with arbitrary change to comment apache#6202 Triggering new build with arbitrary code change. apache#6202 Triggering new build with arbitrary code change. apache#6202
Contributor
Author
|
This PR was just used to identify a possible issue with a previous PR where all tests were falsely passing. Turns out the issue was caused by a Github Workflow change. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Branch of: #6202
(which is having weird Github Action CI issues and won't build my code changes anymore.)