We found 3 tests flaky

[shaker-project]

We run your test cases for 50 times and found that the following tests are flaky [1] (i.e., they pass or fail non-deterministically):

• testExternalBarHiddenWhenViewingAllApps
• testKissBarEmptiesSearch
• testSearchResultAppears

We ran these tests on a generic Android Emulator (AVD) with Android API version 28.

To reproduce failures on these tests, please run the following script on gist:
https://gist.github.com/shaker-project/f61c9a7d6da2d41b4b4afff2cb742a3b

We require that stress-ng is installed. If not, run $> sudo apt-get install stress-ng.

If you confirm this behavior, our suggestion is to add the annotation @testflaky on these tests. See https://developer.android.com/reference/androidx/test/filters/FlakyTest

If you wish for a repair proposal, please let us know.

[1] https://hackernoon.com/flaky-tests-a-war-that-never-ends-9aa32fdef359

[Neamar]

Thanks, but not super interested in upgrading the test suite, it isn't used for now.