Skip to content

Conversation

@kmelmon
Copy link
Contributor

@kmelmon kmelmon commented Aug 12, 2020

Fixes #5661

This change adds a couple things to make our E2E tests more reliable:
1 - The RNTester list is long, many items are scrolled out of view. We're seeing some reliability issues with scrolling into view before clicking. To workaround this, we're filtering the list down to the one test first.
2 - The $ selector tries to find elements without any guarantee they are in the UI yet. $ has some built-in retry logic but this logic is brittle and not reliable. I added some manual retry logic that runs before we try to click on anything in a test page.

Also in this change:

  • refactored all the existing tests to use the same mechanism, which should help ensure they are all reliable
  • removed the AAA_SmokeTest as it's no longer necessary.

With these changes we should no longer see any instabilities caused by selectors not finding elements on the page.

Microsoft Reviewers: Open in CodeFlow

@kmelmon
Copy link
Contributor Author

kmelmon commented Aug 12, 2020

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@kmelmon
Copy link
Contributor Author

kmelmon commented Aug 13, 2020

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@kmelmon kmelmon marked this pull request as ready for review August 17, 2020 22:45
@kmelmon kmelmon requested a review from a team as a code owner August 17, 2020 22:45
Copy link
Member

@vmoroz vmoroz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

:shipit:

@kmelmon kmelmon merged commit 4174941 into microsoft:master Aug 18, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

E2ETest: VisitAllPages instability

2 participants