-
Notifications
You must be signed in to change notification settings - Fork 16.4k
Simplify Integration test execution in CI #39866
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
I think that should address the recent flakiness observed in |
391954d to
8148bba
Compare
|
BTW, This one should address the last "frequent" flakiness observed in |
8148bba to
85c460b
Compare
When we run all integration tests in CI together on self-hosted runners they are somewhat flaky, however when those tests are run individually on public runners, they are both fast and stable. Also the integration test list has been somewhat duplicated - you had to remember about adding individual integration tests to the separate integration-tests workflow when you added such integration tests. This PR solves all those problems: * we always run integration tests individually * they are all run on public runners no matter what build they are on * they are run as matrix of jobs and list of tests is extracted via selective checks outputs - no more duplication
85c460b to
c6f04aa
Compare
When we run all integration tests in CI together on self-hosted runners they are somewhat flaky, however when those tests are run individually on public runners, they are both fast and stable. Also the integration test list has been somewhat duplicated - you had to remember about adding individual integration tests to the separate integration-tests workflow when you added such integration tests. This PR solves all those problems: * we always run integration tests individually * they are all run on public runners no matter what build they are on * they are run as matrix of jobs and list of tests is extracted via selective checks outputs - no more duplication
When we run all integration tests in CI together on self-hosted runners they are somewhat flaky, however when those tests are run individually on public runners, they are both fast and stable. Also the integration test list has been somewhat duplicated - you had to remember about adding individual integration tests to the separate integration-tests workflow when you added such integration tests. This PR solves all those problems: * we always run integration tests individually * they are all run on public runners no matter what build they are on * they are run as matrix of jobs and list of tests is extracted via selective checks outputs - no more duplication

When we run all integration tests in CI together on self-hosted runners they are somewhat flaky, however when those tests are run individually on public runners, they are both fast and stable. Also the integration test list has been somewhat duplicated - you had to remember about adding individual integration tests to the separate integration-tests workflow when you added such integration tests.
This PR solves all those problems:
^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named
{pr_number}.significant.rstor{issue_number}.significant.rst, in newsfragments.