Skip to content

{Test} Fix cloud tests#14994

Merged
fengzhou-msft merged 4 commits intoAzure:devfrom
fengzhou-msft:fix_cloud_tests
Sep 7, 2020
Merged

{Test} Fix cloud tests#14994
fengzhou-msft merged 4 commits intoAzure:devfrom
fengzhou-msft:fix_cloud_tests

Conversation

@fengzhou-msft
Copy link
Member

@fengzhou-msft fengzhou-msft commented Aug 31, 2020

Description

When running cloud tests in parallel, it may fail to revert to the original cloud settings. The tests relies on setup() to get the original active cloud and tearDown() to set back to the original cloud. But when running in parallel, if the original cloud is A, it is possible that process 1 runs a test to set to cloud B, then process 2 begins and treats cloud B as the original cloud in enviroment. Process 1 finishes and set the cloud back to A, process 2 finishes and set the cloud back to B. Now the cloud of the environemnt changes from cloud A to cloud B. This will cause issues with other tests running afterwards.

This PR modifies package tests to run cloud tests in serial and add serial_test mark to run in serial in live test pipeline.

Testing Guide

History Notes

[Component Name 1] BREAKING CHANGE: az command a: Make some customer-facing breaking change.
[Component Name 2] az command b: Add some customer-facing feature.


This checklist is used to make sure that common guidelines for a pull request are followed.

@Azure Azure deleted a comment from yonzhan Sep 1, 2020

for mod_name in mod_list:
if mod_name in ['botservice', 'network']:
if mod_name in ['botservice', 'network', 'cloud']:
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What's the purpose of this line

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Add cloud to the modules that need to be run in serial.

@fengzhou-msft fengzhou-msft merged commit b5cc347 into Azure:dev Sep 7, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants