Cherry-picks: Run integration tests in parallel by zjs · Pull Request #8162 · vmware/vic

zjs · 2018-07-27T22:02:46Z

Cherry-pick:

Scope the installed version of VIC in upgrade tests, so that parallel testing succeeds (f9a1600 from Scope the installed version of VIC in upgrade tests, so that parallel testing succeeds #7972)
Add basic integration tests for VCH inspect API (21f713d from Add basic integration tests for VCH inspect API #7290)
Enable Group 23 - Vic Machine Service to run in parallel under CI (280704f from Enable Group 23 - Vic Machine Service to run in parallel under CI #7961)
Provide per-suite vic-machine-server logs in CI (346982a from Provide per-suite vic-machine-server logs in CI #7978)
Improve docker cp test concurrency (e465c53 from Improve docker cp test concurrency #7987)
Address spreading use of secret tag in our curl commands (050999c from Address spreading use of secret tag in our curl commands #7862)
Remove errant file that accidentally got merged (718f430 from Remove errant file that accidentally got merged #7873)
Scope admin keywords so that they can be run in parallel (6e9a91a from Scope admin keywords so that they can be run in parallel #8005)
Scope the BC test so that it can run in parallel (0ce4c76 from Scope the BC test so that it can run in parallel #8004)
Fix the for loop in the concurrent rm test which was never working (81d4762 from Fix the for loop in the concurrent rm test which was never working #8017)
Parallelize integration tests (02ba3ad from Parallelize integration tests #5601)

[full ci]

hickeng

Only item that needs changing is the removal of the VCH-0-.... folder.

hickeng · 2018-08-01T21:56:51Z

VCH-0-1212/VCH-0-1212.env

@@ -0,0 +1 @@
+DOCKER_HOST=10.170.123.186:2376


This should not be here.

Addressed this by cherry-picking 718f430 from #7873.

Created #8170 to avoid this sort of issue in the future.

hickeng · 2018-08-01T22:01:17Z

tests/test-cases/Group1-Docker-Commands/1-06-Docker-Run.robot

    \   Log  ${res.stdout}
    \   Should Be Equal As Integers  ${res.rc}  0

+    Sleep  3 minutes


we could instead use a docker event stream for deletions with a timeout so we don't wait longer than necessary. That said, not suggesting changing it in this PR.

hickeng · 2018-08-01T22:10:55Z

tests/test-cases/Group12-VCH-BC/12-01-Delete.robot

    Log To Console  \nDownloading VIC 1.1.1 from gcp...
-    ${rc}  ${output}=  Run And Return Rc And Output  wget https://storage.googleapis.com/vic-engine-releases/vic_1.1.1.tar.gz -O vic.tar.gz
-    ${rc}  ${output}=  Run And Return Rc And Output  tar zxvf vic.tar.gz
+    ${val}=  Evaluate  time.clock()  modules=time


Seems as though this should be using Install VIC with version to Test Server but maybe there's a reason? Again, not something that needs addressing in this PR.

… testing succeeds (vmware#7972) (vmware#8162) (cherry picked from commit f9a1600)

…#8162) (cherry picked from commit 21f713d)

…ware#8162) * Implement thread safe VIC Machine Server keywords (cherry picked from commit 280704f)

…#8162) Leverage the recent change which introduced per-suite logging from vic-machine-server to provide per-suite log files. These log files will be included in the CI log bundle, and they will be written to the local filesystem when running CI locally. (cherry picked from commit 346982a)

(cherry picked from commit e465c53)

vmware#8162) (cherry picked from commit 050999c)

…#8162) (cherry picked from commit 718f430)

vmware#8162) (cherry picked from commit 6e9a91a)

…e#8162) (cherry picked from commit 0ce4c76)

…mware#8017) (vmware#8162) (cherry picked from commit 81d4762)

(cherry picked from commit 02ba3ad)

… testing succeeds (#7972) (#8162) (cherry picked from commit f9a1600)

(cherry picked from commit 21f713d)

) * Implement thread safe VIC Machine Server keywords (cherry picked from commit 280704f)

Leverage the recent change which introduced per-suite logging from vic-machine-server to provide per-suite log files. These log files will be included in the CI log bundle, and they will be written to the local filesystem when running CI locally. (cherry picked from commit 346982a)

(cherry picked from commit e465c53)

(cherry picked from commit 050999c)

(cherry picked from commit 718f430)

(cherry picked from commit 6e9a91a)

(cherry picked from commit 0ce4c76)

…8017) (#8162) (cherry picked from commit 81d4762)

zjs self-assigned this Jul 27, 2018

zjs requested a review from hickeng July 27, 2018 22:02

vmwclabot added the cla-not-required label Jul 27, 2018

DanielXiao approved these changes Jul 30, 2018

View reviewed changes

hickeng suggested changes Aug 1, 2018

View reviewed changes

mhagen-vmware and others added 11 commits August 2, 2018 13:00

Scope the installed version of VIC in upgrade tests, so that parallel…

ce1c5d8

… testing succeeds (vmware#7972) (vmware#8162) (cherry picked from commit f9a1600)

Add basic integration tests for VCH inspect API (vmware#7290) (vmware…

52e7661

…#8162) (cherry picked from commit 21f713d)

Enable Group 23 - Vic Machine Service to run in parallel under CI (vm…

1e91a5f

…ware#8162) * Implement thread safe VIC Machine Server keywords (cherry picked from commit 280704f)

Improve docker cp test concurrency (vmware#7987) (vmware#8162)

1c8d0db

(cherry picked from commit e465c53)

Address spreading use of secret tag in our curl commands (vmware#7862) (

4dc69f8

vmware#8162) (cherry picked from commit 050999c)

Remove errant file that accidentally got merged (vmware#7873) (vmware…

70e83fa

…#8162) (cherry picked from commit 718f430)

Scope admin keywords so that they can be run in parallel (vmware#8005) (

4d2589c

vmware#8162) (cherry picked from commit 6e9a91a)

Scope the BC test so that it can run in parallel (vmware#8004) (vmwar…

7db493c

…e#8162) (cherry picked from commit 0ce4c76)

Fix the for loop in the concurrent rm test which was never working (v…

693152b

…mware#8017) (vmware#8162) (cherry picked from commit 81d4762)

Parallelize integration tests (vmware#5601) (vmware#8162)

bd40925

(cherry picked from commit 02ba3ad)

zjs force-pushed the cherry/parallelism branch from da545ba to bd40925 Compare August 2, 2018 20:02

hickeng approved these changes Aug 7, 2018

View reviewed changes

zjs merged commit 89a1ca8 into vmware:releases/1.4.3 Aug 7, 2018

zjs pushed a commit that referenced this pull request Aug 7, 2018

Scope the installed version of VIC in upgrade tests, so that parallel…

9eab6b5

… testing succeeds (#7972) (#8162) (cherry picked from commit f9a1600)

zjs pushed a commit that referenced this pull request Aug 7, 2018

Add basic integration tests for VCH inspect API (#7290) (#8162)

8967f3b

(cherry picked from commit 21f713d)

zjs pushed a commit that referenced this pull request Aug 7, 2018

Enable Group 23 - Vic Machine Service to run in parallel under CI (#8162

93da6ff

) * Implement thread safe VIC Machine Server keywords (cherry picked from commit 280704f)

zjs pushed a commit that referenced this pull request Aug 7, 2018

Improve docker cp test concurrency (#7987) (#8162)

c561407

(cherry picked from commit e465c53)

zjs pushed a commit that referenced this pull request Aug 7, 2018

Address spreading use of secret tag in our curl commands (#7862) (#8162)

adb9d37

(cherry picked from commit 050999c)

zjs pushed a commit that referenced this pull request Aug 7, 2018

Remove errant file that accidentally got merged (#7873) (#8162)

95c96e7

(cherry picked from commit 718f430)

zjs pushed a commit that referenced this pull request Aug 7, 2018

Scope admin keywords so that they can be run in parallel (#8005) (#8162)

247b6f6

(cherry picked from commit 6e9a91a)

zjs pushed a commit that referenced this pull request Aug 7, 2018

Scope the BC test so that it can run in parallel (#8004) (#8162)

80c4e13

(cherry picked from commit 0ce4c76)

zjs pushed a commit that referenced this pull request Aug 7, 2018

Fix the for loop in the concurrent rm test which was never working (#…

01ed0ae

…8017) (#8162) (cherry picked from commit 81d4762)

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Cherry-picks: Run integration tests in parallel#8162

Cherry-picks: Run integration tests in parallel#8162
zjs merged 11 commits intovmware:releases/1.4.3from
zjs:cherry/parallelism

zjs commented Jul 27, 2018 •

edited

Loading

Uh oh!

hickeng left a comment

Uh oh!

hickeng Aug 1, 2018

Uh oh!

zjs Aug 2, 2018

Uh oh!

zjs Aug 2, 2018

Uh oh!

hickeng Aug 1, 2018

Uh oh!

hickeng Aug 1, 2018

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

		@@ -0,0 +1 @@
		DOCKER_HOST=10.170.123.186:2376 No newline at end of file

Conversation

zjs commented Jul 27, 2018 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

hickeng left a comment

Choose a reason for hiding this comment

Uh oh!

hickeng Aug 1, 2018

Choose a reason for hiding this comment

Uh oh!

zjs Aug 2, 2018

Choose a reason for hiding this comment

Uh oh!

zjs Aug 2, 2018

Choose a reason for hiding this comment

Uh oh!

hickeng Aug 1, 2018

Choose a reason for hiding this comment

Uh oh!

hickeng Aug 1, 2018

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

zjs commented Jul 27, 2018 •

edited

Loading