Skip to content

[skip ci] Nimbus testbed for nfs volume nightly test#7853

Merged
rajanashok merged 1 commit intovmware:masterfrom
rajanashok:feature/nfs-testbed
May 1, 2018
Merged

[skip ci] Nimbus testbed for nfs volume nightly test#7853
rajanashok merged 1 commit intovmware:masterfrom
rajanashok:feature/nfs-testbed

Conversation

@rajanashok
Copy link
Contributor

Updated the NFS Volume nightlies to build a full NFS test bed instead of relying on the unsupported pod placement calls.

Fixes #7642

@codecov-io
Copy link

codecov-io commented Apr 26, 2018

Codecov Report

Merging #7853 into master will decrease coverage by 4.55%.
The diff coverage is n/a.

Impacted file tree graph

@@            Coverage Diff             @@
##           master    #7853      +/-   ##
==========================================
- Coverage   31.08%   26.52%   -4.56%     
==========================================
  Files         295       36     -259     
  Lines       43723     5183   -38540     
==========================================
- Hits        13590     1375   -12215     
+ Misses      28951     3701   -25250     
+ Partials     1182      107    -1075
Impacted Files Coverage Δ
lib/install/management/configure.go
...piservers/service/restapi/handlers/vch_list_get.go
pkg/vsphere/disk/config.go
pkg/ip/ip.go
...rvers/portlayer/restapi/handlers/stream_handler.go
lib/install/validate/storage.go
lib/tether/netfilter/netfilter_linux.go
pkg/filelock/flock.go
pkg/vsphere/guest/util_linux.go
pkg/vsphere/rbac/rbac_test_util.go
... and 250 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 718f430...6d1d8ea. Read the comment docs.

@rajanashok rajanashok changed the title Nimbus testbed for nfs volume nightly test [skip ci] Nimbus testbed for nfs volume nightly test Apr 27, 2018
Close Connection

${nfs} ${nfs_ip}= Deploy Nimbus NFS Datastore %{NIMBUS_USER} %{NIMBUS_PASSWORD} additional-args=--nimbus ${POD}
${nfs} ${nfs_ro} ${esx1} ${nfs_ip} ${nfs_ro_ip} ${esx1_ip}= Deploy Nimbus NFS Datastore %{NIMBUS_USER} %{NIMBUS_PASSWORD} additional-args=--testbedSpecRubyFile /dbc/w3-dbc302/rashok/vic-nfs.rb --esxBuild ${ESX_VERSION} --esxPxeDir ${ESX_VERSION} --plugin testng
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

just make sure that path is accessible by the nightly user account

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Verified it works on svc.vicuser

@@ -0,0 +1,58 @@
#This file is needed because there are 3 functions in it which are used in this testbed.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this is wholy implied by the fact that you have required it, so not really sure the purpose of this comment


testbed = {
'version' => 3,
'name' => "vsan-1esx-allflash-#{sharedStorageStyle}-#{esxStyle}",
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

it is not allflash, it apparently has one HDD that is 250GB in size?

testbed = {
'version' => 3,
'name' => "vsan-1esx-allflash-#{sharedStorageStyle}-#{esxStyle}",
'esx' => (0..0).map do |i|
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is a single iteration loop, really not needed

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah the script had multiple ESXs to start with, will get rid of the loop.

'name' => 'dev-nfs',
'type' => 'NFS',
'nfsOpt' => 'ro',
'numMem' => 64 * 1024,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I like the memory increase, might be overkill but is there any way to specify SSD for these? and we should specify a good sized disk capacity in addition to the mem update

Copy link
Contributor Author

@rajanashok rajanashok Apr 27, 2018

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sure, may be a 8 GB memory practical one? also, looking into adding a disk, as the local-0 is running out of space during my test runs.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think 16 is probably a happy medium

'ssds' => [ 200 * oneGB, 250 * oneGB ],
'nics' => 2,
'staf' => false,
'desiredPassword' => 'ca$hc0w',
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

e2eFunctionalTest

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

'numCPUs' => 6,
'disks' => [ 250 * oneGB ],
'disableNfsMounts' => true,
'ssds' => [ 200 * oneGB, 250 * oneGB ],
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

two of these are really not needed I don't think.

'esxcli system settings kernel set -s skipPartitioningSsds -v "TRUE"', \
'services.sh restart', \
'esxcli vsan storage tag add -d mpx.vmhba1:C0:T1:L0 -t capacityFlash', \
'esxcli storage core adapter rescan --all', \
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we don't need vsan here

@rajanashok rajanashok force-pushed the feature/nfs-testbed branch from 15813ff to d9cf275 Compare May 1, 2018 16:17
@rajanashok
Copy link
Contributor Author

@mhagen-vmware Updated PR with the review comments.

'numMem' => 16 * 1024,
}],
}
testbed
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

stray comment?

'staf' => false,
'desiredPassword' => 'e2eFunctionalTest',
}],
'vsan' => true,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

un-needed

\ ${status}= Run Keyword And Return Status Should Contain ${line} ${name}.esx.0' is up. IP:
\ ${ip}= Run Keyword If ${status} Fetch From Right ${line} ${SPACE}
\ Run Keyword If ${status} Set Suite Variable ${esx-ip} ${ip}
\ Exit For Loop If ${status}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

these loops should be replaced with the 'Get IP' logic we are using in newer test cases like this:
https://github.com/vmware/vic/blob/master/tests/manual-test-cases/Group5-Functional-Tests/5-27-Selenium-Grid.robot#L33

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yup thanks, these are pretty handy! Updated the PR.

@@ -405,25 +405,39 @@ Get Vsphere Version
Deploy Nimbus NFS Datastore
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Deploy Simple NFS Testbed

@rajanashok rajanashok force-pushed the feature/nfs-testbed branch from d9cf275 to 5ec5df2 Compare May 1, 2018 17:15
Copy link
Contributor

@mhagen-vmware mhagen-vmware left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm, just a small consolidation left

Open Connection %{NIMBUS_GW}
Wait Until Keyword Succeeds 10 min 30 sec Login %{NIMBUS_USER} %{NIMBUS_PASSWORD}
${esx-ip}= Get IP ${name}.esx.0
Close Connection
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

just combine these three into a single open connection/close connection

@rajanashok rajanashok force-pushed the feature/nfs-testbed branch from 5ec5df2 to bb96a8d Compare May 1, 2018 18:39
Copy link
Contributor

@rogeliosanchez rogeliosanchez left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@rajanashok rajanashok force-pushed the feature/nfs-testbed branch from bb96a8d to 6d1d8ea Compare May 1, 2018 19:06
@rajanashok rajanashok merged commit ff6baa9 into vmware:master May 1, 2018
zjs pushed a commit to zjs/vic that referenced this pull request Jul 19, 2018
Updated the NFS Volume nightlies to build a full NFS test bed instead of relying on the unsupported pod placement calls.

Fixes vmware#7642

(cherry picked from commit ff6baa9)
zjs pushed a commit to zjs/vic that referenced this pull request Jul 27, 2018
Updated the NFS Volume nightlies to build a full NFS test bed instead of relying on the unsupported pod placement calls.

Fixes vmware#7642

(cherry picked from commit ff6baa9)
zjs pushed a commit that referenced this pull request Jul 27, 2018
Updated the NFS Volume nightlies to build a full NFS test bed instead of relying on the unsupported pod placement calls.

Fixes #7642

(cherry picked from commit ff6baa9)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants