[VM/VMSS] Improved disk caching support by tjprescott · Pull Request #2522 · Azure/azure-cli

tjprescott · 2017-03-15T21:25:11Z

Closes #2497.

VMSS create no longer adds template variables regarding storage account unless storage accounts will be created. While these didn't do anything before if storage accounts weren't created, it was confusing when you would view the template.
Adds an alias to vm/vmss create for OS disk caching. The existing --storage-caching exists alongside --os-caching. The intent is that --storage-caching will be deprecated and removed in the future. (Issue 'vm/vmss create': deprecate and remove --storage-caching #2523)
Adds --data-caching to vm/vmss create which is the caching type used for data disks.
Adds --caching to vm disk/vmss disk/vm unmanaged-disk attach command.
Reflects on the SDK's CachingType object to expose all caching types (including None). Due to a bug in the Swagger (OS Disk Caching for VM/VMSS OSProfile should not support None azure-rest-api-specs#1044), I manually omit "None" from the list of OS Disk caching types.
Removes the hard coded default values for caching and allows the service to apply defaults if not specified. For VMSS, which defaults to a supposedly invalid caching value of "None", I set the default to "ReadWrite" to match VM create.

codecov-io · 2017-03-15T22:07:16Z

Codecov Report

Merging #2522 into master will increase coverage by <.01%.
The diff coverage is 89.47%.

@@            Coverage Diff            @@
##           master   #2522      +/-   ##
=========================================
+ Coverage    72.1%   72.1%   +<.01%     
=========================================
  Files         362     362              
  Lines       19790   19791       +1     
  Branches     2920    2920              
=========================================
+ Hits        14269   14270       +1     
  Misses       4600    4600              
  Partials      921     921

Impacted Files	Coverage Δ
.../azure/cli/command_modules/vm/_template_builder.py	`80.95% <0%> (ø)`	✅
...ure-cli-vm/azure/cli/command_modules/vm/_params.py	`96.05% <100%> (+0.01%)`	✅
...zure-cli-vm/azure/cli/command_modules/vm/custom.py	`73.82% <100%> (ø)`	✅
...cli-vm/azure/cli/command_modules/vm/_validators.py	`72.17% <75%> (ø)`	✅

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 9a31807...79cd649. Read the comment docs.

yugangw-msft

LGTM to overall. Left a few suggestions

yugangw-msft · 2017-03-16T16:43:38Z

src/command_modules/azure-cli-vm/azure/cli/command_modules/vm/_template_builder.py

I suggest exposing --os-disk-caching and --data-disk-caching. Were this PR out last month, these short names look pretty good; but now with customdata and secret support, it is necessary to be a bit complete to avoid potential confusions.

I prefer to keep this short. It is consistent with --os-type (which refers to a disk) and is in the storage argument group, so I think it's pretty clear.

With help it will be clear, but there is also a scenario that when you read existing commands, the meaning should be clear w/o referring to help.
There are lots and lots of caching mechanisms in the whole stack from CPU cache to the web page cache at the top, so when I talk about cache, I have to be very specific on the term and context, otherwise people would not understand. This is why I am not quite into the argument naming of --os-caching, and --data-cache, because they could mean lots of different things.
However, I would not let my own experience/knowledge to determine the naming for wide audience. So /cc: @gbowerman @gatneil, if they are fine with this short naming, I will be fine too.

Although longer, we probably need 'disk' in the names for clarity, e.g. --os-disk-caching, --data-disk-caching, or --os-disk-cache, --data-disk-cache.

yugangw-msft · 2017-03-16T16:50:09Z

src/command_modules/azure-cli-vm/azure/cli/command_modules/vm/_template_builder.py

Please set the caching on data disks coming with the managed image itself. The code is about 10 lines above

yugangw-msft · 2017-03-16T16:53:33Z

src/command_modules/azure-cli-vm/azure/cli/command_modules/vm/_template_builder.py

since we are here, please fix it to be [StorageProfile.ManagedPirImage, StorageProfile.ManagedCustomImage]

yugangw-msft · 2017-03-16T16:57:16Z

src/command_modules/azure-cli-vm/azure/cli/command_modules/vm/_validators.py

i think for any unmanaged storage profiles, the data_caching would not apply, hence we should error

yugangw-msft · 2017-03-16T17:04:31Z

src/command_modules/azure-cli-vm/azure/cli/command_modules/vm/_params.py

My understanding is we should set Read/Write to OS Disk for VMSS, as the service default as None is not favorable

Yes, the latest email says it should be whatever VM is, which is ReadWrite.

Also, I suppressed "None" from the enum for OS caching.

tjprescott · 2017-03-17T21:24:50Z

@yugangw-msft changes made

* Azure/master: (478 commits) vm live test: allow more valid power states on vmss test verifications (Azure#2564) rbac:catch more graph error (Azure#2567) appservice: support to create plan when create a webapp (Azure#2550) Update storage tests (Azure#2556) Change PEP8 check filter from whitelist to blacklist (Azure#2557) Add scenario tests documentation (Azure#2555) [ACS] Adding support for configuring a default ACS cluster (Azure#2554) [ACS] Provide a short name alias for the orchestrator type flag (Azure#2553) Sql Import/Export CLI commands and test (Azure#2538) Fix format bug. (Azure#2549) [VM/VMSS] Improved disk caching support (Azure#2522) VM/VMSS: incorporate credentials validation logic used by portal (Azure#2537) Script that creates packaged releases package archive (Azure#2508) Adding alias for defaults flag (Azure#2540) Add wait commands and --no-wait support (Azure#2524) choice list outside of named arguments (Azure#2521) Fixed test failure in test_sql_db_mgmt. (Azure#2530) core: support login using service principal with a cert (Azure#2457) Add note about being in preview (Azure#2512) vm:fix distro check mechanism used by disk encryption (Azure#2511) ...

tjprescott added the Compute az vm/vmss/image/disk/snapshot label Mar 15, 2017

tjprescott added this to the Sprint 14 milestone Mar 15, 2017

tjprescott requested a review from yugangw-msft March 15, 2017 21:25

msftclas added the cla-not-required label Mar 15, 2017

tjprescott mentioned this pull request Mar 15, 2017

'vm/vmss create': deprecate and remove --storage-caching #2523

Closed

yugangw-msft reviewed Mar 16, 2017

View reviewed changes

tjprescott added 2 commits March 16, 2017 16:43

Enable separate os/disk caching mechanisms.

31f793e

Code review feedback.

79cd649

yugangw-msft approved these changes Mar 17, 2017

View reviewed changes

tjprescott merged commit b9c09d2 into Azure:master Mar 17, 2017

tjprescott deleted the SupportBigOlVMSS branch March 17, 2017 21:30

haroldrandom added cla-not-required Compute az vm/vmss/image/disk/snapshot labels Oct 25, 2019

Conversation

tjprescott commented Mar 15, 2017 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

codecov-io commented Mar 15, 2017 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Codecov Report

Uh oh!

yugangw-msft left a comment

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

tjprescott commented Mar 17, 2017

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

tjprescott commented Mar 15, 2017 •

edited

Loading

codecov-io commented Mar 15, 2017 •

edited

Loading