[Bug Report]: New Diagnostic settings do not support retention

[chris-gibbs]

Describe the bug

Receiving an error when trying to deploy a storage account with Diagnostic settings enabled.

I believe it may be related the timelines identified in
https://learn.microsoft.com/en-us/azure/azure-monitor/essentials/migrate-to-azure-storage-lifecycle-policy

Will need a fix for storage account, blob, file, table and queue.

Currently I'm just commenting out but will most likely need further work to clean up old params no longer required.

var diagnosticsMetrics = [for metric in diagnosticMetricsToEnable: {
  category: metric
  timeGrain: null
  enabled: true
  // https://learn.microsoft.com/en-us/azure/azure-monitor/essentials/migrate-to-azure-storage-lifecycle-policy
  //retentionPolicy: {
  //  enabled: true
  //  days: diagnosticLogsRetentionInDays
  //}
}]

To reproduce

Deploy storage with Diagnostic settings enabled

Code snippet

No response

Relevant log output

{
  "code": "BadRequest",
  "message": "Diagnostic settings does not support retention for new diagnostic settings."
}

[johnparkpq]

Same issue with the /network/network-interfaces and /network/public-ip-addresses modules when deploying VMs.
Commented out retentionPolicy sections in the above modules as suggested by @chris-gibbs as a workaround.

[AlexanderSehr]

Hey @chris-gibbs & @johnparkpq , thanks for raising this. I'll take a closer look how to best solve this but would in general suggest to not fix it just for 1, 2 or 3 modules, but for all in one go (assuming that all Providers are supporting the lifecylce changes).

[joehubbert]

Hi @AlexanderSehr I just noticed this issue today, is there a fix planned for this?

[AlexanderSehr]

Hi @AlexanderSehr I just noticed this issue today, is there a fix planned for this?

Hey @joehubbert, not yet planned, but it should be fixed. I'm currently on vacation and hence didn't have a closer look yet. I will however try once I'm back next week.

[rezamanshouri]

Encountered the same problem for Storage Account (blob and queue), Event Grid, and cosmos DB.

[VanathiGanesh]

Our team is encountering the same issue - when can we expect a fix?

[Mercy-Markus]

Same for my team as well. We have diagnostic settings enable on our App Services.

[kschinspari]

Our deployment scripts are failing because of this. It started today.
Any updates would be much appreciated.

[DenisBalan]

Same problem, any eta? was there any information about this deprecation prior to this?

For us, its a major impact as the infrastructure that we provision, suddently fails for all types of resources that had retentionPolicy enabled from terraform.

Thanks.

[rezamanshouri]

Looks like this is the new expected behavior (they just missed the deadline): https://learn.microsoft.com/en-us/azure/azure-monitor/essentials/migrate-to-azure-storage-lifecycle-policy