Test failure: X509Certificates .. RevokeEndEntityWithInvalidRevocationName (Windows)

[antonfirsov]

Test case

System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.RevokeEndEntityWithInvalidRevocationName(pkiOptions: CrlEverywhere)

Failed in

#47781
https://dev.azure.com/dnceng/public/_build/results?buildId=983443&view=ms.vss-test-web.build-test-results-tab&runId=30814998&paneView=debug&resultId=104251

Queue: net6.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server19H1.ES.Open

Error message

Assert.Equal() Failure\r\nExpected: X509ChainStatusFlags[] [NoError, NoError, RevocationStatusUnknown | OfflineRevocation]\r\nActual:   X509ChainStatusFlags[] [NoError, RevocationStatusUnknown | OfflineRevocation, RevocationStatusUnknown | OfflineRevocation]

Stack trace

Details

at System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.AssertChainStatus(X509Chain chain, X509ChainStatusFlags rootStatus, X509ChainStatusFlags issrStatus, X509ChainStatusFlags leafStatus) in /_/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/DynamicRevocationTests.cs:line 1434
   at System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.RunWithInconclusiveEndEntityRevocation(ChainHolder holder, X509Certificate2 endEntity) in /_/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/DynamicRevocationTests.cs:line 1184
   at System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.RevokeEndEntityWithInvalidRevocation(ChainHolder holder, CertificateAuthority intermediate, X509Certificate2 endEntity) in /_/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/DynamicRevocationTests.cs:line 1121
   at System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.<>c.<RevokeEndEntityWithInvalidRevocationName>b__23_0(CertificateAuthority root, CertificateAuthority intermediate, X509Certificate2 endEntity, ChainHolder holder, RevocationResponder responder) in /_/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/DynamicRevocationTests.cs:line 868
   at System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.SimpleTest(PkiOptions pkiOptions, RunSimpleTest callback, String callerName, Boolean pkiOptionsInTestName) in /_/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/DynamicRevocationTests.cs:line 1406
   at System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.RevokeEndEntityWithInvalidRevocationName(PkiOptions pkiOptions) in /_/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/DynamicRevocationTests.cs:line 862

Additional info

According to Kusto, this is a very rare failure. RevokeEndEntityWithInvalidRevocationName has about 3 records in the last 2 months, all with different args, all on Windows.

Tagging subscribers to this area: @bartonjs, @vcsjones, @krwq, @GrabYourPitchforks
See info in area-owners.md if you want to be subscribed.

Issue Details

---

Test case

System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.RevokeEndEntityWithInvalidRevocationName(pkiOptions: CrlEverywhere)

Failed in

#47781
https://dev.azure.com/dnceng/public/_build/results?buildId=983443&view=ms.vss-test-web.build-test-results-tab&runId=30814998&paneView=debug&resultId=104251

Queue: net6.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server19H1.ES.Open

Error message

Assert.Equal() Failure\r\nExpected: X509ChainStatusFlags[] [NoError, NoError, RevocationStatusUnknown | OfflineRevocation]\r\nActual:   X509ChainStatusFlags[] [NoError, RevocationStatusUnknown | OfflineRevocation, RevocationStatusUnknown | OfflineRevocation]

Stack trace

Details

at System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.AssertChainStatus(X509Chain chain, X509ChainStatusFlags rootStatus, X509ChainStatusFlags issrStatus, X509ChainStatusFlags leafStatus) in /_/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/DynamicRevocationTests.cs:line 1434
   at System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.RunWithInconclusiveEndEntityRevocation(ChainHolder holder, X509Certificate2 endEntity) in /_/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/DynamicRevocationTests.cs:line 1184
   at System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.RevokeEndEntityWithInvalidRevocation(ChainHolder holder, CertificateAuthority intermediate, X509Certificate2 endEntity) in /_/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/DynamicRevocationTests.cs:line 1121
   at System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.<>c.<RevokeEndEntityWithInvalidRevocationName>b__23_0(CertificateAuthority root, CertificateAuthority intermediate, X509Certificate2 endEntity, ChainHolder holder, RevocationResponder responder) in /_/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/DynamicRevocationTests.cs:line 868
   at System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.SimpleTest(PkiOptions pkiOptions, RunSimpleTest callback, String callerName, Boolean pkiOptionsInTestName) in /_/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/DynamicRevocationTests.cs:line 1406
   at System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.RevokeEndEntityWithInvalidRevocationName(PkiOptions pkiOptions) in /_/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/DynamicRevocationTests.cs:line 862

Additional info

According to Kusto, this is a very rare failure. RevokeEndEntityWithInvalidRevocationName has about 3 records in the last 2 months, all with different args, all on Windows.

Author:	antonfirsov
Assignees:	-
Labels:	area-System.Security, untriaged
Milestone:	-

[bartonjs]

Since April 1st there have been 35 total failures from DynamicRevocationTests. 28 were good old 0xC0000001 on Windows. The remaining 7 hits were all timeouts (or some other reason why RevocationUnknown was returned).

So we could probably add some RetryHelper to this class to reduce the 7 valid failures. Since it's a relatively small change that should help make servicing easier, I'll leave this at 6.0.