Test failure: System.Security.Cryptography.X509Certificates.Tests.ChainTests.VerifyWithRevocation

[v-haren]

failed in job: runtime-libraries-coreclr outerloop 20200907.3

net5.0-Linux-Release-arm64-CoreCLR_release-(Ubuntu.1804.ArmArch.Open)Ubuntu.1804.ArmArch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-16.04-helix-arm64v8-bfcd90a-20200127194925

Error message

Assert.Equal() Failure
Expected: 3
Actual:   2


Stack trace
   at System.Security.Cryptography.X509Certificates.Tests.ChainTests.VerifyWithRevocation() in /_/src/libraries/System.Security.Cryptography.X509Certificates/tests/ChainTests.cs:line 785

Tagging subscribers to this area: @bartonjs, @vcsjones, @krwq, @jeffhandley
See info in area-owners.md if you want to be subscribed.

[vcsjones]

This is probably related to the expiring intermediate as noted in #40708. I’ll see if I can either fix this test or re-write it in terms of DynamicChainTests.

[vcsjones]

Actually I think this might have just been a networking hiccup or another intermittent issue. This test is passing for me locally. I tested in an Ubuntu 18.04 ARM64 environment and it still passes.

dotnet test --filter VerifyWithRevocation /p:OuterLoop=true

Test Run Successful.
Total tests: 1
Passed: 1
Total time: 2.8526 Seconds

[krwq]

@v-haren can you confirm this is a single instance or do you get consistent repro?

[v-haren]

I couldn't repro this. It did not appear in the recent failed.

[krwq]

Considering this looks like could have been caused by the network hiccup and we have only a single instance of this I'll close this issue as no repro. Please re-open if this happens again and we'll need to find some way to write a test in more reliable way.

[krwq]

Thanks @vcsjones for the investigation!

[v-haren]

failed again in job: runtime-libraries-coreclr outerloop 20200922.1

failed test: System.Security.Cryptography.X509Certificates.Tests.ChainTests.VerifyWithRevocation

net5.0-Linux-Release-arm64-CoreCLR_release-(Ubuntu.1804.ArmArch.Open)Ubuntu.1804.ArmArch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-16.04-helix-arm64v8-bfcd90a-20200127194925

Error message

Assert.Equal() Failure
Expected: 3
Actual:   2


Stack trace
   at System.Security.Cryptography.X509Certificates.Tests.ChainTests.VerifyWithRevocation() in /_/src/libraries/System.Security.Cryptography.X509Certificates/tests/ChainTests.cs:line 785