Test failure: System.Diagnostics.Tests.ProcessTests.MainWindowTitle_GetWithGui_ShouldRefresh_Windows

[v-haren]

failed in job: https://dev.azure.com/dnceng/public/_build/results?buildId=929390&view=ms.vss-test-web.build-test-results-tab&runId=29452414&resultId=101161&paneView=debug

failed tests:
System.Diagnostics.Tests.ProcessTests.MainWindowTitle_GetWithGui_ShouldRefresh_Windows
System.Diagnostics.Tests.ProcessTests.MainWindowHandle_GetWithGui_ShouldRefresh_Windows

net6.0-windows-Release-x64-CoreCLR_release-(Windows.Server.Core.1909.Amd64.Open)windows.10.amd64.server20h1.open@mcr.microsoft.com/dotnet-buildtools/prereqs:windowsservercore-2004-helix-amd64-20200904200251-272704c

Error message

Assert.NotEqual() Failure
Expected: Not ""
Actual:   ""

Stack trace
   at System.Diagnostics.Tests.ProcessTests.MainWindowTitle_GetWithGui_ShouldRefresh_Windows() in /_/src/libraries/System.Diagnostics.Process/tests/ProcessTests.cs:line 1619

Tagging subscribers to this area: @tommcdon, @krwq
See info in area-owners.md if you want to be subscribed.

Issue Details

---

failed in job: https://dev.azure.com/dnceng/public/_build/results?buildId=929390&view=ms.vss-test-web.build-test-results-tab&runId=29452414&resultId=101161&paneView=debug

failed tests:
System.Diagnostics.Tests.ProcessTests.MainWindowTitle_GetWithGui_ShouldRefresh_Windows
System.Diagnostics.Tests.ProcessTests.MainWindowHandle_GetWithGui_ShouldRefresh_Windows

net6.0-windows-Release-x64-CoreCLR_release-(Windows.Server.Core.1909.Amd64.Open)windows.10.amd64.server20h1.open@mcr.microsoft.com/dotnet-buildtools/prereqs:windowsservercore-2004-helix-amd64-20200904200251-272704c

Error message

Assert.NotEqual() Failure
Expected: Not ""
Actual:   ""

Stack trace
   at System.Diagnostics.Tests.ProcessTests.MainWindowTitle_GetWithGui_ShouldRefresh_Windows() in /_/src/libraries/System.Diagnostics.Process/tests/ProcessTests.cs:line 1619

Author:	v-haren
Assignees:	-
Labels:	area-System.Diagnostics, untriaged
Milestone:	-

Tagging subscribers to this area: @eiriktsarpalis
See info in area-owners.md if you want to be subscribed.

Issue Details

---

failed in job: https://dev.azure.com/dnceng/public/_build/results?buildId=929390&view=ms.vss-test-web.build-test-results-tab&runId=29452414&resultId=101161&paneView=debug

failed tests:
System.Diagnostics.Tests.ProcessTests.MainWindowTitle_GetWithGui_ShouldRefresh_Windows
System.Diagnostics.Tests.ProcessTests.MainWindowHandle_GetWithGui_ShouldRefresh_Windows

net6.0-windows-Release-x64-CoreCLR_release-(Windows.Server.Core.1909.Amd64.Open)windows.10.amd64.server20h1.open@mcr.microsoft.com/dotnet-buildtools/prereqs:windowsservercore-2004-helix-amd64-20200904200251-272704c

Error message

Assert.NotEqual() Failure
Expected: Not ""
Actual:   ""

Stack trace
   at System.Diagnostics.Tests.ProcessTests.MainWindowTitle_GetWithGui_ShouldRefresh_Windows() in /_/src/libraries/System.Diagnostics.Process/tests/ProcessTests.cs:line 1619

Author:	v-haren
Assignees:	-
Labels:	area-System.Diagnostics.Process, untriaged
Milestone:	-

[danmoseley]

@adamsitnik these fail consistently on Server Core. MainWindowTitle_GetWithGui_ShouldRefresh_Windows needs to be disabled on this OS, for reasons explained in #44972

https://engsrvprod.kusto.windows.net/engineeringdata?query=H4sIAAAAAAAEAI1RwWoCMRC9F%2foPgyeFLa4eC1uwSK0FC9UFjzJuRhN3N5HJBLH045t1bfXgQRjI5OXNey9JTl7m5EMlHh4ffuCgiQlmJNopyDLozNDYpbHKHXIjFa0mJEsjehLMaqFdqNScNkxer1qS74Dj2%2fPvaNU9Ak2MnTMWyghkxlpiWDoup0K1B2f%2fN1N1FfnNWOM1KXjJQKGQmJq6w3SYPg2GsSB9Tpvq3VL%2fcOuTcFyn6iL5ymgLfboF08b3NaHy%2fRq9EJ9S7tntqBBYCLKQSmAcGMU4m5xfIIGvQIE%2bsaYG8h63sYn0oswZi9iPeBtqsuITyI97Og%2bMKoMRGbuiJM5x2x4OEmi%2fqvH2oa6RzTdB4YKVbg%2fWx4vFn33Lv4rxC2CGioDwAQAA&web=0

TestResults 
| where Method == "MainWindowTitle_GetWithGui_ShouldRefresh_Windows" or Method == "MainWindowHandle_GetWithGui_ShouldRefresh_Windows"
| join kind=inner WorkItems on WorkItemId 
| where Finished >= datetime(2020-12-12 0:00:00)
| join kind=inner Jobs on JobId
| where Branch == "refs/heads/master"
| project Started, Duration, Method, QueueName, Message, StackTrace, Arguments, Type, QueueAlias, DockerTag, Type1, Result
| summarize count() by Message, Method, Result, QueueName

Message	Method	Result	QueueName	count_
Assert.NotEqual() Failure\r\nExpected: Not 0\r\nActual: 0	MainWindowHandle_GetWithGui_ShouldRefresh_Windows	Fail	windows.10.amd64.server20h1.open.rt	4
Assert.NotEqual() Failure\r\nExpected: Not ""\r\nActual: ""	MainWindowTitle_GetWithGui_ShouldRefresh_Windows	Fail	windows.10.amd64.server20h1.open.rt	4

I don't know about MainWindowHandle_GetWithGui_ShouldRefresh_Windows but perhaps also reasonable to disable on this OS..

Note that there are no results from other Windows SKU's - I assume this is unrelated and I'll have a look.

[danmoseley]

BTW, in MainWindowTitle_GetWithGui_ShouldRefresh_Windows() is Assert.Equal(string.Empty, process.MainWindowTitle); racing with Notepad setting the title? As far as I can see when it's retrieved the first time it reads the live value. Seems that line ought to be removed.

[adamsitnik]

@danmosemsft thanks for keeping an eye on it and sharing the Kusto Query! I've sent #46387 with a fix.

For some reason, all the System.Diagnostics.Process tests belong to System.Diagnostics.Tests namespace which contains more than just the Process tests. Would it be acceptable to move the Process tests to the System.Diagnostics.Process.Tests namespace? (cc @eiriktsarpalis)

It would allow be for easier filtering of the failed tests. And perhaps help a little the labeling bot?

[danmoseley]

I have no opinion.