EMSDK-.WasmNativeDefaultsTests work item failing

[runfoapp]

Runfo Tracking Issue: EMSDK-.WasmNativeDefaultsTests work item failing

Build	Definition	Kind	Run Name	Console	Core Dump	Test Results	Run Client
1758177	runtime	PR 68991	net7.0-Browser-Release-wasm-Mono_Release_Linux-BuildWasmApps-Ubuntu.1804.Amd64.Open	console.log	core dump	test results	runclient.py
1756138	runtime	PR 68126	net7.0-Browser-Release-wasm-Mono_Release_Linux-BuildWasmApps-Ubuntu.1804.Amd64.Open	console.log	core dump	test results	runclient.py
1754800	runtime	PR 66147	net7.0-Browser-Release-wasm-Mono_Release_Linux-BuildWasmApps-Ubuntu.1804.Amd64.Open	console.log			runclient.py
1754259	runtime	PR 66147	net7.0-Browser-Release-wasm-Mono_Release_Linux-BuildWasmApps-Ubuntu.1804.Amd64.Open	console.log			runclient.py
1752402	runtime	PR 66147	net7.0-Browser-Release-wasm-Mono_Release_Linux-BuildWasmApps-Ubuntu.1804.Amd64.Open	console.log			runclient.py
1750315	runtime	Rolling	net7.0-Browser-Release-wasm-Mono_Release_Linux-BuildWasmApps-Ubuntu.1804.Amd64.Open	console.log		test results	runclient.py
1749104	runtime	PR 68801	net7.0-Browser-Release-wasm-Mono_Release_Linux-BuildWasmApps-Ubuntu.1804.Amd64.Open	console.log		test results	runclient.py
1744053	runtime	PR 66304	net7.0-Browser-Release-wasm-Mono_Release_Linux-BuildWasmApps-Ubuntu.1804.Amd64.Open	console.log		test results	runclient.py
1729244	runtime	PR 67883	net7.0-Browser-Release-wasm-Mono_Release_Linux-BuildWasmApps-Ubuntu.1804.Amd64.Open	console.log	core dump	test results	runclient.py
1725717	runtime	PR 68077	net7.0-Browser-Release-wasm-Mono_Release_Linux-BuildWasmApps-Ubuntu.1804.Amd64.Open	console.log	core dump	test results	runclient.py
1725600	runtime	Rolling	net7.0-Browser-Release-wasm-Mono_Release_Linux-BuildWasmApps-Ubuntu.1804.Amd64.Open	console.log	core dump	test results	runclient.py
1718025	runtime	PR 68024	net7.0-Browser-Release-wasm-Mono_Release_Linux-BuildWasmApps-Ubuntu.1804.Amd64.Open	console.log		test results	runclient.py
1716274	runtime	Rolling	net7.0-Browser-Release-wasm-Mono_Release_Linux-BuildWasmApps-Ubuntu.1804.Amd64.Open	console.log		test results	runclient.py
1712733	runtime	PR 67773	net7.0-Browser-Release-wasm-Mono_Release_Linux-BuildWasmApps-Ubuntu.1804.Amd64.Open	console.log	core dump	test results	runclient.py
1712633	runtime	PR 67771	net7.0-Browser-Release-wasm-Mono_Release_Linux-BuildWasmApps-Ubuntu.1804.Amd64.Open	console.log		test results	runclient.py
1712034	runtime	PR 67771	net7.0-Browser-Release-wasm-Mono_Release_Linux-BuildWasmApps-Ubuntu.1804.Amd64.Open	console.log		test results	runclient.py
1711717	runtime	PR 67676	net7.0-Browser-Release-wasm-Mono_Release_Linux-BuildWasmApps-Ubuntu.1804.Amd64.Open	console.log	core dump	test results	runclient.py
1711187	runtime	PR 67771	net7.0-Browser-Release-wasm-Mono_Release_Linux-BuildWasmApps-Ubuntu.1804.Amd64.Open	console.log		test results	runclient.py
1710393	runtime	PR 67771	net7.0-Browser-Release-wasm-Mono_Release_Linux-BuildWasmApps-Ubuntu.1804.Amd64.Open	console.log		test results	runclient.py
1710148	runtime	PR 67771	net7.0-Browser-Release-wasm-Mono_Release_Linux-BuildWasmApps-Ubuntu.1804.Amd64.Open	console.log		test results	runclient.py
1709042	runtime	PR 61776	net7.0-Browser-Release-wasm-Mono_Release_Linux-BuildWasmApps-Ubuntu.1804.Amd64.Open	console.log		test results	runclient.py
1708510	runtime	PR 67771	net7.0-Browser-Release-wasm-Mono_Release_Linux-BuildWasmApps-Ubuntu.1804.Amd64.Open	console.log		test results	runclient.py

Build Result Summary

Day Hit Count	Week Hit Count	Month Hit Count
0	0	8

I couldn't figure out the best area label to add to this issue. If you have write-permissions please help me learn by adding exactly one area label.

[radical]

Issue is being tracked at dotnet/arcade#9025

Tagging subscribers to 'arch-wasm': @lewing
See info in area-owners.md if you want to be subscribed.

Issue Details

---

Runfo Tracking Issue: EMSDK-.WasmNativeDefaultsTests work item failing

Build	Definition	Kind	Run Name	Console	Core Dump	Test Results	Run Client
1712733	runtime	PR 67773	net7.0-Browser-Release-wasm-Mono_Release_Linux-BuildWasmApps-Ubuntu.1804.Amd64.Open	console.log	core dump	test results	runclient.py
1712633	runtime	PR 67771	net7.0-Browser-Release-wasm-Mono_Release_Linux-BuildWasmApps-Ubuntu.1804.Amd64.Open	console.log		test results	runclient.py
1712034	runtime	PR 67771	net7.0-Browser-Release-wasm-Mono_Release_Linux-BuildWasmApps-Ubuntu.1804.Amd64.Open	console.log		test results	runclient.py
1711717	runtime	PR 67676	net7.0-Browser-Release-wasm-Mono_Release_Linux-BuildWasmApps-Ubuntu.1804.Amd64.Open	console.log	core dump	test results	runclient.py
1711187	runtime	PR 67771	net7.0-Browser-Release-wasm-Mono_Release_Linux-BuildWasmApps-Ubuntu.1804.Amd64.Open	console.log		test results	runclient.py
1710393	runtime	PR 67771	net7.0-Browser-Release-wasm-Mono_Release_Linux-BuildWasmApps-Ubuntu.1804.Amd64.Open	console.log		test results	runclient.py
1710148	runtime	PR 67771	net7.0-Browser-Release-wasm-Mono_Release_Linux-BuildWasmApps-Ubuntu.1804.Amd64.Open	console.log		test results	runclient.py
1709042	runtime	PR 61776	net7.0-Browser-Release-wasm-Mono_Release_Linux-BuildWasmApps-Ubuntu.1804.Amd64.Open	console.log		test results	runclient.py
1708510	runtime	PR 67771	net7.0-Browser-Release-wasm-Mono_Release_Linux-BuildWasmApps-Ubuntu.1804.Amd64.Open	console.log		test results	runclient.py

Build Result Summary

Day Hit Count	Week Hit Count	Month Hit Count
4	9	9

Author:	runfoapp[bot]
Assignees:	-
Labels:	arch-wasm, untriaged, area-VM-meta-mono
Milestone:	-

[jakobbotsch]

That issue was closed @radical.
There are now new failures in the latest rolling build that look related to the Emscripten SDK:

[upv2xixw.rdh]   non_async_main_args_Release_False -> /datadisks/disk1/work/AA0C094A/w/9FA308C4/e/upv2xixw.rdh/bin/Release/net7.0/browser-wasm/publish/
[upv2xixw.rdh]   Traceback (most recent call last):
[upv2xixw.rdh]     File "/datadisks/disk1/work/AA0C094A/p/build/emsdk/upstream/emscripten/emcc.py", line 23, in <module>
[upv2xixw.rdh]       from tools.toolchain_profiler import ToolchainProfiler
[upv2xixw.rdh]   ModuleNotFoundError: No module named 'tools'
[upv2xixw.rdh] /datadisks/disk1/work/AA0C094A/p/build/wasm/WasmApp.Native.targets(474,5): error : Traceback (most recent call last): [/datadisks/disk1/work/AA0C094A/w/9FA308C4/e/upv2xixw.rdh/non_async_main_args_Release_False.csproj]
[upv2xixw.rdh] /datadisks/disk1/work/AA0C094A/p/build/wasm/WasmApp.Native.targets(474,5): error :   File "/datadisks/disk1/work/AA0C094A/p/build/emsdk/upstream/emscripten/emcc.py", line 23, in <module> [/datadisks/disk1/work/AA0C094A/w/9FA308C4/e/upv2xixw.rdh/non_async_main_args_Release_False.csproj]
[upv2xixw.rdh] /datadisks/disk1/work/AA0C094A/p/build/wasm/WasmApp.Native.targets(474,5): error :     from tools.toolchain_profiler import ToolchainProfiler [/datadisks/disk1/work/AA0C094A/w/9FA308C4/e/upv2xixw.rdh/non_async_main_args_Release_False.csproj]
[upv2xixw.rdh] /datadisks/disk1/work/AA0C094A/p/build/wasm/WasmApp.Native.targets(474,5): error : ModuleNotFoundError: No module named 'tools' [/datadisks/disk1/work/AA0C094A/w/9FA308C4/e/upv2xixw.rdh/non_async_main_args_Release_False.csproj]
[upv2xixw.rdh] /datadisks/disk1/work/AA0C094A/p/build/wasm/WasmApp.Native.targets(474,5): error MSB3073: The command "emcc --version" exited with code 1. [/datadisks/disk1/work/AA0C094A/w/9FA308C4/e/upv2xixw.rdh/non_async_main_args_Release_False.csproj]

Build: https://dev.azure.com/dnceng/public/_build/results?buildId=1750315&view=results
Example log: https://helixre8s23ayyeko0k025g8.blob.core.windows.net/dotnet-runtime-refs-heads-main-5d82cf334bf34431b6/EMSDK-.MainWithArgsTests/1/console.acdd695a.log?helixlogtype=result

[jakobbotsch]

A new EMSDK failure that failed the latest rolling build, this time in FlagsChangeRebuildTest:

Binlog path: /datadisks/disk1/work/A95A0970/w/A3FD0907/uploads/xharness-output/logs/kt1z0fri.c1b/rebuild_flags_Release.binlog
Building rebuild_flags_Release in /datadisks/disk1/work/A95A0970/w/A3FD0907/e/kt1z0fri.c1b
Running: /datadisks/disk1/work/A95A0970/p/sdk-no-workload/dotnet: publish -p:WasmBuildOnlyAfterPublish=true  /p:WasmBuildSupportDir=/datadisks/disk1/work/A95A0970/p/build /p:EMSDK_PATH=/datadisks/disk1/work/A95A0970/p/build/emsdk  /p:Configuration=Release /bl:"/datadisks/disk1/work/A95A0970/w/A3FD0907/uploads/xharness-output/logs/kt1z0fri.c1b/rebuild_flags_Release.binlog" /nologo /fl /flp:"v:diag,LogFile=/datadisks/disk1/work/A95A0970/w/A3FD0907/uploads/xharness-output/logs/kt1z0fri.c1b/rebuild_flags_Release.binlog.log" /v:minimal  
WorkingDirectory: /datadisks/disk1/work/A95A0970/w/A3FD0907/e/kt1z0fri.c1b
    Wasm.Build.NativeRebuild.Tests.FlagsChangeRebuildTest.ExtraEmccFlagsSetButNoRealChange(buildArgs: BuildArgs { ProjectName = placeholder, Config = Release, AOT = False, ProjectFileContents = placeholder, ExtraBuildArgs =  }, extraCFlags: "/p:EmccExtraCFlags=-g", extraLDFlags: "/p:EmccExtraLDFlags=-g", host: V8, id: "utva41aq.bgq") [FAIL]
      Build process exited with non-zero exit code: 139
      Expected: True
      Actual:   False
      Stack Trace:
        /_/src/tests/BuildWasmApps/Wasm.Build.Tests/BuildTestBase.cs(589,0): at Wasm.Build.Tests.BuildTestBase.AssertBuild(String args, String label, Boolean expectSuccess, IDictionary`2 envVars, Nullable`1 timeoutMs)
        /_/src/tests/BuildWasmApps/Wasm.Build.Tests/BuildTestBase.cs(338,0): at Wasm.Build.Tests.BuildTestBase.BuildProject(BuildArgs buildArgs, String id, BuildProjectOptions options)
        /_/src/tests/BuildWasmApps/Wasm.Build.Tests/NativeRebuildTests/NativeRebuildTestsBase.cs(50,0): at Wasm.Build.NativeRebuild.Tests.NativeRebuildTestsBase.FirstNativeBuild(String programText, Boolean nativeRelink, Boolean invariant, BuildArgs buildArgs, String id, String extraProperties)
        /_/src/tests/BuildWasmApps/Wasm.Build.Tests/NativeRebuildTests/FlagsChangeRebuildTest.cs(36,0): at Wasm.Build.NativeRebuild.Tests.FlagsChangeRebuildTest.ExtraEmccFlagsSetButNoRealChange(BuildArgs buildArgs, String extraCFlags, String extraLDFlags, RunHost host, String id)
           at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
           at System.Reflection.RuntimeMethodInfo.InvokeNonEmitUnsafe(Object obj, IntPtr* arguments, Span`1 argsForTemporaryMonoSupport, BindingFlags invokeAttr)

Build: https://dev.azure.com/dnceng/public/_build/results?buildId=1750315&view=results
Log: https://helixre8s23ayyeko0k025g8.blob.core.windows.net/dotnet-runtime-refs-heads-main-2043f5bb2a2e432d80/EMSDK-.FlagsChangeRebuildTest/1/console.601b2900.log?helixlogtype=result
There is a coredump available.

[lewing]

that failure looks like dotnet/msbuild#7596

[jakobbotsch]

The build error further up looks like emscripten-core/emsdk#130, which indicates the installation of the emscripten SDK somehow was not successful. Let's see if it comes back.