Several Interop tests failing in Helix on ARM

[wtgodbe]

The following Interop tests are failing:

Interop_ArrayMarshalling.BoolArray_MarshalBoolArrayTest_MarshalBoolArrayTest._BoolArray_MarshalBoolArrayTest_MarshalBoolArrayTest_cmd()
Interop_ArrayMarshalling.ByValArray_MarshalArrayByValTest_MarshalArrayByValTest._ByValArray_MarshalArrayByValTest_MarshalArrayByValTest_cmd()
Interop_FuncPtrAsDelegateParam.FuncPtrAsDelegateParam_FuncPtrAsDelegateParam._FuncPtrAsDelegateParam_FuncPtrAsDelegateParam_cmd()
Interop_MarshalAPI.IUnknown_IUnknownTest_IUnknownTest._IUnknown_IUnknownTest_IUnknownTest_cmd()
Interop_NativeCallable.NativeCallableTest_NativeCallableTest._NativeCallableTest_NativeCallableTest_cmd()
Interop_PrimitiveMarshalling.Bool_BoolTest_BoolTest._Bool_BoolTest_BoolTest_cmd()
Interop_PrimitiveMarshalling.EnumMarshalling_EnumTest_EnumTest._EnumMarshalling_EnumTest_EnumTest_cmd()
Interop_PrimitiveMarshalling.UIntPtr_PInvokeUIntPtrTest_PInvokeUIntPtrTest._UIntPtr_PInvokeUIntPtrTest_PInvokeUIntPtrTest_cmd()
Interop_SizeConst.SizeConstTest_SizeConstTest._SizeConstTest_SizeConstTest_cmd()
Interop_StringMarshalling.LPSTR_LPSTRTest_LPSTRTest._LPSTR_LPSTRTest_LPSTRTest_cmd()
Interop_StringMarshalling.LPTSTR_LPTSTRTest_LPTSTRTest._LPTSTR_LPTSTRTest_LPTSTRTest_cmd()
Interop_StringMarshalling.UTF8_UTF8Test_UTF8Test._UTF8_UTF8Test_UTF8Test_cmd()

All failed with messages like:

Expected: 100\r\nActual: -532462766

Interestingly, these tests all have native .dll's in their test directories, and several other Interop tests failed with a System.DllNotFoundException in failing to find the native .dll in their test directory, so that may be related.

[wtgodbe]

@yizhang82 can you route these failures to the right person?

[wtgodbe]

https://mc.dot.net/#/product/netcore/master/source/official~2Fcoreclr~2Fmaster~2F/type/test~2Ffunctional~2Fcli~2F/build/20170626.03

[yizhang82]

@botaberg Please work with @wtgodbe / @tijoytom to figure out where the problem is.

[botaberg]

@wtgodbe do we know where these tests are looking when trying to load the DLLs (loader snaps)? This looks like a CoreCLR test infrastructure issue, and I do not know very much about this infrastructure.

Also, it is possible to get hold of a repro machine?

[tijoytom-zz]

@wtgodbe is this arm64 on wow32 mode?

[wtgodbe]

@tijoytom I believe so (the tests were built for Arm32, but are running on Arm64 machines)

@botaberg they should be looking in their own directory, which is where we'd expect those .DLL's to be. You can find the binaries used to run these tests in Azure, in the storage account dotnetbuildoutput, in the container coreclr-beta-20170626-03-windows-test (The .dll is in the right place, so it's odd we're not finding it). @MattGal may be able to help you get a repro machine.

[MattGal]

@tijoytom I'm happy to help get you onto a repro machine but only manually; we only have 8 currently and they're quite slow. Ping me and we'll do that.

One thing I am recalling from setting up the CoreCLR repo's tests for normal Helix execution was that we had to automate installing a CRT 14 MSI before stuff would work as expected. If such a package is needed, we definitely have not done this already. (This may have only been for version < 10 Windows SKUs though?). Definitely worth checking, although ideally tests would bring along their own specific dependencies.

[tijoytom-zz]

@MattGal You may be right , we can give that a try..Attaching a debugger and getting loader snaps should tell us what is missing.

[tijoytom-zz]

this should be fixed , @MattGal update this issue when you get a change to fix the dependencies for the test

[MattGal]

@wtgodbe can you look into this? I'm happy to help for any infra-related questions but this is simply a matter of payload construction

[BruceForstall]

dotnet/coreclr#12519 looks like the same failure as this.

[wtgodbe]

@tijoytom do we know what package contains the missing binaries here? I can update the dependency list once I know what needs to be added

[wtgodbe]

https://mc.dot.net/#/product/netcore/master/source/official~2Fcoreclr~2Fmaster~2F/type/test~2Ffunctional~2Fcli~2F/build/20170713.02 these tests are now passing