[NETSDKE2E] [Regression]With .Net 8 Preview4, 'GC heap initialization failed with error 0x8007000E' on Linux Arm32

[v-xiaofchen]

Description

Environment:
.NET 8.0.100-preview.4.23253.2(runtime-8.0.0-preview.4.23228.5)

Reproduction Steps

Repro steps:

1. Prepare Ubuntu23.04 or Alpine3.17 Arm32 in docker

2 . Extract dotnet-sdk-8.0.100-preview.4.23253.2-linux-arm.tar.gz, and use the export command to set DOTNET_ROOT to the extracted folder's location and then ensure .NET is in PATH

3. Run 'dotnet --info' and observe

Expected behavior

It works normally.

Actual behavior

There is an error message stating that
GC heap initialization failed with error 0x8007000E
Failed to create CoreCLR, HRESULT: 0x8007000E

Regression?

This issue not repro on 8.0.100-preview.4.23214.16(runtime- 8.0.0-preview.4.23210.1)

Known Workarounds

No response

Configuration

No response

Other information

This issue also repro on .Net 8 Preview5

[jeffschwMSFT]

@mangod9 @janvorli can you take a look? This is impacting preview 4

[janvorli]

@v-xiaofchen can you please share the docker command you've used to launch the container for your testing and also details on your host system running the docker and the amount of memory it has? I was unable to repro your issue with a docker running Ubuntu 23.04 on my RPI4:

dotnet --info
.NET SDK:
 Version:   8.0.100-preview.4.23253.2
 Commit:    0da7f0b452

Runtime Environment:
 OS Name:     ubuntu
 OS Version:  23.04
 OS Platform: Linux
 RID:         ubuntu.23.04-arm
 Base Path:   /dotnet80/sdk/8.0.100-preview.4.23253.2/

.NET workloads installed:
There are no installed workloads to display.

Host:
  Version:      8.0.0-preview.4.23228.5
  Architecture: arm
  Commit:       8e472c8886

.NET SDKs installed:
  8.0.100-preview.4.23253.2 [/dotnet80/sdk]

.NET runtimes installed:
  Microsoft.AspNetCore.App 8.0.0-preview.4.23251.12 [/dotnet80/shared/Microsoft.AspNetCore.App]
  Microsoft.NETCore.App 8.0.0-preview.4.23228.5 [/dotnet80/shared/Microsoft.NETCore.App]

Other architectures found:
  None

Environment variables:
  Not set

global.json file:
  Not found

Learn more:
  https://aka.ms/dotnet/info

Download .NET:
  https://aka.ms/dotnet/download

[janvorli]

The Alpine 3.17 docker image also worked for me

[janvorli]

@cshung I got access to the device from @v-xiaofchen and found that it is caused by issues in the gc heap memory computations. We end up computing these values:
block_size_normal = 0x40000000, block_size_large = 0x80000000, block_size_pinned = 0x80000000

Please note this is 32 bit ARM, Raspberry PI 3 device with 1GB of physical memory.
As you can see, the sum of the block sizes goes over the 4GB addressing limit of the 32 bit processor. What happens is that due to overflow in some computations, we end up computing requestedMemory as 0x40000000, but then attempt to map all three blocks into it sequentially.
Here is the code where the sum overflows:

5306            size_t requestedMemory = memory_details.block_count * (normal_size + large_size + temp_pinned_size);

Here is the alloc that we use to allocate the memory:

5308            uint8_t* allatonce_block = (uint8_t*)virtual_alloc(requestedMemory, use_large_pages_p);

I've also found this check that also overflows, so it doesn't work as expected:

5145        if (((size_t)MAX_PTR / memory_details.block_count) < (normal_size + large_size + pinned_size))

I've looked at gc_heap::compute_memory_settings. The numbers it gets stem from total_physical_memory, which is 968052736.

Can you please take a look?

Tagging subscribers to this area: @dotnet/gc
See info in area-owners.md if you want to be subscribed.

Issue Details

---

Description

Environment:
.NET 8.0.100-preview.4.23253.2(runtime-8.0.0-preview.4.23228.5)

Reproduction Steps

Repro steps:

1. Prepare Ubuntu23.04 or Alpine3.17 Arm32 in docker

2 . Extract dotnet-sdk-8.0.100-preview.4.23253.2-linux-arm.tar.gz, and use the export command to set DOTNET_ROOT to the extracted folder's location and then ensure .NET is in PATH

3. Run 'dotnet --info' and observe

Expected behavior

It works normally.

Actual behavior

There is an error message stating that
GC heap initialization failed with error 0x8007000E
Failed to create CoreCLR, HRESULT: 0x8007000E

Regression?

This issue not repro on 8.0.100-preview.4.23214.16(runtime- 8.0.0-preview.4.23210.1)

Known Workarounds

No response

Configuration

No response

Other information

This issue also repro on .Net 8 Preview5

Author:	v-xiaofchen
Assignees:	cshung
Labels:	area-GC-coreclr, untriaged
Milestone:	-