Skip to content
This repository was archived by the owner on Jan 23, 2023. It is now read-only.

Build managed tests with dotnet#19254

Merged
chsienki merged 7 commits into
dotnet:masterfrom
chsienki:sdk_tests_build
Aug 3, 2018
Merged

Build managed tests with dotnet#19254
chsienki merged 7 commits into
dotnet:masterfrom
chsienki:sdk_tests_build

Conversation

@chsienki
Copy link
Copy Markdown
Member

@chsienki chsienki commented Aug 2, 2018

This is a re-PR of #19230 as the previous one broke the priority flag, which is fixed here.

@chsienki
Copy link
Copy Markdown
Member Author

chsienki commented Aug 2, 2018

@dotnet-bot test Windows_NT x64 Checked please

@BruceForstall
Copy link
Copy Markdown

@dotnet-bot test Windows_NT x86 Checked Build and Test
@dotnet-bot test Windows_NT x64 Build and Test

Copy link
Copy Markdown

@BruceForstall BruceForstall left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM if the tests pass

Copy link
Copy Markdown
Member

@sbomer sbomer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@chsienki chsienki merged commit 101baee into dotnet:master Aug 3, 2018
@BruceForstall
Copy link
Copy Markdown

@chsienki Looks like the arm64 release pri-1 builds are failing all the pri-1 tests. From what I can tell, the pri-1 tests are not getting built, even though I do see "-priority=1" in various places in the build log.

Any ideas?

https://ci.dot.net/job/dotnet_coreclr/job/master/view/arm64/job/arm64_cross_release_windows_nt_flow/

The thing is that arm32/arm64 use a different test list, that explicitly lists all tests to run. I'm worried that what could happen to the other architectures is that we pass "-priority=1" but for some reason we don't actually build pri-1 tests, and we don't notice that because when we run tests, we only run what we find.

@BruceForstall
Copy link
Copy Markdown

In fact, this appears to be what has happened:

The last x64 checked Windows NT pri-1 job that runs on every merge, before your change:

GRAND TOTAL: 12278          0          0           0        31864.892s (2683.353s)

https://ci.dot.net/job/dotnet_coreclr/job/master/view/x64/job/checked_windows_nt/10089/consoleText

After your change:

GRAND TOTAL: 2541          0          0           0        9475.166s (757.343s)

https://ci.dot.net/job/dotnet_coreclr/job/master/view/x64/job/checked_windows_nt/10092/consoleText

You can also see that the time these jobs are taking has dropped from almost 2 hours to under 1 hour.

@BruceForstall
Copy link
Copy Markdown

@chsienki Seeing as how this is going to break arm32/arm64 pri-1 Windows testing, and cause us to silently lose coverage everywhere else, and how it's the weekend, I'm going to revert this.

cc @RussKeldorph

BruceForstall added a commit to BruceForstall/coreclr that referenced this pull request Aug 4, 2018
@BruceForstall
Copy link
Copy Markdown

Revert with: #19287

BruceForstall added a commit that referenced this pull request Aug 4, 2018
Revert "Build managed tests with dotnet (#19254)"
@chsienki
Copy link
Copy Markdown
Member Author

chsienki commented Aug 4, 2018

Dang, ok thanks @BruceForstall. I'll take a look and see if we can eventually get this in without breaking everything.

AaronRobinsonMSFT added a commit to AaronRobinsonMSFT/coreclr that referenced this pull request Aug 7, 2018
AaronRobinsonMSFT added a commit that referenced this pull request Aug 8, 2018
* Revert "Revert "Build managed tests with dotnet (#19254)""
* Reenable MSBuild support through dotnet instead of global MSBuild
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants