[devops] Improved diagnostics and implement deadlocked process termination. by rolfbjarne · Pull Request #21317 · dotnet/macios

rolfbjarne · 2024-09-27T09:17:50Z

Unify the code to collect diagnostic information about a bot.
Unify some of the cleanup code to prepare a bot as well.
Implement code to terminate processes on a bot that's used more than a day
of CPU (presumably these processes are stuck for some reason).

Also show: * The network configuration * The load on the system / cpu usage (top)

…ation. * Unify the code to collect diagnostic information about a bot. * Unify some of the cleanup code to prepare a bot as well. * Implement code to terminate processes on a bot that's used more than a day of CPU (presumably these processes are stuck for some reason).

dalexsoto · 2024-09-27T11:47:45Z


+# Clean workspace
+(
+	if test -d "$SYSTEM_DEFAULTWORKINGDIRECTORY/xamarin-macios"; then


@rolfbjarne Can you make the name of the repo a variable somewhere central? Maybe first line in the top level Make.config? Some sed'ing may be involved heh but since we are migrating the repo over we can start adding to the machinery to no depend on the magic string xamarin-macios

@dalexsoto fixed!

…ics-and-preparation

vs-mobiletools-engineering-service2 · 2024-10-01T04:02:28Z

📚 [CI Build] Artifacts 📚

Artifacts were not provided.

Pipeline on Agent
Hash: [PR build]

vs-mobiletools-engineering-service2 · 2024-10-01T04:06:10Z

✅ API diff for current PR / commit

NET (empty diffs)

~~iOS~~: (empty diff detected)
~~tvOS~~: (empty diff detected)
~~MacCatalyst~~: (empty diff detected)
~~macOS~~: (empty diff detected)

✅ API diff vs stable

.NET (No breaking changes)

iOS: vsdrops gist (No breaking changes)
tvOS: vsdrops gist (No breaking changes)
MacCatalyst: vsdrops gist (No breaking changes)
macOS: vsdrops gist (No breaking changes)

ℹ️ Generator diff

Generator Diff: vsdrops (html) vsdrops (raw diff) gist (raw diff) - Please review changes)

Pipeline on Agent
Hash: f2858ee783b5cdd92fa3c21499a71c36bf8e7a73 [PR build]

…ics-and-preparation

vs-mobiletools-engineering-service2 · 2024-10-09T16:36:33Z

✅ API diff for current PR / commit

NET (empty diffs)

~~iOS~~: (empty diff detected)
~~tvOS~~: (empty diff detected)
~~MacCatalyst~~: (empty diff detected)
~~macOS~~: (empty diff detected)

✅ API diff vs stable

.NET (No breaking changes)

iOS: vsdrops gist (No breaking changes)
tvOS: vsdrops gist (No breaking changes)
MacCatalyst: vsdrops gist (No breaking changes)
macOS: vsdrops gist (No breaking changes)

ℹ️ Generator diff

Generator Diff: vsdrops (html) vsdrops (raw diff) gist (raw diff) - Please review changes)

Pipeline on Agent
Hash: 3af13ac04e5c4f05779fc6623b4a31c801e9eac3 [PR build]

vs-mobiletools-engineering-service2 · 2024-10-09T17:26:10Z

💻 [CI Build] Tests on macOS X64 - Mac Sonoma (14) passed 💻

✅ All tests on macOS X64 - Mac Sonoma (14) passed.

Pipeline on Agent
Hash: 3af13ac04e5c4f05779fc6623b4a31c801e9eac3 [PR build]

vs-mobiletools-engineering-service2 · 2024-10-09T17:31:05Z

💻 [CI Build] Tests on macOS M1 - Mac Monterey (12) passed 💻

✅ All tests on macOS M1 - Mac Monterey (12) passed.

Pipeline on Agent
Hash: 3af13ac04e5c4f05779fc6623b4a31c801e9eac3 [PR build]

vs-mobiletools-engineering-service2 · 2024-10-09T17:31:39Z

💻 [CI Build] Tests on macOS M1 - Mac Ventura (13) passed 💻

✅ All tests on macOS M1 - Mac Ventura (13) passed.

Pipeline on Agent
Hash: 3af13ac04e5c4f05779fc6623b4a31c801e9eac3 [PR build]

vs-mobiletools-engineering-service2 · 2024-10-09T18:21:39Z

💻 [CI Build] Windows Integration Tests passed 💻

✅ All Windows Integration Tests passed.

Pipeline on Agent
Hash: 3af13ac04e5c4f05779fc6623b4a31c801e9eac3 [PR build]

vs-mobiletools-engineering-service2 · 2024-10-10T09:55:37Z

🚀 [CI Build] Test results 🚀

Test results

✅ All tests passed on VSTS: test results.

🎉 All 99 tests passed 🎉

Tests counts

✅ cecil: All 1 tests passed. Html Report (VSDrops) Download
✅ dotnettests (iOS): All 1 tests passed. Html Report (VSDrops) Download
✅ dotnettests (MacCatalyst): All 1 tests passed. [attempt 2] Html Report (VSDrops) Download
✅ dotnettests (macOS): All 1 tests passed. Html Report (VSDrops) Download
✅ dotnettests (Multiple platforms): All 1 tests passed. Html Report (VSDrops) Download
✅ dotnettests (tvOS): All 1 tests passed. Html Report (VSDrops) Download
✅ framework: All 2 tests passed. Html Report (VSDrops) Download
✅ fsharp: All 4 tests passed. Html Report (VSDrops) Download
✅ generator: All 1 tests passed. [attempt 2] Html Report (VSDrops) Download
✅ interdependent-binding-projects: All 4 tests passed. Html Report (VSDrops) Download
✅ introspection: All 4 tests passed. Html Report (VSDrops) Download
✅ linker: All 40 tests passed. Html Report (VSDrops) Download
✅ monotouch (iOS): All 7 tests passed. [attempt 2] Html Report (VSDrops) Download
✅ monotouch (MacCatalyst): All 8 tests passed. Html Report (VSDrops) Download
✅ monotouch (macOS): All 9 tests passed. [attempt 2] Html Report (VSDrops) Download
✅ monotouch (tvOS): All 7 tests passed. Html Report (VSDrops) Download
✅ msbuild: All 2 tests passed. Html Report (VSDrops) Download
✅ xcframework: All 4 tests passed. Html Report (VSDrops) Download
✅ xtro: All 1 tests passed. Html Report (VSDrops) Download

Pipeline on Agent
Hash: 3af13ac04e5c4f05779fc6623b4a31c801e9eac3 [PR build]

…ation. (#21317) * Unify the code to collect diagnostic information about a bot. * Unify some of the cleanup code to prepare a bot as well. * Implement code to terminate processes on a bot that's used more than a day of CPU (presumably these processes are stuck for some reason).

rolfbjarne added 2 commits September 27, 2024 11:14

[devops] Add a bit more info when showing the enviroment.

6294877

Also show: * The network configuration * The load on the system / cpu usage (top)

This comment has been minimized.

Sign in to view

dalexsoto reviewed Sep 27, 2024

View reviewed changes

Delete watchOS simulators, we don't need them anymore.

0dffb7b

This comment has been minimized.

Sign in to view

rolfbjarne added 3 commits September 27, 2024 17:13

Fix scripts

4cdb1d1

Don't hardcode repo name.

9a547e9

Merge remote-tracking branch 'origin/main' into dev/rolf/bot-diagnost…

97f8669

…ics-and-preparation

This comment has been minimized.

Sign in to view

rolfbjarne added 5 commits October 1, 2024 01:48

Add 'uptime' and 'ps aux' to the diagnostic output.

3781225

Merge remote-tracking branch 'origin/main' into dev/rolf/bot-diagnost…

bda0b67

…ics-and-preparation

Just skip top.

4476e8a

Only delete old Xcode that actually exists.

eea7714

Fix typo

f2858ee

This comment has been minimized.

Sign in to view

Merge remote-tracking branch 'origin/main' into tmp

0000d7c

This comment has been minimized.

Sign in to view

rolfbjarne added 2 commits October 8, 2024 17:11

Fix show info.

93855ee

Fix more stuff.

c63fb41

This comment has been minimized.

Sign in to view

Merge remote-tracking branch 'origin/main' into dev/rolf/bot-diagnost…

3af13ac

…ics-and-preparation

This comment has been minimized.

Sign in to view

dalexsoto approved these changes Oct 11, 2024

View reviewed changes

rolfbjarne merged commit 48f5591 into main Oct 11, 2024

rolfbjarne deleted the dev/rolf/bot-diagnostics-and-preparation branch October 11, 2024 11:26

Conversation

rolfbjarne commented Sep 27, 2024

Uh oh!

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

dalexsoto Sep 27, 2024

Choose a reason for hiding this comment

Uh oh!

rolfbjarne Sep 27, 2024

Choose a reason for hiding this comment

Uh oh!

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

vs-mobiletools-engineering-service2 commented Oct 1, 2024

📚 [CI Build] Artifacts 📚

Uh oh!

vs-mobiletools-engineering-service2 commented Oct 1, 2024

✅ API diff for current PR / commit

✅ API diff vs stable

ℹ️ Generator diff

Uh oh!

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

vs-mobiletools-engineering-service2 commented Oct 9, 2024

✅ API diff for current PR / commit

✅ API diff vs stable

ℹ️ Generator diff

Uh oh!

vs-mobiletools-engineering-service2 commented Oct 9, 2024

💻 [CI Build] Tests on macOS X64 - Mac Sonoma (14) passed 💻

Uh oh!

vs-mobiletools-engineering-service2 commented Oct 9, 2024

💻 [CI Build] Tests on macOS M1 - Mac Monterey (12) passed 💻

Uh oh!

vs-mobiletools-engineering-service2 commented Oct 9, 2024

💻 [CI Build] Tests on macOS M1 - Mac Ventura (13) passed 💻

Uh oh!

vs-mobiletools-engineering-service2 commented Oct 9, 2024

💻 [CI Build] Windows Integration Tests passed 💻

Uh oh!

This comment has been minimized.

vs-mobiletools-engineering-service2 commented Oct 10, 2024

🚀 [CI Build] Test results 🚀

Test results

Tests counts

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants