Summary
Smoke test run for Copilot engine — workflow run §24541850986
Overall Status: ⚠️ PARTIAL PASS (1 test failure)
Timestamp: 2026-04-17T00:51:22Z
Pull Request: #26771 — fix: compute Docker socket GID separately for shell expansion
PR Author: @lpcox
PR Assignees: @pelikhan, @Copilot
Test Results
| # |
Test |
Status |
Notes |
| 1 |
GitHub MCP Testing |
✅ |
Reviewed last 2 merged PRs (#26771, #26658) |
| 2 |
MCP Scripts GH CLI Testing |
✅ |
Queried 2 PRs via mcpscripts-gh |
| 3 |
Serena CLI Testing |
❌ |
activate_project and find_symbol both failed with EOF/connection errors from Serena backend |
| 4 |
Playwright CLI Testing |
✅ |
Navigated to https://github.com — title contains "GitHub" |
| 5 |
Web Fetch Testing |
✅ |
Fetched https://github.com — response contains "GitHub" |
| 6 |
File Writing Testing |
✅ |
Created /tmp/gh-aw/agent/smoke-test-copilot-24541850986.txt |
| 7 |
Bash Tool Testing |
✅ |
cat verified file content successfully |
| 8 |
Discussion Interaction Testing |
✅ |
Fetched discussion #26760, added smoke test comment |
| 9 |
Build gh-aw |
✅ |
make build succeeded with GOCACHE/GOMODCACHE overrides |
| 10 |
Upload gh-aw binary |
✅ |
Binary uploaded as artifact |
| 11 |
Discussion Creation Testing |
✅ |
Created "copilot was here" discussion in announcements |
| 12 |
Workflow Dispatch Testing |
✅ |
Dispatched haiku-printer workflow with automation haiku |
| 13 |
PR Review Testing |
✅ |
Created 2 inline review comments, submitted review, replied to existing comment #3097271716 |
Failure Details
Test 3 — Serena CLI: The Serena MCP server returned EOF / connection closed errors on both activate_project and find_symbol calls. The server accepted the connection and returned HTTP 200 but then closed the connection before delivering a valid result. This appears to be a backend availability issue with the Serena service, not a parameter error.
References:
📰 BREAKING: Report filed by Smoke Copilot · ● 963.8K · ◷
Summary
Smoke test run for Copilot engine — workflow run §24541850986
Overall Status:⚠️ PARTIAL PASS (1 test failure)
Timestamp: 2026-04-17T00:51:22Z
Pull Request: #26771 — fix: compute Docker socket GID separately for shell expansion
PR Author:
@lpcoxPR Assignees:
@pelikhan,@CopilotTest Results
mcpscripts-ghactivate_projectandfind_symbolboth failed with EOF/connection errors from Serena backend/tmp/gh-aw/agent/smoke-test-copilot-24541850986.txtcatverified file content successfullymake buildsucceeded withGOCACHE/GOMODCACHEoverrideshaiku-printerworkflow with automation haikuFailure Details
Test 3 — Serena CLI: The Serena MCP server returned
EOF/connection closederrors on bothactivate_projectandfind_symbolcalls. The server accepted the connection and returned HTTP 200 but then closed the connection before delivering a valid result. This appears to be a backend availability issue with the Serena service, not a parameter error.References: