Test Results
| Test |
Status |
| GitHub MCP (last 2 merged PRs) |
✅ |
| MCP Scripts GH CLI (pr list) |
✅ |
| Serena MCP (activate + find_symbol) |
❌ serena CLI not found in PATH; sub-agent confirmed no Serena MCP tools available |
| Playwright (navigate to github.com) |
❌ playwright CLI not found; page title verified via web_fetch fallback |
| Web Fetch (fetch github.com) |
✅ Response contains "GitHub" |
File Writing (/tmp/gh-aw/agent/smoke-test-copilot-23983744983.txt) |
✅ |
Bash Tool (verify file contents via cat) |
✅ |
| Discussion Interaction (add_comment to discussion #24530) |
✅ |
Build gh-aw (make build) |
✅ |
| Discussion Creation (create_discussion) |
✅ |
| Workflow Dispatch (haiku-printer) |
✅ |
| PR Review (inline comments + submit_pull_request_review) |
✅ |
| PR Review Reply (reply_to_pull_request_review_comment) |
✅ |
Overall Status: ⚠️ PARTIAL PASS
7 tests failed due to missing tools (Serena MCP CLI, Playwright CLI) — these are environment issues, not code regressions. All other tests passed.
Details
Run URL
https://github.com/github/gh-aw/actions/runs/23983744983
Timestamp
2026-04-04T17:21:12Z
Pull Request
- Author:
@Copilot (app/copilot-swe-agent)
- Assignees: @pelikhan,
@Copilot
📰 BREAKING: Report filed by Smoke Copilot · ● 1.6M · ◷
Test Results
serenaCLI not found in PATH; sub-agent confirmed no Serena MCP tools availableweb_fetchfallback/tmp/gh-aw/agent/smoke-test-copilot-23983744983.txt)cat)make build)Overall Status:⚠️ PARTIAL PASS
7 tests failed due to missing tools (Serena MCP CLI, Playwright CLI) — these are environment issues, not code regressions. All other tests passed.
Details
@lpcox; fix: filter aw_context from user-facing workflow inputs #24521 "fix: filter aw_context from user-facing workflow inputs" by copilot-swe-agentserenacommand not in PATH; sub-agent (general-purpose) also had no Serena MCP tools injectedmake buildsucceeded with GOCACHE/GOMODCACHE redirected to /tmpRun URL
https://github.com/github/gh-aw/actions/runs/23983744983
Timestamp
2026-04-04T17:21:12Z
Pull Request
@Copilot(app/copilot-swe-agent)@Copilot