Test Results
| # |
Test |
Status |
| 1 |
GitHub MCP — last 2 merged PRs (#24528 lpcox, #24524 lpcox) |
✅ |
| 2 |
MCP Scripts GH CLI — mcpscripts-gh pr list (PRs #24536, #24535) |
✅ |
| 3 |
Serena MCP — activate_project + find_symbol |
❌ Tools not in function schema |
| 4 |
Playwright — navigated to github.com, title contains "GitHub" |
✅ |
| 5 |
Web Fetch — fetched github.com, response contains "GitHub" |
✅ |
| 6 |
File Writing — created /tmp/gh-aw/agent/smoke-test-copilot-23983870823.txt |
✅ |
| 7 |
Bash Tool — verified file with cat |
✅ |
| 8 |
Discussion Interaction — queried discussion #24534, added comment |
✅ |
| 9 |
Build gh-aw — make build with GOCACHE/GOMODCACHE in /tmp |
✅ |
| 10 |
Discussion Creation — created "copilot was here" discussion |
✅ |
| 11 |
Workflow Dispatch — dispatched haiku-printer with haiku |
✅ |
| 12 |
PR Review — 2 inline comments + review submitted + reply to comment #3035823029 |
✅ |
Overall Status: ⚠️ PARTIAL PASS (11/12)
Details
Failure Details
Test 3 (Serena MCP): The activate_project and find_symbol Serena MCP tools were not present in the available function schema for this run. This is a configuration issue with the Serena MCP server not being properly registered.
📰 BREAKING: Report filed by Smoke Copilot · ● 1.4M · ◷
Test Results
mcpscripts-gh pr list(PRs #24536, #24535)activate_project+find_symbol/tmp/gh-aw/agent/smoke-test-copilot-23983870823.txtcatmake buildwith GOCACHE/GOMODCACHE in /tmphaiku-printerwith haikuOverall Status:⚠️ PARTIAL PASS (11/12)
Details
@Copilot(copilot-swe-agent)@CopilotFailure Details
Test 3 (Serena MCP): The
activate_projectandfind_symbolSerena MCP tools were not present in the available function schema for this run. This is a configuration issue with the Serena MCP server not being properly registered.