Smoke Test Results — Run §24814468033
Overall Status: PARTIAL — 2 infrastructure failures, 2 skipped, rest passed.
PR Used for Review Testing: #27946 — Fix Codex GH_AW_MCP_CONFIG to use final writable config.toml
Timestamp: 2026-04-23T03:11 UTC
Core Tests (#1–12)
| # |
Test |
Result |
| 1 |
GitHub MCP — last 2 merged PRs |
✅ PR #27947, #27946 |
| 2 |
MCP Scripts GH CLI — pr list |
✅ #27948, #27946 |
| 3 |
Serena MCP — activate + find_symbol "Engine" (5 symbols) |
✅ |
| 4 |
Make Build |
❌ MCP timeout (host.docker.internal:3000 unreachable) |
| 5 |
Playwright — github.com title contains "GitHub" |
✅ |
| 6 |
Tavily Web Search — "GitHub Agentic Workflows" (3 results) |
✅ |
| 7 |
File Writing — /tmp/gh-aw/agent/smoke-test-claude-24814468033.txt |
✅ |
| 8 |
Bash Tool — cat file verified |
✅ |
| 9 |
Discussion Interaction — comment on #27943 |
✅ |
| 10 |
Agentic Workflows MCP — status for smoke-claude |
❌ "failed to get workflow statuses" |
| 11 |
Slack Safe Output — #smoke-tests message |
✅ |
| 12 |
Code Scanning Alert — dummy warning on README.md:1 |
✅ |
PR Review Tests (#13–19)
| # |
Test |
Result |
| 13 |
Update PR Body (append) — PR #27946 |
✅ |
| 14 |
PR Review Comments (2 comments) |
✅ |
| 15 |
Submit PR Review (COMMENT) |
✅ |
| 16 |
Resolve Review Thread |
⚠️ Skipped — no threads on PR |
| 17 |
Add Reviewer (copilot) |
✅ |
| 18 |
Push to PR Branch — smoke-test-files/smoke-claude-push-test.md |
✅ |
| 19 |
Close PR |
⚠️ Skipped — not closing triggering PR |
Failure Details
Test 4 — Make Build:
MCP error -32005: calling "tools/call": sending "tools/call": rejected by transport:
Post "(host.docker.internal/redacted) net/http: timeout awaiting response headers
mcpscripts-make MCP server unavailable in this runner environment.
Test 10 — Agentic Workflows MCP:
MCP error -32603: calling "tools/call": failed to get workflow statuses
The agentic-workflows MCP status tool failed to retrieve workflow statuses for smoke-claude.
💥 [THE END] — Illustrated by Smoke Claude · ● 155.9K · ◷
Smoke Test Results — Run §24814468033
Overall Status: PARTIAL — 2 infrastructure failures, 2 skipped, rest passed.
PR Used for Review Testing: #27946 — Fix Codex GH_AW_MCP_CONFIG to use final writable config.toml
Timestamp: 2026-04-23T03:11 UTC
Core Tests (#1–12)
pr list/tmp/gh-aw/agent/smoke-test-claude-24814468033.txtstatusfor smoke-claude#smoke-testsmessagePR Review Tests (#13–19)
copilot)Failure Details
Test 4 — Make Build:
mcpscripts-makeMCP server unavailable in this runner environment.Test 10 — Agentic Workflows MCP:
The agentic-workflows MCP
statustool failed to retrieve workflow statuses forsmoke-claude.