Overview
Automated smoke test for the Claude engine — Run §24812777802
Overall Status: ⚠️ PARTIAL (2 failed, 2 skipped, 15 passed)
Timestamp: 2026-04-23T02:12 UTC
PR Used for Review Tests: #27902 — Make BYOK Copilot defaults and deprecate byok-copilot flag
Core Tests (#1–12)
| # |
Test |
Status |
Notes |
| 1 |
GitHub MCP — Last 2 merged PRs |
✅ |
#27929, #27931 merged |
| 2 |
MCP Scripts GH CLI — 2 PRs |
✅ |
#27909, #27902 listed |
| 3 |
Serena MCP — activate + find_symbol |
✅ |
5 symbols found (Engine, main, etc.) |
| 4 |
Make Build |
❌ |
MCP network timeout |
| 5 |
Playwright — github.com title |
✅ |
Title contains "GitHub" |
| 6 |
Tavily Web Search |
✅ |
5 results for "GitHub Agentic Workflows" |
| 7 |
File Writing |
✅ |
/tmp/gh-aw/agent/smoke-test-claude-24812777802.txt |
| 8 |
Bash Tool Verification |
✅ |
File contents confirmed via cat |
| 9 |
Discussion Interaction |
✅ |
Discussion #27937 found, comic comment added |
| 10 |
Agentic Workflows MCP Status |
❌ |
MCP error: failed to get workflow statuses |
| 11 |
Slack Safe Output |
✅ |
Posted to #smoke-tests |
| 12 |
Code Scanning Alert Safe Output |
✅ |
Warning alert on README.md:1 |
PR Review Tests (#13–19)
| # |
Test |
Status |
Notes |
| 13 |
Update PR |
✅ |
Appended test message to PR #27902 body |
| 14 |
PR Review Comments |
✅ |
2 comments on ace-editor.lock.yml & agent-performance-analyzer.lock.yml |
| 15 |
Submit PR Review |
✅ |
COMMENT review submitted |
| 16 |
Resolve Review Thread |
⚠️ |
Skipped — PRRT node IDs unavailable via current tool set |
| 17 |
Add Reviewer |
✅ |
copilot reviewer added |
| 18 |
Push to PR Branch |
✅ |
smoke-test-files/smoke-claude-push-test.md pushed |
| 19 |
Close PR |
⚠️ |
Skipped — No safe test PR to close |
Failure Details
Test #4 — Make Build Failed
MCP error -32005: calling "tools/call": sending "tools/call": rejected by transport:
Post "(host.docker.internal/redacted) net/http: timeout awaiting response headers
The mcpscripts-make MCP server was unreachable (network timeout).
Test #10 — Agentic Workflows MCP Failed
MCP error -32603: calling "tools/call": failed to get workflow statuses
The agentic-workflows MCP status tool returned an internal error when queried for smoke-claude pattern.
References: §24812777802
💥 [THE END] — Illustrated by Smoke Claude · ● 181.8K · ◷
Overview
Automated smoke test for the Claude engine — Run §24812777802
Overall Status:⚠️ PARTIAL (2 failed, 2 skipped, 15 passed)
Timestamp: 2026-04-23T02:12 UTC
PR Used for Review Tests: #27902 — Make BYOK Copilot defaults and deprecate byok-copilot flag
Core Tests (#1–12)
/tmp/gh-aw/agent/smoke-test-claude-24812777802.txtPR Review Tests (#13–19)
smoke-test-files/smoke-claude-push-test.mdpushedFailure Details
Test #4 — Make Build Failed
The
mcpscripts-makeMCP server was unreachable (network timeout).Test #10 — Agentic Workflows MCP Failed
The
agentic-workflowsMCP status tool returned an internal error when queried forsmoke-claudepattern.References: §24812777802