Smoke test run for Claude engine. Run: §24754915256 · Date: 2026-04-22T01:17 UTC · PR: #27708 (merged during run)
Test Results
| # |
Test |
Status |
Notes |
| 1 |
GitHub MCP Testing |
✅ |
Last 2 merged PRs: #27708, #27707 |
| 2 |
MCP Scripts GH CLI Testing |
✅ |
PR #27722 returned |
| 3 |
Serena MCP Testing |
✅ |
Activated; 13 Engine symbols found |
| 4 |
Make Build Testing |
✅ |
go build succeeded (2nd attempt) |
| 5 |
Playwright Testing |
✅ |
GitHub title verified |
| 6 |
Tavily Web Search Testing |
✅ |
3 results for "GitHub Agentic Workflows" |
| 7 |
File Writing Testing |
✅ |
/tmp/gh-aw/agent/smoke-test-claude-24754915256.txt |
| 8 |
Bash Tool Testing |
✅ |
File contents verified |
| 9 |
Discussion Interaction Testing |
✅ |
Discussion #27723 found |
| 10 |
Agentic Workflows MCP Testing |
❌ |
Tool unavailable: MCP error -32603 |
| 11 |
Slack Safe Output Testing |
✅ |
Message posted to #smoke-tests |
| 12 |
Code Scanning Alert Testing |
✅ |
Dummy warning alert created |
| 13 |
Update PR Testing |
✅ |
PR body appended |
| 14 |
PR Review Comment Testing |
✅ |
2 comments on changed files |
| 15 |
Submit PR Review Testing |
✅ |
COMMENT review submitted |
| 16 |
Resolve Review Thread Testing |
⚠️ |
Thread node IDs not retrievable via available APIs |
| 17 |
Add Reviewer Testing |
✅ |
Copilot reviewer added |
| 18 |
Push to PR Branch Testing |
✅ |
smoke-test-files/smoke-claude-push-test.md pushed |
| 19 |
Close PR Testing |
⚠️ |
Skipped — PR #27708 already merged/closed |
Overall Status
PARTIAL — 1 test failed (Agentic Workflows MCP tool unavailable), 2 skipped
Details
Test #4 — Make Build (first attempt timed out)
First make build call timed out with MCP error -32005: timeout. Second call succeeded with:
go build -ldflags "-s -w -X main.version=v0.69.3-8-g9b672c64b-dirty" -o gh-aw ./cmd/gh-aw
Test #10 — Agentic Workflows MCP Status Error
MCP error -32603: calling "tools/call": failed to get workflow statuses
Pattern smoke-claude returned no results. Workflow may not exist or MCP server had a transient failure.
Test #16 — Resolve Review Thread (Skipped)
PR #27708 had 2 unresolved (outdated) review threads on:
pkg/workflow/universal_llm_consumer_engine.go
pkg/workflow/crush_engine.go
Thread node IDs (PRRT_kwDO...) could not be retrieved from available MCP tools. GraphQL query via mcpscripts-gh CLI failed due to argument parsing.
References: §24754915256
💥 [THE END] — Illustrated by Smoke Claude · ● 222.8K · ◷
Smoke test run for Claude engine. Run: §24754915256 · Date: 2026-04-22T01:17 UTC · PR: #27708 (merged during run)
Test Results
go buildsucceeded (2nd attempt)/tmp/gh-aw/agent/smoke-test-claude-24754915256.txtOverall Status
PARTIAL — 1 test failed (Agentic Workflows MCP tool unavailable), 2 skipped
Details
Test #4 — Make Build (first attempt timed out)
First
make buildcall timed out withMCP error -32005: timeout. Second call succeeded with:Test #10 — Agentic Workflows MCP Status Error
Pattern
smoke-claudereturned no results. Workflow may not exist or MCP server had a transient failure.Test #16 — Resolve Review Thread (Skipped)
PR #27708 had 2 unresolved (outdated) review threads on:
pkg/workflow/universal_llm_consumer_engine.gopkg/workflow/crush_engine.goThread node IDs (PRRT_kwDO...) could not be retrieved from available MCP tools. GraphQL query via mcpscripts-gh CLI failed due to argument parsing.
References: §24754915256