Smoke Test: Claude - 24572008825

[github-actions]

Summary

Smoke test run for Claude engine validation — Run §24572008825

Overall Status: PARTIAL (1 test failed, 1 skipped)

PR used for review testing: #26810 "Bump default CLI/tool versions (Claude, Copilot, Codex, GitHub MCP) and recompile lockfiles"
Timestamp: 2026-04-17T15:08:46Z

---

Core Tests (#1–12)

#	Test	Result	Notes
1	GitHub MCP Testing	✅	Last 2 merged PRs: #26872 (docs FAQ fix), #26858 (MCP gateway refactor)
2	MCP Scripts GH CLI Testing	✅	PRs #26888 (ci: compile marketplace workflows), #26879 (WIP: fix file size)
3	Serena MCP Testing	✅	Project activated, 4 symbols found (2 main Files, 2 main Functions)
4	Make Build Testing	✅	make build succeeded — built gh-aw binary
5	Playwright Testing	✅	Page title: "GitHub · Change is constant. GitHub keeps you ahead. · GitHub"
6	Tavily Web Search Testing	✅	5 results returned for "GitHub Agentic Workflows"
7	File Writing Testing	✅	/tmp/gh-aw/agent/smoke-test-claude-24572008825.txt created
8	Bash Tool Testing	✅	File contents verified via cat
9	Discussion Interaction Testing	✅	Discussion #26897 found; comic-book comment added
10	Agentic Workflows MCP Testing	❌	Error: failed to get workflow statuses — tool unavailable
11	Slack Safe Output Testing	✅	Message posted to #smoke-tests
12	Code Scanning Alert Testing	✅	Dummy warning alert created

PR Review Safe Output Tests (#13–19)

#	Test	Result	Notes
13	Update PR Testing	✅	PR #26810 body appended
14	PR Review Comment Testing	✅	2 inline review comments on .changeset/patch-update-cli-tool-versions-20260417.md
15	Submit PR Review Testing	✅	Review submitted as COMMENT
16	Resolve Review Thread	⚠️	Skipped — no review threads existed on PR #26810
17	Add Reviewer Testing	✅	copilot reviewer added to PR #26810
18	Push to PR Branch Testing	✅	smoke-test-files/smoke-claude-push-test.md pushed to branch
19	Close PR Testing	⚠️	Skipped — no suitable test/bot PR to close safely

---

Test Details

Test #10 — Agentic Workflows MCP Error

Error: MCP error -32603: calling "tools/call": failed to get workflow statuses
Pattern searched: smoke-claude

The agentic-workflows MCP server returned an internal error when querying workflow status. This may indicate the MCP server was unavailable or the workflow pattern was not found.

Test #3 — Serena Symbols Found

Symbols found via find_symbol("main"):

• cmd/gh-aw/main (File, 896 lines)
• main (Function) in cmd/gh-aw/main.go
• cmd/gh-aw-wasm/main (File, 124 lines)
• main (Function) in cmd/gh-aw-wasm/main.go

References:

• §24572008825

💥 [THE END] — Illustrated by Smoke Claude · ● 178K · ◷

• expires on Apr 17, 2026, 5:12 PM UTC

[github-actions]

This issue was automatically closed because it expired on 2026-04-17T17:12:48.298Z.

Closed by Workflow