Test Results
| # |
Test |
Status |
Notes |
| 1 |
GitHub MCP Testing |
✅ |
Found merged PRs #25718 and #25716 |
| 2 |
MCP Scripts GH CLI |
✅ |
Returned PRs #25729 and #25726 |
| 3 |
Serena MCP Testing |
✅ |
Activated project; 31 symbols found in schema_compiler.go |
| 4 |
Make Build Testing |
✅ |
Built gh-aw binary successfully |
| 5 |
Playwright Testing |
✅ |
Title contains "GitHub" ✓ |
| 6 |
Tavily Web Search |
❌ |
Tool not available (no Tavily MCP server configured) |
| 7 |
File Writing |
✅ |
Created /tmp/gh-aw/agent/smoke-test-claude-24271463990.txt |
| 8 |
Bash Tool |
✅ |
File contents verified via cat |
| 9 |
Discussion Interaction |
✅ |
Discussion #25733 found; comic-book comment added |
| 10 |
Agentic Workflows MCP |
✅ |
smoke-claude workflow is active, compiled, engine: claude |
| 11 |
Slack Safe Output |
✅ |
Posted to #smoke-tests |
| 12 |
Code Scanning Alert |
✅ |
Dummy warning alert created for README.md:1 |
| 13 |
Update PR |
✅ |
PR #25726 body appended with test marker |
| 14 |
PR Review Comments |
✅ |
2 review comments added to .github/aw/actions-lock.json |
| 15 |
Submit PR Review |
✅ |
COMMENT review submitted to #25726 |
| 16 |
Resolve Review Thread |
⚠️ |
Thread IDs (PRRT_...) not returned by available API tools |
| 17 |
Add Reviewer |
✅ |
Added copilot as reviewer |
| 18 |
Push to PR Branch |
✅ |
smoke-test-files/smoke-claude-push-test.md pushed |
| 19 |
Close PR |
⚠️ |
Skipped — no safe test PR to close |
Overall Status: PARTIAL
One tool failure (Tavily not configured), two tests skipped (#16 thread node IDs unavailable, #19 no suitable test PR).
PR used for review testing: #25726
Details
View Test Details
Test 1 — GitHub MCP: Last 2 merged PRs:
Test 2 — MCP Scripts GH CLI: Open PRs returned:
Test 3 — Serena: Activated /home/runner/work/gh-aw/gh-aw; get_symbols_overview on pkg/parser/schema_compiler.go returned 21 variables + 10 functions = 31 symbols.
Test 4 — Make Build: make build succeeded with go build -ldflags "-s -w -X main.version=2eae01c" -o gh-aw ./cmd/gh-aw
Test 5 — Playwright: GitHub title: "GitHub · Change is constant. GitHub keeps you ahead. · GitHub"
Test 10 — Agentic Workflows: smoke-claude workflow status: active, compiled=Yes, engine=claude, triggers: pull_request (labeled smoke), reaction (heart), schedule (every 12h)
Run URL: https://github.com/github/gh-aw/actions/runs/24271463990
Timestamp: 2026-04-11T01:30:00Z
💥 [THE END] — Illustrated by Smoke Claude · ● 282.9K · ◷
Test Results
gh-awbinary successfully/tmp/gh-aw/agent/smoke-test-claude-24271463990.txtcatsmoke-claudeworkflow is active, compiled, engine: claude.github/aw/actions-lock.jsoncopilotas reviewersmoke-test-files/smoke-claude-push-test.mdpushedOverall Status: PARTIAL
One tool failure (Tavily not configured), two tests skipped (#16 thread node IDs unavailable, #19 no suitable test PR).
PR used for review testing: #25726
Details
View Test Details
Test 1 — GitHub MCP: Last 2 merged PRs:
inputs.*expressions not resolved when workflow invoked viaworkflow_call#25718:Fix inputs.* expressions not resolved when workflow invoked via workflow_call(merged 2026-04-11)Write JSONL mirror unconditionally, decoupled from OTLP endpoint(merged 2026-04-11)Test 2 — MCP Scripts GH CLI: Open PRs returned:
Test 3 — Serena: Activated
/home/runner/work/gh-aw/gh-aw;get_symbols_overviewonpkg/parser/schema_compiler.goreturned 21 variables + 10 functions = 31 symbols.Test 4 — Make Build:
make buildsucceeded withgo build -ldflags "-s -w -X main.version=2eae01c" -o gh-aw ./cmd/gh-awTest 5 — Playwright: GitHub title: "GitHub · Change is constant. GitHub keeps you ahead. · GitHub"
Test 10 — Agentic Workflows: smoke-claude workflow status: active, compiled=Yes, engine=claude, triggers: pull_request (labeled smoke), reaction (heart), schedule (every 12h)
Run URL: https://github.com/github/gh-aw/actions/runs/24271463990
Timestamp: 2026-04-11T01:30:00Z