Smoke Test: Claude - 22557033498 #19145
Description
Summary
Smoke test run for Claude engine — all core systems validated.
Overall Status: PARTIAL (17 tests, 16 passed ✅, 1 skipped
PR Used for Review Tests: #19142 (Detect triggers: keyword misuse)
Run: §22557033498
Timestamp: 2026-03-02T00:57 UTC
Core Tests
| # | Test | Status |
|---|---|---|
| 1 | GitHub MCP: Last 2 merged PRs (#19092, #19141) | ✅ |
| 2 | SafeInputs GH CLI: 2 open PRs (#19142, #19133) | ✅ |
| 3 | Serena MCP: Activated project, found Compiler struct |
✅ |
| 4 | Make Build: go build -ldflags "-s -w" succeeded |
✅ |
| 5 | Playwright: github.com title contains "GitHub" | ✅ |
| 6 | Tavily: 3 results for "GitHub Agentic Workflows" | ✅ |
| 7 | File Writing: /tmp/gh-aw/agent/smoke-test-claude-22557033498.txt |
✅ |
| 8 | Bash: File content verified via cat |
✅ |
| 9 | Discussion #19144: Comic-book comment added | ✅ |
| 10 | Agentic Workflows MCP: smoke-claude is active/compiled |
✅ |
PR Review Tests (PR #19142)
| # | Test | Status |
|---|---|---|
| 11 | Update PR body (append test message) | ✅ |
| 12 | PR Review Comments: 2 inline comments on changed files | ✅ |
| 13 | Submit PR Review: COMMENT review submitted | ✅ |
| 14 | Resolve Review Thread: PRRT_kwDOPc1QR85xcW4a resolved |
✅ |
| 15 | Add Reviewer: copilot added |
✅ |
| 16 | Push to PR Branch: smoke-test-push-22557033498.md pushed |
✅ |
| 17 | Close PR |
Test Details
Test 1 — GitHub MCP (merged PRs)
- PR Enforce readonly access to GitHub MCP server; remove dangerous-permissions-write feature flag #19092: "Enforce readonly access to GitHub MCP server" — merged 2026-03-02
- PR [docs] docs: remove bullet-list bloat from ephemerals guide #19141: "[docs] docs: remove bullet-list bloat from ephemerals guide" — merged 2026-03-02
Test 2 — SafeInputs GH CLI
gh pr list --repo github/gh-aw --limit 2 --json number,title,author→ returned Detecttriggers:keyword misuse in compile with actionable error #19142 and Add agentic workflow repo-assist #19133
Test 3 — Serena MCP
- Project activated at
/home/runner/work/gh-aw/gh-aw(Go, TypeScript, Bash) - Symbol found:
Compilerstruct atpkg/workflow/compiler_types.go:80
Test 4 — Make Build
- Synced action pins and scripts, then
go build -ldflags "-s -w -X main.version=dcaa791" -o gh-aw ./cmd/gh-aw
Test 5 — Playwright
- URL: https://github.com/
- Title: "GitHub · Change is constant. GitHub keeps you ahead. · GitHub" ✅
Test 6 — Tavily
- Top result: githubnext.com/projects/agentic-workflows (score: 0.947)
- 3 total results returned ✅
Test 10 — Agentic Workflows MCP
smoke-claude: engine=claude, compiled=Yes, status=active- Triggers: pull_request (smoke label), reaction (heart), schedule (every 12h), status-comment
💥 [THE END] — Illustrated by Smoke Claude
- expires on Mar 2, 2026, 3:03 AM UTC