Smoke Test: Claude - 23194715491 #21390
Description
Summary
Automated smoke test run for Claude engine.
- Run: §23194715491
- Timestamp: 2026-03-17T12:48:00Z
- PR used for review tests: fix: use GITHUB_TOKEN in bot-detection precompute step (expired GH_AW_BOT_DETECTION_TOKEN causing 84% failure rate) #21386 (fix: use GITHUB_TOKEN in bot-detection precompute step)
- Overall Status: PARTIAL (core tests all pass; 3 PR review steps skipped)
Core Test Results (#1–10)
| # | Test | Status |
|---|---|---|
| 1 | GitHub MCP Testing (last 2 merged PRs: #21384, #21364) | ✅ |
| 2 | MCP Scripts GH CLI Testing (PRs: #21387, #21386) | ✅ |
| 3 | Serena MCP Testing (activated project; 17+ symbols found in cmd/gh-aw/main.go) | ✅ |
| 4 | Make Build Testing (make build succeeded) |
✅ |
| 5 | Playwright Testing (github.com title contains "GitHub") | ✅ |
| 6 | Tavily Web Search Testing (5 results for "GitHub Agentic Workflows") | ✅ |
| 7 | File Writing Testing (/tmp/gh-aw/agent/smoke-test-claude-23194715491.txt created) |
✅ |
| 8 | Bash Tool Testing (file contents verified via cat) |
✅ |
| 9 | Discussion Interaction Testing (comic-book comment on discussion #21383) | ✅ |
| 10 | Agentic Workflows MCP Testing (smoke-claude workflow: active, engine: claude) |
✅ |
PR Review Safe Output Test Results (#11–17)
| # | Test | Status |
|---|---|---|
| 11 | Update PR Body (appended test message to #21386) | ✅ |
| 12 | PR Review Comment Testing (2 review comments on #21386) | ✅ |
| 13 | Submit PR Review Testing (COMMENT review submitted on #21386) | ✅ |
| 14 | Resolve Review Thread Testing | |
| 15 | Add Reviewer Testing (added copilot as reviewer on #21386) |
✅ |
| 16 | Push to PR Branch Testing | main, not PR branch |
| 17 | Close PR Testing |
Notes
- All 10 core tests passed ✅
- 3 PR review sub-tests skipped (
⚠️ ) due to branch/state constraints, not failures smoke-claudeworkflow confirmed active withevery 12hschedule trigger
💥 [THE END] — Illustrated by Smoke Claude · ◷
- expires on Mar 17, 2026, 2:51 PM UTC