-
Notifications
You must be signed in to change notification settings - Fork 295
Description
Summary
Overall Status: PARTIAL (Test 16 skipped - no local commits to push)
Run: https://github.com/github/gh-aw/actions/runs/22166207471
Timestamp: 2026-02-19T02:37:00Z
PR used for review testing: #16715
Core Test Results
| # | Test | Status |
|---|---|---|
| 1 | GitHub MCP - Last 2 merged PRs | ✅ |
| 2 | safeinputs-gh CLI - List 2 PRs | ✅ |
| 3 | Serena MCP - activate_project + find_symbol (6 symbols found) | ✅ |
| 4 | Make build | ✅ |
| 5 | Playwright - github.com title contains "GitHub" | ✅ |
| 6 | Tavily web search - "GitHub Agentic Workflows" (3 results) | ✅ |
| 7 | File write: /tmp/gh-aw/agent/smoke-test-claude-22166207471.txt |
✅ |
| 8 | Bash verification: cat confirmed file contents |
✅ |
| 9 | Discussion interaction: comment added to discussion #16711 | ✅ |
| 10 | Agentic Workflows MCP - smoke-claude status: active, compiled | ✅ |
PR Review Test Results (PR #16715)
| # | Test | Status |
|---|---|---|
| 11 | Update PR body (append) | ✅ |
| 12 | PR review comments (2 inline comments added) | ✅ |
| 13 | Submit PR review (COMMENT) | ✅ |
| 14 | Resolve review thread (PRRT_kwDOPc1QR85vbuD8) | ✅ |
| 15 | Add reviewer (copilot) | ✅ |
| 16 | Push to PR branch | |
| 17 | Close PR |
Test Details
Test 1-2: GitHub MCP returned closed PRs (#16718, #16719). safeinputs-gh returned open PRs #16722 and #16719.
Test 3: Serena activated project at /home/runner/work/gh-aw/gh-aw (Go, TypeScript, Bash). find_symbol for Run returned 6 symbols across multiple files.
Test 4: make build succeeded - compiled gh-aw binary with version c7b80828.
Test 5: Playwright navigated to (github.com/redacted) Page title: "GitHub · Change is constant. GitHub keeps you ahead. · GitHub" ✅
Test 6: Tavily returned 3 results for "GitHub Agentic Workflows" including githubnext.com and github.blog.
Test 9: Latest discussion #16711 "copilot was here" - comment added successfully.
Test 10: smoke-claude workflow is active, compiled=Yes, triggers: PR labeled "smoke", heart reaction, every 12h.
Test 14: Resolved thread PRRT_kwDOPc1QR85vbuD8 (Copilot review comment about GH_AW_REPORTS_PARENT_ISSUES vs GH_AW_GROUP_REPORTS variable name inconsistency).
References:
💥 [THE END] — Illustrated by Smoke Claude for issue #16715
- expires on Feb 19, 2026, 4:40 AM UTC