Smoke Test: Claude - 23318554140 #21862
Description
Summary
Smoke test run completed for Claude engine. Overall status: PARTIAL (2 tests skipped, all others passed).
Run URL: https://github.com/github/gh-aw/actions/runs/23318554140
Timestamp: 2026-03-19 21:52–21:58 UTC
PR used for PR review testing: #21752 (feat: mount custom GitHub Actions as safe output tools via safe-outputs.actions)
Core Test Results (#1–11)
| # | Test | Result |
|---|---|---|
| 1 | GitHub MCP — Last 2 merged PRs | ✅ |
| 2 | mcpscripts-gh CLI — Query 2 PRs | ✅ |
| 3 | Serena MCP — activate_project + find_symbol (10 symbols found) | ✅ |
| 4 | Make Build | ✅ |
| 5 | Playwright — github.com title contains "GitHub" | ✅ |
| 6 | Tavily Web Search — "GitHub Agentic Workflows" (3 results) | ✅ |
| 7 | File Write — /tmp/gh-aw/agent/smoke-test-claude-23318554140.txt |
✅ |
| 8 | Bash — Verified file contents | ✅ |
| 9 | Discussion Interaction — Comment added to #21858 | ✅ |
| 10 | Agentic Workflows MCP — smoke-claude: active, compiled, every 12h | ✅ |
| 11 | Slack Safe Output — Posted to #smoke-tests | ✅ |
PR Review Test Results (#12–18)
| # | Test | Result |
|---|---|---|
| 12 | Update PR body (append) | ✅ |
| 13 | PR review comments (2 inline comments) | ✅ |
| 14 | Submit PR review (COMMENT) | ✅ |
| 15 | Resolve review thread | |
| 16 | Add reviewer (copilot) | ✅ |
| 17 | Push to PR branch | ✅ |
| 18 | Close test PR |
Overall Status: PARTIAL
All non-skipped tests passed. Two tests skipped: #15 (no review threads available) and #18 (no suitable test PR to close).
Note
🔒 Integrity filtering filtered 1 item
Integrity filtering activated and filtered the following item during workflow execution.
This happens when a tool call accesses a resource that does not meet the required integrity or secrecy level of the workflow.
- pr:feat: mount custom GitHub Actions as safe output tools via
safe-outputs.actions#21752 (pull_request_read: Resource 'pr:feat: mount custom GitHub Actions as safe output tools viasafe-outputs.actions#21752' has lower integrity than agent requires. Agent would need to drop integrity tags [unapproved:all approved:all] to trust this resource.)
💥 [THE END] — Illustrated by Smoke Claude · ◷
- expires on Mar 19, 2026, 11:59 PM UTC