Smoke Test: Claude - 23300957786 #21821
Description
Summary
All non-skipped tests passed. Overall status: PARTIAL (2 tests skipped — no review threads to resolve, no safe PR to close).
- Run: §23300957786
- Timestamp: 2026-03-19T14:56 UTC
- PR used for review tests: feat: mount custom GitHub Actions as safe output tools via
safe-outputs.actions#21752 (feat: mount custom GitHub Actions as safe output tools via safe-outputs.actions)
Core Tests (#1–11)
| # | Test | Result |
|---|---|---|
| 1 | GitHub MCP — 2 merged PRs (#21811, #21749) | ✅ |
| 2 | MCP Scripts GH CLI — 2 open PRs (#21817, #21795) | ✅ |
| 3 | Serena MCP — activated project, found 4 symbols | ✅ |
| 4 | Make Build — make build succeeded |
✅ |
| 5 | Playwright — github.com title contains "GitHub" | ✅ |
| 6 | Tavily Search — "GitHub Agentic Workflows" returned 5 results | ✅ |
| 7 | File Writing — created /tmp/gh-aw/agent/smoke-test-claude-23300957786.txt |
✅ |
| 8 | Bash Tool — verified file contents | ✅ |
| 9 | Discussion Interaction — fetched #21814, comment added | ✅ |
| 10 | Agentic Workflows MCP — smoke-claude: active, compiled, every 12h | ✅ |
| 11 | Slack Safe Output — posted to #smoke-tests | ✅ |
PR Review Tests (#12–18)
| # | Test | Result |
|---|---|---|
| 12 | Update PR body (append) | ✅ |
| 13 | PR review comments (2 inline comments) | ✅ |
| 14 | Submit PR review (COMMENT) | ✅ |
| 15 | Resolve review thread | |
| 16 | Add reviewer (copilot) | ✅ |
| 17 | Push to PR branch (smoke-test-run-23300957786.md) |
✅ |
| 18 | Close PR |
Note
🔒 Integrity filtering filtered 2 items
Integrity filtering activated and filtered the following items during workflow execution.
This happens when a tool call accesses a resource that does not meet the required integrity or secrecy level of the workflow.
- pr:feat: mount custom GitHub Actions as safe output tools via
safe-outputs.actions#21752 (pull_request_read: Resource 'pr:feat: mount custom GitHub Actions as safe output tools viasafe-outputs.actions#21752' has lower integrity than agent requires. Agent would need to drop integrity tags [unapproved:all approved:all] to trust this resource.) - pr:feat: mount custom GitHub Actions as safe output tools via
safe-outputs.actions#21752 (pull_request_read: Resource 'pr:feat: mount custom GitHub Actions as safe output tools viasafe-outputs.actions#21752' has lower integrity than agent requires. Agent would need to drop integrity tags [approved:all unapproved:all] to trust this resource.)
💥 [THE END] — Illustrated by Smoke Claude · ◷
- expires on Mar 19, 2026, 5:02 PM UTC