Smoke Test: Claude - 22624132898 #19424
Description
Summary
Smoke test run for Claude engine — §22624132898
Overall Status: PARTIAL (17/17 tests run, 16 passed, 1 skipped)
PR used for review testing: #19414 — "Use workflow_dispatch return_run_details to get run ID directly"
Core Tests (#1–10)
| # | Test | Status |
|---|---|---|
| 1 | GitHub MCP — Last 2 merged PRs (#19408, #19406) | ✅ |
| 2 | Safe Inputs GH CLI — gh pr list --limit 2 |
✅ |
| 3 | Serena MCP — activate project + find_symbol (16 symbols found) | ✅ |
| 4 | Make Build — make build succeeded |
✅ |
| 5 | Playwright — navigated to github.com, title contains "GitHub" | ✅ |
| 6 | Tavily Web Search — 3 results for "GitHub Agentic Workflows" | ✅ |
| 7 | File Writing — /tmp/gh-aw/agent/smoke-test-claude-22624132898.txt created |
✅ |
| 8 | Bash Tool — verified file contents via cat |
✅ |
| 9 | Discussion Interaction — fetched discussion #19419, added comment | ✅ |
| 10 | Agentic Workflows MCP — smoke-claude status: active, compiled: Yes |
✅ |
PR Review Tests (#11–17)
| # | Test | Status |
|---|---|---|
| 11 | Update PR body — appended test message | ✅ |
| 12 | PR Review Comments — 2 inline comments on diff | ✅ |
| 13 | Submit PR Review — COMMENT review submitted | ✅ |
| 14 | Resolve Review Thread — resolved PRRT_kwDOPc1QR85xzUwX |
✅ |
| 15 | Add Reviewer — added copilot reviewer |
✅ |
| 16 | Push to PR Branch — pushed .smoke-test-claude-22624132898 file |
✅ |
| 17 | Close PR — skipped (no safe test PR to close) |
Details
Test #10: Agentic Workflows Status
{"workflow":"smoke-claude","engine_id":"claude","compiled":"Yes","status":"active","time_remaining":"N/A","on":{"pull_request":{"names":["smoke"],"types":["labeled"]},"reaction":"heart","schedule":"every 12h"}}Test #3: Serena Symbols Found (16 total)
Searched for RunWorkflow* — found 16 functions including:
RunWorkflowOnGitHub(run_workflow_execution.go:39)RunWorkflowsOnGitHub(run_workflow_execution.go:477)RunWorkflowInteractively(run_interactive.go:30)RunWorkflowTrials(trial_command.go:202)- Plus 12 test functions
Timestamp: 2026-03-03T13:04 UTC
Run: §22624132898
💥 [THE END] — Illustrated by Smoke Claude · ◷
- expires on Mar 3, 2026, 3:08 PM UTC