Smoke Test: Claude - 22657504616 #19531
Description
Automated smoke test validation for the Claude engine. PR used for review tests: #19525 (copilot/update-generated-footer).
Test Results
| # | Test | Result |
|---|---|---|
| 1 | GitHub MCP: Review last 2 merged PRs (#19518, #19507) | ✅ |
| 2 | Safe Inputs GH CLI: Query 2 PRs (#19528, #19527) | ✅ |
| 3 | Serena MCP: Activate project + find symbols (7 found) | ✅ |
| 4 | Make Build: make build succeeded |
✅ |
| 5 | Playwright: github.com title contains "GitHub" | ✅ |
| 6 | Tavily: Search "GitHub Agentic Workflows" (3 results) | ✅ |
| 7 | File Writing: Created smoke test file | ✅ |
| 8 | Bash: Verified file contents | ✅ |
| 9 | Discussion #19524: Comic-book comment added | ✅ |
| 10 | Agentic Workflows MCP: smoke-claude status (active) | ✅ |
| 11 | Update PR #19525 body (appended test message) | ✅ |
| 12 | PR Review Comments: 2 inline comments added | ✅ |
| 13 | Submit PR Review: COMMENT review submitted | ✅ |
| 14 | Resolve Review Thread | |
| 15 | Add Reviewer: copilot added to PR #19525 | ✅ |
| 16 | Push to PR Branch: committed & pushed test file | ✅ |
| 17 | Close PR |
Overall Status: PARTIAL (2 skipped, 0 failed, 15 passed)
Test Details
GitHub MCP (#1)
- PR Fix runtime-import path duplication when repo is named
.github#19518: "Fix runtime-import path duplication when repo is named.github" — merged 2026-03-04 - PR Update history link generation to set type in search query #19507: "Update history link generation to set type in search query" — merged 2026-03-04
Serena MCP (#3)
Found 7 symbols matching Workflow:
Workflowstruct inpkg/cli/copilot_setup.goValidationResult/Workflowinpkg/cli/compile_config.goOverviewDisplay/Workflowinpkg/cli/audit_report.goWorkflowStats/Workflow,WorkflowStatus/Workflow,WorkflowListItem/Workflow,TestOverview/Workflow
Agentic Workflows MCP (#10)
- smoke-claude: active, compiled: Yes
- Triggers: pull_request (labeled: smoke), reaction (heart), schedule (every 12h)
PR Review Tests (#11–16)
- PR [WIP] Update generated footer to include gh-aw-workflow-call-id #19525:
[WIP] Update generated footer to include gh-aw-workflow-call-id - Files changed:
add_comment.cjs,add_comment.test.cjs,.changeset/patch-add-workflow-call-id-marker.md - Review comments on:
add_comment.cjsline 9,add_comment.test.cjsline 1307
Run URL: https://github.com/github/gh-aw/actions/runs/22657504616
Timestamp: 2026-03-04T06:19Z
💥 [THE END] — Illustrated by Smoke Claude · ◷
- expires on Mar 4, 2026, 8:22 AM UTC