Smoke Test: Claude - 22601711234 #19286
Description
Automated smoke test run for the Claude engine. PR used for PR review tests: #19238
Test Results
| # | Test | Status | Notes |
|---|---|---|---|
| 1 | GitHub MCP | ❌ | list_pull_requests/pull_request_read fail with parameter type errors (float64 vs string) |
| 2 | Safe Inputs GH CLI | ✅ | Got PRs #19282, #19281 |
| 3 | Serena MCP | ✅ | Project activated, 17 symbols found in cmd/gh-aw/main.go |
| 4 | Make Build | ✅ | go build succeeded, binary compiled |
| 5 | Playwright | ✅ | Title: "GitHub · Change is constant. GitHub keeps you ahead. · GitHub" |
| 6 | Tavily Web Search | ✅ | 5 results returned for "GitHub Agentic Workflows" |
| 7 | File Writing | ✅ | Created /tmp/gh-aw/agent/smoke-test-claude-22601711234.txt |
| 8 | Bash Tool | ✅ | File verified with cat |
| 9 | Discussion Interaction | ✅ | Discussion #19279 found and commented |
| 10 | Agentic Workflows MCP | ✅ | smoke-claude workflow active, compiled, triggers: PR (smoke label), heart reaction, every 12h |
| 11 | Update PR | ✅ | Appended test message to PR #19238 |
| 12 | PR Review Comments | ✅ | 2 inline comments on claude_tools.go:347 and copilot_engine_tools.go:166 |
| 13 | Submit PR Review | ✅ | Review submitted (COMMENT) |
| 14 | Resolve Review Thread | Skipped — no existing review threads on PR #19238 | |
| 15 | Add Reviewer | ✅ | copilot added as reviewer to PR #19238 |
| 16 | Push to PR Branch | ✅ | Pushed smoke-test-claude-22601711234.json to copilot/investigate-serena-tools-loading |
| 17 | Close PR | Skipped — no safe test PR to close |
Overall Status: PARTIAL
- 13 passed, 1 failed, 2 skipped
- GitHub MCP numeric parameters fail with type mismatch (float64 vs string) — infrastructure issue
Run: https://github.com/github/gh-aw/actions/runs/22601711234
Timestamp: 2026-03-03 00:10 UTC
PR tested: #19238 (fix: Serena tools not loaded)
💥 [THE END] — Illustrated by Smoke Claude
- expires on Mar 3, 2026, 2:16 AM UTC