Smoke Test: Claude - 23223776723 #21495
Description
Test Results
| # | Test | Status | Notes |
|---|---|---|---|
| 1 | GitHub MCP Testing | ✅ | Reviewed PRs #21485 and #21474 |
| 2 | MCP Scripts GH CLI Testing | ✅ | Queried PRs #21493 and #21492 |
| 3 | Serena MCP Testing | ❌ | Project activated ✅ but find_symbol consistently returned EOF errors |
| 4 | Make Build Testing | ✅ | make build succeeded, binary built at gh-aw |
| 5 | Playwright Testing | ✅ | Page title "GitHub · Change is constant. GitHub keeps you ahead. · GitHub" contains "GitHub" |
| 6 | Tavily Web Search Testing | ✅ | 5 results returned for "GitHub Agentic Workflows" |
| 7 | File Writing Testing | ✅ | Created /tmp/gh-aw/agent/smoke-test-claude-23223776723.txt |
| 8 | Bash Tool Testing | ✅ | File content verified with cat |
| 9 | Discussion Interaction Testing | ✅ | Comic-book comment added to discussion #21490 |
| 10 | Agentic Workflows MCP Testing | ✅ | smoke-claude is active, compiled, runs on schedule every 12h |
| 11 | Update PR Testing | ✅ | Appended test message to PR #21491 body |
| 12 | PR Review Comment Testing | ✅ | 2 review comments added on logs_orchestrator.go:331 and logs_summary_test.go:367 |
| 13 | Submit PR Review Testing | ✅ | Review submitted as COMMENT on PR #21491 |
| 14 | Resolve Review Thread Testing | No threads returned via API (possible timing) | |
| 15 | Add Reviewer Testing | ✅ | copilot added as reviewer to PR #21491 |
| 16 | Push to PR Branch Testing | ✅ | .smoke-test-23223776723.md pushed to copilot/cli-tools-test-fix-safe-items-count |
| 17 | Close PR Testing | Skipped — no safe test PR to close |
Overall Status: PARTIAL
- 13 passed, 1 failed, 3 skipped/partial
- PR used for review testing: Fix safe_items_count missing from cached runs when filtering by workflow_name #21491 (Fix safe_items_count missing from cached runs when filtering by workflow_name)
Failure Details
Test 3 - Serena MCP: activate_project succeeded but all subsequent find_symbol calls returned EOF errors (connection closed: calling "tools/call": client is closing: EOF). The Serena LSP server appears to drop connections after activation.
Run Information
- Run URL: https://github.com/github/gh-aw/actions/runs/23223776723
- Timestamp: 2026-03-18T01:00:00Z
- Engine: Claude (claude-sonnet-4-6)
💥 [THE END] — Illustrated by Smoke Claude · ◷
- expires on Mar 18, 2026, 3:04 AM UTC