Test Results
| # |
Test |
Status |
Notes |
| 1 |
GitHub MCP Testing |
✅ |
Found 2 merged PRs: #27839, #27784 |
| 2 |
MCP Scripts GH CLI Testing |
✅ |
Queried open PRs #27851, #27850 |
| 3 |
Serena MCP Testing |
✅ |
Project activated; 100+ compile symbols found |
| 4 |
Make Build Testing |
⚠️ |
mcpscripts-make timed out (HTTP timeout); fallback bash make build succeeded — binary gh-aw created |
| 5 |
Playwright Testing |
✅ |
GitHub page loaded; title contains "GitHub" |
| 6 |
Tavily Web Search Testing |
✅ |
5 results returned for "GitHub Agentic Workflows" |
| 7 |
File Writing Testing |
✅ |
/tmp/gh-aw/agent/smoke-test-claude-24783751036.txt created |
| 8 |
Bash Tool Testing |
✅ |
File content verified via cat |
| 9 |
Discussion Interaction Testing |
✅ |
Discussion #27834 found; comic-book comment added |
| 10 |
Agentic Workflows MCP Testing |
❌ |
Error: failed to get workflow statuses |
| 11 |
Slack Script Safe Output Testing |
✅ |
Posted to #smoke-tests |
| 12 |
Code Scanning Alert Safe Output Testing |
✅ |
Warning alert created on README.md:1 |
| 13 |
Update PR Testing |
✅ |
Appended test message to PR #27850 |
| 14 |
PR Review Comment Testing |
✅ |
2 inline review comments added on .github/workflows/shared/apm.md |
| 15 |
Submit PR Review Testing |
✅ |
COMMENT review submitted |
| 16 |
Resolve Review Thread Testing |
⚠️ |
Skipped — thread exists but PRRT node ID not retrievable via available tools |
| 17 |
Add Reviewer Testing |
✅ |
copilot added as reviewer |
| 18 |
Push to PR Branch Testing |
✅ |
smoke-test-files/smoke-claude-push-test.md pushed to branch |
| 19 |
Close PR Testing |
⚠️ |
Skipped — no safe test PR to close |
Overall Status: PARTIAL
Some tests were skipped (⚠️) and test #10 (Agentic Workflows MCP) returned a tool error.
PR Used for Review Testing
PR #27850 — "Use pre-agent-steps to restore APM bundle after checkout" (copilot/update-apm-md-pre-agent)
Error Details
Test #10 — Agentic Workflows MCP: Tool returned error failed to get workflow statuses when querying for smoke-claude workflow pattern.
Test #4 — Make Build: mcpscripts-make MCP tool timed out with HTTP timeout to host.docker.internal:3000. Bash fallback succeeded — make build completed and binary gh-aw (26MB) was created successfully.
Test #16 — Resolve Review Thread: One unresolved thread exists (by copilot-pull-request-reviewer), but the PRRT_kwDO... node ID was not returned by the get_review_comments MCP method and the GraphQL API query via mcpscripts-gh failed due to argument parsing limitations.
Run Information
💥 [THE END] — Illustrated by Smoke Claude · ● 275.5K · ◷
Test Results
mcpscripts-maketimed out (HTTP timeout); fallback bashmake buildsucceeded — binarygh-awcreated/tmp/gh-aw/agent/smoke-test-claude-24783751036.txtcreatedcatfailed to get workflow statuses#smoke-tests.github/workflows/shared/apm.mdcopilotadded as reviewersmoke-test-files/smoke-claude-push-test.mdpushed to branchOverall Status: PARTIAL
Some tests were skipped (⚠️ ) and test #10 (Agentic Workflows MCP) returned a tool error.
PR Used for Review Testing
PR #27850 — "Use pre-agent-steps to restore APM bundle after checkout" (
copilot/update-apm-md-pre-agent)Error Details
Test #10 — Agentic Workflows MCP: Tool returned error
failed to get workflow statuseswhen querying forsmoke-claudeworkflow pattern.Test #4 — Make Build:
mcpscripts-makeMCP tool timed out with HTTP timeout tohost.docker.internal:3000. Bash fallback succeeded —make buildcompleted and binarygh-aw(26MB) was created successfully.Test #16 — Resolve Review Thread: One unresolved thread exists (by
copilot-pull-request-reviewer), but thePRRT_kwDO...node ID was not returned by theget_review_commentsMCP method and the GraphQL API query viamcpscripts-ghfailed due to argument parsing limitations.Run Information