-
Notifications
You must be signed in to change notification settings - Fork 312
Closed as not planned
Labels
Description
Summary
Smoke test run for Claude engine — §23426114132
Overall Status: PARTIAL (all non-skipped tests passed; Serena MCP had connection errors; DIFC policy blocked some PR reads)
Date: 2026-03-23
PR Used: #22388 (chore: bump gh-aw-mcpg to v0.2.0)
Core Test Results
| # | Test | Result |
|---|---|---|
| 1 | GitHub MCP — last 2 merged PRs (#22382, #22378) | ✅ |
| 2 | MCP Scripts GH CLI — gh pr list (#22388, #22384) |
✅ |
| 3 | Serena MCP — activate_project succeeded, find_symbol failed (EOF) | |
| 4 | Make Build — make build succeeded |
✅ |
| 5 | Playwright — github.com title contains "GitHub" | ✅ |
| 6 | Tavily Web Search — "GitHub Agentic Workflows" returned 5 results | ✅ |
| 7 | File Writing — /tmp/gh-aw/agent/smoke-test-claude-23426114132.txt created |
✅ |
| 8 | Bash Tool — file content verified | ✅ |
| 9 | Discussion Interaction — discussion #22386 found, comic comment added | ✅ |
| 10 | Agentic Workflows MCP — smoke-claude status: active, compiled, status file written | ✅ |
| 11 | Slack Safe Output — post_slack_message to #smoke-tests succeeded |
✅ |
PR Review Test Results
| # | Test | Result |
|---|---|---|
| 12 | Update PR Body (append) | ✅ |
| 13 | PR Review Comments (2 comments on pkg/constants/constants.go + smoke-claude.lock.yml) | ✅ |
| 14 | Submit PR Review (COMMENT event) | ✅ |
| 15 | Resolve Review Thread | |
| 16 | Add Reviewer (copilot) | ✅ |
| 17 | Push to PR Branch (.github/smoke-test-23426114132.json) |
✅ |
| 18 | Close PR |
Notes
- Serena MCP:
activate_projectsucceeded on first call, but subsequentfind_symbolcalls returned EOF/connection closed errors. Marked as⚠️ . - DIFC Policy: PR chore: bump gh-aw-mcpg to v0.2.0 #22388 has integrity below "approved" —
get_files,get_diff, andget_review_commentsall returned empty with DIFC-filtered notice. Review comments were added using known file paths from the PR description. - Test Add workflow: githubnext/agentics/weekly-research #3: Only 2 symbols returned before Serena connection dropped (needed ≥3). Marked
⚠️ .
References:
Note
🔒 Integrity filter blocked 1 item
The following item were blocked because they don't meet the GitHub integrity level.
- chore: bump gh-aw-mcpg to v0.2.0 #22388
pull_request_read: has lower integrity than agent requires. The agent cannot read data with integrity below "approved".
To allow these resources, lower min-integrity in your GitHub frontmatter:
tools:
github:
min-integrity: approved # merged | approved | unapproved | none💥 [THE END] — Illustrated by Smoke Claude · ◷
- expires on Mar 23, 2026, 9:37 AM UTC
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
Type
Fields
Give feedbackNo fields configured for issues without a type.