-
Notifications
You must be signed in to change notification settings - Fork 312
Description
In licensee/licensee, I observed a regression where Repo Assist started creating a new monthly activity issue on each scheduled run instead of updating the existing open one.
I asked Copilot to investigate and after back and forth what follows is its suggested issue.
The clearest boundary in the logs is not the repo-side workflow upgrade by itself, but the runtime change between:
- a last known good run using GitHub MCP
v0.31.0 - subsequent broken runs using GitHub MCP
v0.32.0
Why this is likely a bug
The key inconsistency is:
- The backend/gateway finds the already-open monthly issues.
- Those same issues are then
DIFC-FILTEREDfrom the agent. - The agent behaves as if no monthly issue exists and calls
create_issue.
So Repo Assist is not failing to search. It is finding the issue, but the issue is not visible at the point where the agent decides whether to update or create.
This leads to a false negative:
- search finds the issue
- filtering hides it
- agent assumes it does not exist
- agent creates a duplicate
Evidence
Last known good run
This run updated the existing monthly issue instead of creating a new one:
- Run: https://github.com/licensee/licensee/actions/runs/23260741102
- Existing monthly issue it updated: [Repo Assist] Monthly Activity 2026-03 licensee/licensee#941
Relevant logs from that run show:
- GitHub MCP server version
v0.31.0 - agent text:
Now I'll update the monthly summary issue #941
First broken run
This run created a duplicate monthly issue instead:
- Run: https://github.com/licensee/licensee/actions/runs/23385748544
- Duplicate issue created by that run: [Repo Assist] Monthly Activity 2026-03 licensee/licensee#956
Relevant behavior from that run:
-
The gateway returned existing open monthly issues for the search query.
For example, responses included open[Repo Assist] Monthly Activity 2026-03issues such as: -
The GitHub MCP log then recorded those same issues as
DIFC-FILTERED, for example:issue:licensee/licensee#941issue:licensee/licensee#954issue:licensee/licensee#955
with messages like:
Resource 'issue:licensee/licensee#941' has lower integrity than agent requiresAgent would need to drop integrity tags [...] to trust this resource
-
The agent sandbox log then reasoned as if nothing existed, with messages like:
No monthly activity issue was found ...Memory says "Monthly 2026-03 issue created" but the search returns nothing
-
The run then called
create_issueand created:
Later broken runs
The same pattern appears in later scheduled runs:
- https://github.com/licensee/licensee/actions/runs/23409407003
- https://github.com/licensee/licensee/actions/runs/23453592817
These also used GitHub MCP v0.32.0 and also created additional monthly duplicates rather than updating the existing open issue.
Expected behavior
If search_issues finds an existing issue that Repo Assist previously created and is expected to maintain, that issue should remain visible to the agent for update flows.
If integrity filtering intentionally prevents that, the tool result should fail in a way that is distinguishable from "no results", so the agent does not treat a filtered match as nonexistence.
Actual behavior
In the broken runs:
search_issuesfinds existing monthly issues at the backend/gateway layer- those issues are then
DIFC-FILTERED - the agent sees no usable monthly issue
- Repo Assist creates a fresh
[Repo Assist] Monthly Activity 2026-03issue instead of updating the existing one
Questions
- Was there an intentional trust / DIFC change between the runtime stack using GitHub MCP
v0.31.0and the one usingv0.32.0that would explain this? - Should issues previously created by Repo Assist /
github-actions[bot]be readable as trusted inputs for subsequent Repo Assist runs in the same repository? - Should
gh-awsurface a stronger error when all matchingsearch_issuesresults are filtered, so the agent does not interpret that as "not found"?
Environment
- Repo: https://github.com/licensee/licensee
- Good run: https://github.com/licensee/licensee/actions/runs/23260741102
- First broken run: https://github.com/licensee/licensee/actions/runs/23385748544
- Later broken runs:
- Repo-side workflow/compiler upgrade context:
gh-awin compiled workflow after that point:v0.61.2- GitHub MCP observed in logs:
- good run:
v0.31.0 - broken runs:
v0.32.0
- good run: