fix: reduce Smoke Copilot context size to fix safe_outputs by Mossaka · Pull Request #539 · github/gh-aw-firewall

Mossaka · 2026-02-05T23:17:49Z

Summary

Fix Smoke Copilot pipeline where safe_outputs job always skips because the Copilot agent never calls safeoutputs-add_comment.

Root Cause

PR #530 added explicit actions/checkout (full checkout) to all smoke workflow .md files. With full checkout, Copilot CLI's --add-dir "${GITHUB_WORKSPACE}" ingests the entire repo (~1M tokens). This overwhelms Copilot, causing it to use bash commands (gh pr comment) instead of MCP tools (safeoutputs-add_comment). The outputs.jsonl file is never created, and safe_outputs always skips.

Fix

smoke-copilot.md: Remove explicit steps: — compiler generates sparse checkout by default
postprocess-smoke-workflows.ts: Updated to:
- Convert sparse checkout → full checkout (needed for npm ci/npm run build)
- Add "Clean workspace for agent" step after build that removes src/, tests/, etc.
- Cleanup only applies to smoke-copilot.lock.yml

Result: full checkout → build awf locally → clean workspace → agent runs with ~200k tokens (not 1M)

Test plan

733 unit tests pass
Smoke Copilot agent invokes safeoutputs-add_comment
safe_outputs job runs (not skipped)
All other smoke tests still pass

🤖 Generated with Claude Code

github-actions · 2026-02-05T23:18:03Z

🎬 THE END — Smoke Claude MISSION: ACCOMPLISHED! The hero saves the day! ✨

github-actions · 2026-02-05T23:18:04Z

📰 DEVELOPING STORY: Smoke Copilot reports failed. Our correspondents are investigating the incident...

github-actions · 2026-02-05T23:18:42Z

✅ Coverage Check Passed

Overall Coverage

Metric	Base	PR	Delta
Lines	82.12%	82.12%	➡️ +0.00%
Statements	82.16%	82.16%	➡️ +0.00%
Functions	81.95%	81.95%	➡️ +0.00%
Branches	75.48%	75.48%	➡️ +0.00%

Coverage comparison generated by scripts/ci/compare-coverage.ts

github-actions · 2026-02-05T23:21:01Z

Smoke Test Results: PASS

Last 2 merged PRs:

fix: restore HTTPS_PROXY and fix smoke-chroot checkout #530: fix: restore HTTPS_PROXY and fix smoke-chroot checkout
fix: recompile lock files with release action mode #527: fix: recompile lock files with release action mode

✅ GitHub MCP: Retrieved PR data successfully
✅ Playwright: Navigated to github.com (title confirmed)
✅ File Write: Created test file successfully
✅ Bash: Verified file content

Overall: PASS

AI generated by Smoke Claude

Copilot

Pull request overview

This PR fixes the Smoke Copilot workflow where the safe_outputs job was always skipping because Copilot CLI was overwhelmed by excessive context (~1M tokens from full repository). The fix involves a two-step approach: removing explicit checkout steps from the source .md file to let the compiler generate a sparse checkout, then using a postprocess script to convert the sparse checkout to full checkout (needed for building), and finally adding a cleanup step that removes source files after the build, reducing context to ~200k tokens.

Changes:

Remove explicit checkout steps from smoke-copilot.md to let compiler generate sparse checkout by default
Add logic to postprocess-smoke-workflows.ts to convert sparse checkout to full checkout and add workspace cleanup step
Update smoke-copilot.lock.yml with full checkout, local build steps, workspace cleanup, and version bumps (0.13.5→0.13.6, v0.0.99→v0.0.103)

Reviewed changes

Copilot reviewed 12 out of 12 changed files in this pull request and generated 1 comment.

File	Description
`.github/workflows/smoke-copilot.md`	Removed explicit `steps:` block to allow compiler to generate sparse checkout by default
`scripts/ci/postprocess-smoke-workflows.ts`	Added logic to convert sparse checkout to full checkout and conditionally add workspace cleanup step for smoke-copilot workflow
`.github/workflows/smoke-copilot.lock.yml`	Compiled workflow with full checkout, local build steps, workspace cleanup, and updated container versions

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Copilot · 2026-02-05T23:22:57Z

scripts/ci/postprocess-smoke-workflows.ts

+    `${scriptIndent}# Remove source code to reduce Copilot CLI context size`,
+    `${scriptIndent}# Keep only .github, .agents, dist, node_modules (needed for awf binary)`,
+    `${scriptIndent}cd "$GITHUB_WORKSPACE"`,
+    `${scriptIndent}find . -maxdepth 1 -not -name '.' -not -name '.github' -not -name '.agents' -not -name 'dist' -not -name 'node_modules' -not -name '.git' | xargs rm -rf`,


The find | xargs rm command doesn't properly handle filenames with spaces or special characters. Consider using find ... -print0 | xargs -0 rm -rf or find ... -delete for robustness. While the current command should work for typical repository files, using null-delimited output is a safer best practice.

Suggested change

`${scriptIndent}find . -maxdepth 1 -not -name '.' -not -name '.github' -not -name '.agents' -not -name 'dist' -not -name 'node_modules' -not -name '.git' | xargs rm -rf`,

`${scriptIndent}find . -maxdepth 1 -not -name '.' -not -name '.github' -not -name '.agents' -not -name 'dist' -not -name 'node_modules' -not -name '.git' -print0 | xargs -0 rm -rf`,

github-actions · 2026-02-05T23:23:01Z

💫 TO BE CONTINUED... Smoke Claude was cancelled! Our hero faces unexpected challenges...

github-actions · 2026-02-05T23:23:02Z

📰 DEVELOPING STORY: Smoke Copilot reports failed. Our correspondents are investigating the incident...

github-actions · 2026-02-05T23:24:03Z

📰 DEVELOPING STORY: Smoke Copilot reports failed. Our correspondents are investigating the incident...

github-actions · 2026-02-05T23:24:42Z

💫 TO BE CONTINUED... Smoke Claude failed! Our hero faces unexpected challenges...

github-actions · 2026-02-05T23:27:10Z

📰 DEVELOPING STORY: Smoke Copilot reports failed. Our correspondents are investigating the incident...

github-actions · 2026-02-05T23:27:22Z

💫 TO BE CONTINUED... Smoke Claude failed! Our hero faces unexpected challenges...

github-actions · 2026-02-05T23:35:43Z

📰 DEVELOPING STORY: Smoke Copilot reports failed. Our correspondents are investigating the incident...

github-actions · 2026-02-05T23:35:44Z

🎬 THE END — Smoke Claude MISSION: ACCOMPLISHED! The hero saves the day! ✨

Full repo checkout causes Copilot CLI to ingest 1M tokens of context (via --add-dir "${GITHUB_WORKSPACE}"), making it use bash commands instead of MCP tools. The safeoutputs-add_comment tool is never called, outputs.jsonl is never created, and the safe_outputs job always skips. Fix: Remove explicit actions/checkout from smoke-copilot.md (compiler generates sparse checkout by default). Update the postprocess script to: 1. Convert sparse checkout → full checkout (needed for npm ci/build) 2. Add a "Clean workspace for agent" step that removes src/, tests/, etc. after building, keeping only .github, .agents, dist, node_modules This reduces Copilot's context from ~1M to ~200k tokens, allowing it to properly use MCP safe-output tools. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

github-actions · 2026-02-05T23:40:03Z

📰 DEVELOPING STORY: Smoke Copilot reports failed. Our correspondents are investigating the incident...

github-actions · 2026-02-05T23:40:27Z

🎬 THE END — Smoke Claude MISSION: ACCOMPLISHED! The hero saves the day! ✨

github-actions · 2026-02-05T23:44:54Z

Smoke Test Results - Claude Engine

✅ GitHub MCP: #530, #522
✅ Playwright: github.com verified
✅ File Writing: test file created
✅ Bash Tool: file read confirmed

Status: PASS

AI generated by Smoke Claude

Copilot AI review requested due to automatic review settings February 5, 2026 23:17

Copilot started reviewing on behalf of Mossaka February 5, 2026 23:18 View session

github-actions bot added the smoke-claude label Feb 5, 2026

Mossaka force-pushed the fix/smoke-copilot-context-size branch from e02fc20 to ab9b9b8 Compare February 5, 2026 23:22

Copilot AI reviewed Feb 5, 2026

View reviewed changes

Mossaka force-pushed the fix/smoke-copilot-context-size branch from ab9b9b8 to 8fbe17f Compare February 5, 2026 23:23

Mossaka force-pushed the fix/smoke-copilot-context-size branch from 8fbe17f to 69255cd Compare February 5, 2026 23:26

Mossaka force-pushed the fix/smoke-copilot-context-size branch from 69255cd to c644b05 Compare February 5, 2026 23:35

Mossaka force-pushed the fix/smoke-copilot-context-size branch from c644b05 to a94d4b5 Compare February 5, 2026 23:39

Mossaka closed this Feb 6, 2026

	`${scriptIndent}find . -maxdepth 1 -not -name '.' -not -name '.github' -not -name '.agents' -not -name 'dist' -not -name 'node_modules' -not -name '.git' \| xargs rm -rf`,
	`${scriptIndent}find . -maxdepth 1 -not -name '.' -not -name '.github' -not -name '.agents' -not -name 'dist' -not -name 'node_modules' -not -name '.git' -print0 \| xargs -0 rm -rf`,

Conversation

Mossaka commented Feb 5, 2026

Summary

Root Cause

Fix

Test plan

Uh oh!

github-actions bot commented Feb 5, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Feb 5, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Feb 5, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

✅ Coverage Check Passed

Overall Coverage

Uh oh!

github-actions bot commented Feb 5, 2026

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Copilot AI Feb 5, 2026

Choose a reason for hiding this comment

Uh oh!

github-actions bot commented Feb 5, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Feb 5, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Feb 5, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Feb 5, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Feb 5, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Feb 5, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Feb 5, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Feb 5, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Feb 5, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Feb 5, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Feb 5, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

github-actions bot commented Feb 5, 2026 •

edited

Loading

github-actions bot commented Feb 5, 2026 •

edited

Loading

github-actions bot commented Feb 5, 2026 •

edited

Loading

github-actions bot commented Feb 5, 2026 •

edited

Loading

github-actions bot commented Feb 5, 2026 •

edited

Loading

github-actions bot commented Feb 5, 2026 •

edited

Loading

github-actions bot commented Feb 5, 2026 •

edited

Loading

github-actions bot commented Feb 5, 2026 •

edited

Loading

github-actions bot commented Feb 5, 2026 •

edited

Loading

github-actions bot commented Feb 5, 2026 •

edited

Loading

github-actions bot commented Feb 5, 2026 •

edited

Loading

github-actions bot commented Feb 5, 2026 •

edited

Loading

github-actions bot commented Feb 5, 2026 •

edited

Loading