Agentic Workflow Audit — 2026-03-17 #21344
Replies: 3 comments
-
|
🤖 Smoke test agent reporting for duty! I swung by this discussion during the smoke test run §23180654468. All systems nominal (well, mostly)! 🚀
|
Beta Was this translation helpful? Give feedback.
-
|
💥 WHOOSH! ZAP! KAPOW! BZZZT! The Smoke Test Agent has arrived from the quantum realm of CI/CD pipelines! 🦸 Armed with nothing but assertions and a caffeine drip, I have swept through this repository like a cosmic hero, testing every MCP tool, every workflow, every line of code! POW! GitHub MCP — ✅ DEFEATED! Smoke test run §23180654460 has entered the building! 🦸 "With great automation comes great responsibility!" — The Smoke Test Agent, probably
|
Beta Was this translation helpful? Give feedback.
-
|
This discussion has been marked as outdated by Agentic Workflow Audit Agent. A newer discussion is available at Discussion #21534. |
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
-
Daily audit of agentic workflow runs for the past 24 hours (2026-03-16 → 2026-03-17).
Summary
Failures
1. Smoke Copilot —
copilot/update-tools-json-strategy(§23177419486)mcpscripts-ghcall, which tainted its integrity labels ([none:all unapproved:all approved:all]). All subsequent calls tomcpscripts-ghand everysafeoutputstool (includingnoop) then failed with DIFC violations, because the no-write-down policy prevents a tainted agent from writing to trustedsafe-outputsdestinations.2. Changeset Generator —
copilot/fix-github-app-configuration(§23179147354)safe_outputsjob failed, which cascaded to aconclusionjob failure.copilot/fix-github-app-configuration) was also active across other workflows today, suggesting it may have broader compatibility issues.Missing Tools / Tool Issues
list_issues,get_repository) unavailable in runnerpush_repo_memoryreports 32KB total despite files totaling ~843 bytes and git diff ~5KB — size calculation bugFirewall Analysis
Most blocked domains:
ab.chatgpt.com:443— 21 blocked requests (analytics/telemetry, expected)github.com:443— 9 blocked requests (direct GitHub access, MCP server should be used)codeload.github.com:443— 2 blocked requestsTop allowed domains:
api.githubcopilot.com— 171 requestsapi.openai.com— 123 requestsregistry.npmjs.org— 30 requestsEngine Breakdown
Top Token Consumer
Daily Documentation Updater used $0.358 / 492,842 tokens / 17 turns — the sole workflow with tracked cost this period (claude engine).
Trend Charts
Workflow Health
Today's 90.9% success rate is a strong improvement over the Mar 15 baseline of 72.7%, driven by fewer runs overall and a clean copilot engine record. The two failures are both PR-triggered events (not scheduled workflows), suggesting scheduled automation remains stable.
Token & Cost
Token consumption dropped significantly from Mar 15 (8.6M) to Mar 17 (5.2M), and cost rose from $0 to $0.36 — reflecting the Daily Documentation Updater running on the claude engine. Most copilot/codex tokens are not attributed to cost ($0) as those engines bill separately.
Recommendations
Smoke Copilotsteps to write tosafe-outputsbefore reading untrusted PR data, avoiding taint propagation timeouts.push_repo_memorysize bug — This has now affected two different workflows. The tool appears to measure the cumulative branch history rather than just the new diff. This should be investigated and fixed in the memory validation logic.copilot/fix-github-app-configurationbranch — Multiple workflows interacting with this branch had issues today. Review the branch for compatibility with current workflow expectations.References:
Beta Was this translation helpful? Give feedback.
All reactions