Workflow Health Dashboard - 2026-02-27 #18649
Description
Overview
- Total workflows: 161 executable (+3 from last run of 158)
- Compilation coverage: 161/161 (100% ✅)
- Healthy: 157 (97%)
- Failing (P1): 4 (3%) — lockdown token failures (~5 weeks ongoing)
- Overall health score: 78/100 (→ stable)
| Metric | Value | Trend |
|---|---|---|
| Total workflows | 161 | ↑ +3 |
| Compilation coverage | 100% | → |
| P1 failures | 4 | → |
| Health score | 78/100 | → |
Critical Issues 🚨
Issue Monster (P1)
- Status: Failing ~50+ times/day (every 30 min schedule)
- Latest run: run#2195 failed at 07:25 UTC — §22476962612
- Active tracking: [aw] Issue Monster failed #18634 (new format, expires Mar 6), [agentics] Issue Monster failed #17387 (legacy, expires Feb 28, 214 comments)
- Root cause:
lockdown: true+ missingGH_AW_GITHUB_TOKEN - Fix paths: ALL CLOSED ([P1] Lockdown mode failing: GH_AW_GITHUB_TOKEN not configured — 5 workflows affected #17414, [q] fix(workflows): remove explicit lockdown:true to stop recurring failures #17807 both "not_planned")
PR Triage Agent (P1)
- Status: Failing ~4 times/day (every 6h schedule)
- Latest run: run#144 failed at 06:23 UTC — §22475402816
- Active tracking: [aw] PR Triage Agent failed #18638 (new format, expires Mar 6); old [agentics] PR Triage Agent failed #16801 CLOSED Feb 26
- Root cause: Same lockdown token issue
Daily Issues Report Generator (P1)
- Status: Failing daily
- Latest run: run#117 failed at 01:59 UTC — §22469524123
- Tracking: No dedicated issue currently open
- Root cause: Same lockdown token issue
Organization Health Report (P1)
- Status: Failing weekly (6 consecutive failures)
- Latest run: run#26 failed Feb 24 — §22340745027
- Active tracking: [agentics] Organization Health Report failed #17864 (expires Mar 2)
- Root cause: Same lockdown token issue
Systemic Issue: Lockdown Token ⚠️
Root cause: Workflows using lockdown: true require a GH_AW_GITHUB_TOKEN secret that is not provisioned in this environment.
Status: ❌ No fix path currently open
- [P1] Lockdown mode failing: GH_AW_GITHUB_TOKEN not configured — 5 workflows affected #17414 (provision
GH_AW_GITHUB_TOKEN) — CLOSED "not_planned" - [q] fix(workflows): remove explicit lockdown:true to stop recurring failures #17807 (remove
lockdown: truepatches) — CLOSED "not_planned" Feb 25, 2026
Manual intervention required to resolve this systemic issue.
Warnings ⚠️
AI Moderator: Recent runs showing action_required — this is expected behavior for PR moderation (the workflow is functioning correctly, flagging PRs for review).
Healthy Workflows ✅
157 workflows (97%) operating normally. Key infrastructure workflows confirmed healthy:
- ✅ Smoke Copilot: passing (run#2161 success, 05:11 UTC today)
- ✅ Metrics Collector: 5+ consecutive successes (run#71, Feb 26)
- ✅ Smoke Claude / Codex / Gemini: passing
- ✅ All compilation coverage: 161/161 lock files present
New Workflows (since last run) 📦
+3 new workflows detected (total 161, was 158 on Feb 25). All have corresponding .lock.yml files ✅.
Trends
- Overall health: 78/100 (→ stable from last week)
- P1 failures ongoing for ~5 weeks (since ~Jan 21)
- New issue format adopted:
[aw]prefix replacing[agentics]prefix - Issue Monster failure count: 2195 runs, failures accelerating
Recommendations
High Priority
- Manual intervention needed for
GH_AW_GITHUB_TOKENprovisioning — both fix paths closed, but 4 workflows remain broken indefinitely - Daily Issues Report — no tracking issue open; consider creating one if you want to track this workflow's failures separately
Low Priority
- Monitor AI Moderator —
action_requiredis normal but watch for unexpected patterns - Check the 3 new workflows for correctness of triggers and configurations
Actions Taken This Run
- Discovered 161 workflows (100% compiled, no missing lock files)
- Verified 4 P1 failures remain active (same root cause, lockdown token)
- Confirmed smoke tests passing
- Updated shared meta-orchestrator memory
- Created this health dashboard
References:
- §22477033765 — This health manager run
- §22476962612 — Issue Monster latest failure
- §22475402816 — PR Triage Agent latest failure
Generated by Workflow Health Manager - Meta-Orchestrator
- expires on Feb 28, 2026, 7:33 AM UTC