[observability] Observability Coverage Report - 2026-04-28

[github-actions[bot]]

Executive Summary

Analyzed 94 completed workflow runs retrieved from the last-7-days query. The downloaded sample covers the latest available high-activity slice (2026-04-28 to 2026-04-28); 6 in-progress runs were retrieved but excluded from coverage scoring because final artifacts are not available until completion.

AWF Firewall observability is mostly healthy at 98.9% coverage (93/94 completed firewall-enabled runs with access.log). MCP telemetry coverage is healthy at 100.0% (93/93 MCP-enabled runs with either gateway.jsonl or the canonical rpc-messages.jsonl fallback). All observed MCP telemetry came from rpc-messages.jsonl; no completed run in this sample published gateway.jsonl.

Key Alerts and Anomalies

🔴 Critical Issues:

• AWF Firewall access log missing for DeepReport - Intelligence Gathering Agent §25061830104 (2026-04-28, conclusion: failure).

⚠️ Warnings:

• 12 completed firewall-enabled runs published access.log but parsed with zero firewall entries, mostly Smoke CI runs.
• 6 MCP-enabled runs published rpc-messages.jsonl but had zero derived MCP entries/tool calls in the parsed summary.
• 6 retrieved runs were still in progress and were deferred from coverage scoring because final artifacts were not yet uploaded.

Coverage Summary

Component	Runs Analyzed	Logs Present	Coverage	Status
AWF Firewall (access.log)	94	93	98.9%	🔴 Critical
MCP Gateway (gateway.jsonl or rpc-messages.jsonl)	93	93	100.0%	⚠️ Warning

Detailed Run Analysis

Firewall-Enabled Runs

Workflow	Run ID	access.log	Entries	Allowed	Blocked	Status
DeepReport - Intelligence Gathering Agent	§25061830104	❌	0	0	0	🔴 Critical
Smoke CI	§25080677949	✅	0	0	0	⚠️ Warning
Smoke CI	§25079988548	✅	0	0	0	⚠️ Warning
Smoke CI	§25079868645	✅	0	0	0	⚠️ Warning
Smoke CI	§25079779583	✅	0	0	0	⚠️ Warning
Smoke CI	§25078909093	✅	0	0	0	⚠️ Warning
Smoke CI	§25077198931	✅	0	0	0	⚠️ Warning
Smoke CI	§25075909456	✅	0	0	0	⚠️ Warning
Smoke CI	§25075889608	✅	0	0	0	⚠️ Warning
Smoke CI	§25072221378	✅	0	0	0	⚠️ Warning
Smoke CI	§25068301168	✅	0	0	0	⚠️ Warning
Smoke CI	§25067920787	✅	0	0	0	⚠️ Warning
Smoke CI	§25067072893	✅	0	0	0	⚠️ Warning
Package Specification Librarian	§25083165961	✅	26	26	0	✅ Healthy
Test Quality Sentinel	§25082969716	✅	4	4	0	✅ Healthy
Design Decision Gate 🏗️	§25082969684	✅	9	9	0	✅ Healthy
Daily Skill Optimizer Improvements	§25082926596	✅	5	5	0	✅ Healthy
AI Moderator	§25082909493	✅	8	6	2	✅ Healthy
Issue Monster	§25082883002	✅	3	3	0	✅ Healthy
Test Quality Sentinel	§25082700826	✅	16	16	0	✅ Healthy
Design Decision Gate 🏗️	§25082700747	✅	22	22	0	✅ Healthy
Daily Safe Output Integrator	§25082334998	✅	15	8	7	✅ Healthy
Issue Monster	§25081789974	✅	4	4	0	✅ Healthy
Daily Secrets Analysis Agent	§25080938442	✅	14	7	7	✅ Healthy
Issue Monster	§25080887506	✅	3	3	0	✅ Healthy
Smoke Gemini	§25080367963	✅	11	10	1	✅ Healthy
Smoke Claude	§25080367957	✅	17	17	0	✅ Healthy
Smoke Codex	§25080367944	✅	30	25	5	✅ Healthy
Smoke Copilot	§25080367933	✅	28	28	0	✅ Healthy
Changeset Generator	§25080367926	✅	122	114	8	✅ Healthy
Draft PR Cleanup	§25080270176	✅	17	17	0	✅ Healthy
Daily Safe Outputs Conformance Checker	§25080250836	✅	9	9	0	✅ Healthy
Test Quality Sentinel	§25079984880	✅	4	4	0	✅ Healthy
Design Decision Gate 🏗️	§25079984859	✅	9	9	0	✅ Healthy
Test Quality Sentinel	§25079956410	✅	9	9	0	✅ Healthy
Design Decision Gate 🏗️	§25079956407	✅	10	10	0	✅ Healthy
Design Decision Gate 🏗️	§25079858178	✅	9	9	0	✅ Healthy
Test Quality Sentinel	§25079858155	✅	12	12	0	✅ Healthy

Missing Firewall Logs (access.log)

Workflow	Run ID	Date	Link
DeepReport - Intelligence Gathering Agent	25061830104	2026-04-28	§25061830104

MCP-Enabled Runs

Workflow	Run ID	Telemetry Source	Entries	Servers	Tool Calls	Errors	Status
Smoke Gemini	§25080367963	rpc-messages.jsonl	0	N/A	0	0	⚠️ Warning
Go Logger Enhancement	§25078738903	rpc-messages.jsonl	0	N/A	0	0	⚠️ Warning
Contribution Check	§25078011250	rpc-messages.jsonl	0	N/A	0	0	⚠️ Warning
Auto-Triage Issues	§25072008417	rpc-messages.jsonl	0	N/A	0	0	⚠️ Warning
Contribution Check	§25067613852	rpc-messages.jsonl	0	N/A	0	0	⚠️ Warning
The Daily Repository Chronicle	§25063756460	rpc-messages.jsonl	0	N/A	0	0	⚠️ Warning
Package Specification Librarian	§25083165961	rpc-messages.jsonl	1	safeoutputs	1	0	✅ Healthy
Test Quality Sentinel	§25082969716	rpc-messages.jsonl	1	safeoutputs	1	0	✅ Healthy
Design Decision Gate 🏗️	§25082969684	rpc-messages.jsonl	1	safeoutputs	1	0	✅ Healthy
Daily Skill Optimizer Improvements	§25082926596	rpc-messages.jsonl	1	safeoutputs	1	0	✅ Healthy
AI Moderator	§25082909493	rpc-messages.jsonl	6	github, safeoutputs	6	0	✅ Healthy
Issue Monster	§25082883002	rpc-messages.jsonl	8	github, safeoutputs	8	0	✅ Healthy
Test Quality Sentinel	§25082700826	rpc-messages.jsonl	2	safeoutputs	2	0	✅ Healthy
Design Decision Gate 🏗️	§25082700747	rpc-messages.jsonl	2	safeoutputs	2	0	✅ Healthy
Daily Safe Output Integrator	§25082334998	rpc-messages.jsonl	1	safeoutputs	1	0	✅ Healthy
Issue Monster	§25081789974	rpc-messages.jsonl	8	github, safeoutputs	8	0	✅ Healthy
Daily Secrets Analysis Agent	§25080938442	rpc-messages.jsonl	1	safeoutputs	1	0	✅ Healthy
Issue Monster	§25080887506	rpc-messages.jsonl	8	github, safeoutputs	8	0	✅ Healthy
Smoke CI	§25080677949	rpc-messages.jsonl	1	safeoutputs	1	0	✅ Healthy
Smoke Claude	§25080367957	rpc-messages.jsonl	72	agenticworkflows, github, mcpscripts, playwright	29	0	✅ Healthy
Smoke Codex	§25080367944	rpc-messages.jsonl	13	github, playwright, safeoutputs, serena	13	0	✅ Healthy
Smoke Copilot	§25080367933	rpc-messages.jsonl	68	github, mcpscripts, playwright, safeoutputs	28	0	✅ Healthy
Changeset Generator	§25080367926	rpc-messages.jsonl	2	safeoutputs	2	0	✅ Healthy
Draft PR Cleanup	§25080270176	rpc-messages.jsonl	3	github, safeoutputs	3	0	✅ Healthy
Daily Safe Outputs Conformance Checker	§25080250836	rpc-messages.jsonl	1	safeoutputs	1	0	✅ Healthy
Smoke CI	§25079988548	rpc-messages.jsonl	1	safeoutputs	1	0	✅ Healthy
Test Quality Sentinel	§25079984880	rpc-messages.jsonl	1	safeoutputs	1	0	✅ Healthy
Design Decision Gate 🏗️	§25079984859	rpc-messages.jsonl	1	safeoutputs	1	0	✅ Healthy
Test Quality Sentinel	§25079956410	rpc-messages.jsonl	2	safeoutputs	2	0	✅ Healthy
Design Decision Gate 🏗️	§25079956407	rpc-messages.jsonl	8	github, safeoutputs	8	0	✅ Healthy
Smoke CI	§25079868645	rpc-messages.jsonl	1	safeoutputs	1	0	✅ Healthy

Missing MCP Telemetry (no gateway.jsonl or rpc-messages.jsonl)

No completed MCP-enabled runs were missing both gateway.jsonl and rpc-messages.jsonl.

Deferred In-Progress Runs

• Smoke CI §25083594245 (in_progress)
• Daily Safe Output Tool Optimizer §25083560850 (in_progress)
• Daily Observability Report for AWF Firewall and MCP Gateway §25083551453 (in_progress)
• Daily Semgrep Scan §25083520265 (in_progress)
• GitHub API Consumption Report Agent §25083284908 (in_progress)
• Daily Project Performance Summary Generator (Using MCP Scripts) §25083086049 (in_progress)

Telemetry Quality Analysis

Firewall Log Quality

• Total access.log entries analyzed: 2169
• Domains accessed: 23 unique
• Blocked requests: 168 (7.7%)
• Allowed requests: 2001
• Most accessed domains: api.githubcopilot.com:443 (603), api.anthropic.com:443 (592), github.com:443 (590), (unknown) (143), api.openai.com:443 (69)

Gateway Log Quality

• Telemetry source: rpc-messages.jsonl canonical fallback for 93 completed MCP-enabled runs; gateway.jsonl for 0 runs
• Total telemetry entries analyzed: 882
• MCP servers used: safeoutputs (86), github (29), agenticworkflows (4), mcpscripts (4), serena (4), playwright (3), tavily (1)
• Total tool calls: 699
• Error rate: 0.0%
• Average response time: N/A from this summary because the available telemetry source is rpc-messages.jsonl and duration pairing was not emitted in the parsed aggregate

Additional Artifacts

• agent-stdio.log present: 93/94 completed runs
• agent_output.json present: 92/94 completed runs
• aw_info.json present: 94/94 completed runs
• safeoutputs.jsonl present: 90/94 completed runs

Recommended Actions

1. Investigate why the failed DeepReport run §25061830104 did not publish sandbox/firewall/logs/access.log; this is the only completed firewall-enabled run where the critical Squid log was absent.
2. Review the 12 completed Smoke CI runs where access.log exists but parsed with zero entries to confirm whether those jobs had no network activity after firewall startup or whether parser/artifact timing missed Squid events.
3. Keep accepting rpc-messages.jsonl as valid MCP telemetry, but consider restoring or documenting gateway.jsonl emission if structured per-event duration/status fields are still expected for dashboards.

Historical Trends

No prior local baseline was available in this run. Current completed-run baseline: firewall coverage 98.9%, MCP telemetry coverage 100.0%, blocked firewall request rate 7.7%, MCP error rate 0.0%.

References: §25061830104, §25080677949, §25079988548

Warning

Firewall blocked 4 domains

The following domains were blocked by the firewall during workflow execution:

• ab.chatgpt.com
• api.github.com
• chatgpt.com
• github.com

💡 Tip: api.github.com is blocked because GitHub API access uses the built-in GitHub tools by default. Instead of adding api.github.com to network.allowed, use tools.github.mode: gh-proxy for direct pre-authenticated GitHub CLI access without requiring network access to api.github.com:

tools:
  github:
    mode: gh-proxy

See GitHub Tools for more information on gh-proxy mode.

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "ab.chatgpt.com"
    - "api.github.com"
    - "chatgpt.com"
    - "github.com"

See Network Configuration for more information.

Generated by Daily Observability Report for AWF Firewall and MCP Gateway · ◷

• expires on Apr 29, 2026, 11:56 PM UTC

[github-actions[bot]]

This discussion has been marked as outdated by Daily Observability Report for AWF Firewall and MCP Gateway.

A newer discussion is available at Discussion #29219.