Update metrics-collector and agent-performance-analyzer to new repo-memory path format

[Copilot]

The metrics-collector and agent-performance-analyzer workflows were using outdated repo-memory path formats, preventing proper metrics data sharing and historical trend analysis.

Root Cause

Repo-memory architecture changed to use /tmp/gh-aw/repo-memory/{id}/ format instead of /tmp/gh-aw/repo-memory-default/. Additionally, the branch name is git metadata only - branch contents are placed directly in the memory directory, not in a subdirectory matching the branch name.

Changes

Updated path references in both workflows to use the new repo-memory format:

metrics-collector.md (5 path references):

-**Storage Path**: `/tmp/gh-aw/repo-memory-default/memory/meta-orchestrators/metrics/`
+**Storage Path**: `/tmp/gh-aw/repo-memory/default/metrics/`

-Write metrics to: `/tmp/gh-aw/repo-memory-default/memory/meta-orchestrators/metrics/daily/YYYY-MM-DD.json`
+Write metrics to: `/tmp/gh-aw/repo-memory/default/metrics/daily/YYYY-MM-DD.json`

-Copy current metrics to: `/tmp/gh-aw/repo-memory-default/memory/meta-orchestrators/metrics/latest.json`
+Copy current metrics to: `/tmp/gh-aw/repo-memory/default/metrics/latest.json`

agent-performance-analyzer.md (4 path references):

-**Access shared repo memory at `/tmp/gh-aw/repo-memory-default/memory/meta-orchestrators/`**
+**Access shared repo memory at `/tmp/gh-aw/repo-memory/default/`**

-1. **Latest Metrics**: `/tmp/gh-aw/repo-memory-default/memory/meta-orchestrators/metrics/latest.json`
+1. **Latest Metrics**: `/tmp/gh-aw/repo-memory/default/metrics/latest.json`

Path Structure

• Base: /tmp/gh-aw/repo-memory/ (repo-memory root)
• Memory ID: default (from repo-memory configuration without explicit ID)
• Content: metrics/ (files stored directly from the git branch)

The memory/meta-orchestrators branch name is NOT part of the filesystem path - it's just git metadata.

Impact

• Metrics Collector will write to the correct location that the system actually creates
• Agent Performance Analyzer can access metrics data from the correct location
• Enables historical metrics access, trend analysis, and data-driven performance recommendations
• Both workflows can now properly share metrics data
• No schema or interface changes

Original prompt

---

This section details on the original issue you should resolve

<issue_title>[agent-performance] Verify Metrics Collector workflow execution and data availability</issue_title>
<issue_description>## Problem

The Agent Performance Analyzer relies on historical metrics data from the Metrics Collector workflow, but during this run:

• Expected metrics directory not found: /tmp/gh-aw/repo-memory-default/memory/meta-orchestrators/metrics/
• No latest.json or daily/*.json files available
• Cannot perform trend analysis or compare to historical baselines

Expected Data Structure

According to the Agent Performance Analyzer instructions:

/tmp/gh-aw/repo-memory-default/memory/meta-orchestrators/
├── metrics/
│   ├── latest.json              # Most recent daily snapshot
│   └── daily/
│       ├── 2024-12-29.json     # Daily metrics for last 30 days
│       ├── 2024-12-28.json
│       └── ...

Metrics Expected

Each metrics file should contain:

1. Per-workflow metrics:

   • Safe output counts (issues, PRs, comments, discussions)
   • Workflow run statistics (total, successful, failed, success_rate)
   • Engagement metrics (reactions, comments, replies)
   • Quality indicators (merge rates, close times)

2. Ecosystem metrics:

   • Total workflow count
   • Engine distribution
   • Tool usage patterns
   • Overall success rates

Investigation Tasks

1. Verify Metrics Collector workflow exists and runs:

   • Check .github/workflows/metrics-collector.md
   • Verify schedule configuration (should be daily)
   • Check recent workflow runs

2. Verify repo-memory configuration:

   • Confirm branch: memory/meta-orchestrators
   • Check file glob patterns
   • Verify max file size limits

3. Test metrics collection:

   • Trigger manual workflow run
   • Verify data written to repo memory
   • Validate JSON structure

4. Debug permission issues:

   • Encountered "Permission denied" errors when accessing /tmp/gh-aw/repo-memory-default/
   • Verify directory permissions
   • Check workflow permissions configuration

Impact

Critical - Without metrics data, Agent Performance Analyzer cannot:

• Calculate actual quality scores
• Track effectiveness trends
• Compare current vs. historical performance
• Provide data-driven recommendations
• Measure improvement over time

Acceptance Criteria

• Metrics Collector workflow runs daily
• Latest metrics available at expected path
• Historical metrics (30 days) accessible
• JSON structure valid and complete
• Agent Performance Analyzer can read and parse data
• Directory permissions correct for workflow access

Priority

Critical - Core infrastructure for agent performance analysis

Estimated Effort

1-2 hours (investigation + fixes)

Potential Root Causes

1. Metrics Collector workflow not scheduled/running
2. Repo memory path incorrect or not initialized
3. Permission issues preventing writes
4. Branch name mismatch
5. File glob patterns not matching

Next Steps

1. Check if metrics-collector.md exists and review configuration
2. Verify last successful run of Metrics Collector
3. Test manual trigger to validate data collection
4. Review repo-memory configuration across workflows
5. Document metrics schema for validation

Related

• Blocks comprehensive agent performance analysis
• Complements #aw_enable_github_mcp (GitHub API access)
• Required for trend analysis and historical comparisons

AI generated by Agent Performance Analyzer - Meta-Orchestrator

Comments on the Issue (you are @copilot in this section)

• Fixes [agent-performance] Verify Metrics Collector workflow execution and data availability #8027

---

💬 We'd love your input! Share your thoughts on Copilot coding agent in our 2 minute survey.

[pelikhan]

@copilot review the report memory location, it is now /pkg/gh-aw/repo-memory/{id}/

[Copilot]

Updated all repo-memory paths to the new format /tmp/gh-aw/repo-memory/{id}/ in commit a031c3d.

Changes made:

• metrics-collector.md: Updated 5 path references from /tmp/gh-aw/repo-memory-default/memory/meta-orchestrators/metrics/ to /tmp/gh-aw/repo-memory/default/metrics/
• agent-performance-analyzer.md: Updated 4 path references to match the new format
• Both .lock.yml files recompiled successfully

The key insight: the branch name (memory/meta-orchestrators) is git metadata, not a filesystem path. The branch contents are placed directly into /tmp/gh-aw/repo-memory/default/.