Skip to content

Add daily GitHub remote MCP authentication test workflow#9249

Merged
pelikhan merged 6 commits intomainfrom
copilot/add-daily-agentic-workflow
Jan 7, 2026
Merged

Add daily GitHub remote MCP authentication test workflow#9249
pelikhan merged 6 commits intomainfrom
copilot/add-daily-agentic-workflow

Conversation

Copy link
Contributor

Copilot AI commented Jan 7, 2026

Implements daily automated testing of GitHub remote MCP server authentication with the GitHub Actions token. Validates the remote MCP can successfully access the GitHub API using workflow permissions.

Implementation

  • Workflow: .github/workflows/github-remote-mcp-auth-test.md
    • Daily execution with fuzzy scheduling (11:46 UTC)
    • Tests authentication by listing 3 open issues via GitHub remote MCP
    • Uses mode: remote with minimal [repos, issues, discussions] toolsets
    • Requires issues: read and discussions: read permissions
    • Configured to use gpt-5-mini model for efficient testing

Failure Handling

  • Creates discussion via safe-outputs.create-discussion on authentication failures
    • Posted in "audits" category
    • Prefix: [auth-test]
    • Automatically closes older discussions via close-older-discussions: true
  • No discussion created on success (low noise)

Configuration

engine:
  id: copilot
  model: gpt-5-mini
tools:
  github:
    mode: remote
    toolsets: [repos, issues, discussions]
safe-outputs:
  create-discussion:
    title-prefix: "[auth-test] "
    category: "audits"
    max: 1
    close-older-discussions: true

Passes strict mode validation. Manual trigger available via workflow_dispatch.

Custom agent used: create-agentic-workflow
Design agentic workflows using GitHub Agentic Workflows (gh-aw) extension with interactive guidance on triggers, tools, and security best practices.

Custom agent used: create-agentic-workflow
Design agentic workflows using GitHub Agentic Workflows (gh-aw) extension with interactive guidance on triggers, tools, and security best practices.

Original prompt

Add a daily agentic workflow that tests that the GitHub remote MCP can be used with the GitHub actions token.

Set issues: read and try to list the list 3 open issue. If the MCP tool fails with authentication, create issue using safe output.

close older issues automatically.

Custom agent used: create-agentic-workflow
Design agentic workflows using GitHub Agentic Workflows (gh-aw) extension with interactive guidance on triggers, tools, and security best practices.


💡 You can make Copilot smarter by setting up custom instructions, customizing its development environment and configuring Model Context Protocol (MCP) servers. Learn more Copilot coding agent tips in the docs.

Copilot AI and others added 2 commits January 7, 2026 15:09
- Creates github-remote-mcp-auth-test.md workflow
- Tests GitHub remote MCP server with issues: read permission
- Lists 3 open issues to verify authentication
- Creates issue via safe-outputs if authentication fails
- Closes old test issues automatically (max 10)
- Issues auto-expire after 7 days
- Uses fuzzy daily scheduling

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
Copilot AI changed the title [WIP] Add daily agentic workflow to test GitHub remote MCP Add daily GitHub remote MCP authentication test workflow Jan 7, 2026
Copilot AI requested a review from pelikhan January 7, 2026 15:14
@pelikhan
Copy link
Contributor

pelikhan commented Jan 7, 2026

@copilot merge main, use copilot gpt-5-mini

Copilot AI and others added 2 commits January 7, 2026 15:22
- Merged origin/main into copilot/add-daily-agentic-workflow
- Added engine configuration with model: gpt-5-mini
- Recompiled workflow with new model configuration

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
Copy link
Contributor Author

Copilot AI commented Jan 7, 2026

@copilot merge main, use copilot gpt-5-mini

Done! Merged main and configured the workflow to use gpt-5-mini model in commit f6e5503.

Changes:

  • Merged origin/main (includes docs updates)
  • Added engine configuration with model: gpt-5-mini
  • Recompiled workflow with new model settings
  • Verified compilation passes strict mode validation

The workflow now uses the gpt-5-mini model for daily GitHub remote MCP authentication testing.

@pelikhan pelikhan marked this pull request as ready for review January 7, 2026 15:26
@pelikhan
Copy link
Contributor

pelikhan commented Jan 7, 2026

@copilot use create-discussion instead of create-issue

- Replaced create-issue with create-discussion in audits category
- Added close-older-discussions: true for automatic cleanup
- Removed close-issue safe output (no longer needed)
- Updated permissions to include discussions: read
- Added discussions toolset to GitHub MCP configuration
- Updated prompt to reference discussions instead of issues
- Recompiled workflow with new configuration

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
Copy link
Contributor Author

Copilot AI commented Jan 7, 2026

@copilot use create-discussion instead of create-issue

Done! Changed to use create-discussion instead of create-issue in commit aab0c18.

Changes:

  • Replaced create-issue with create-discussion in audits category
  • Enabled close-older-discussions: true for automatic cleanup
  • Updated permissions to include discussions: read
  • Added discussions to GitHub MCP toolsets
  • Updated all prompt references from issues to discussions

The workflow now creates discussions instead of issues for test failures, making results better organized in the audits category.

@pelikhan pelikhan merged commit b68086a into main Jan 7, 2026
3 checks passed
@pelikhan pelikhan deleted the copilot/add-daily-agentic-workflow branch January 7, 2026 15:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants