Skip to content

feat: add build test workflows for external test repos#507

Merged
Mossaka merged 3 commits intomainfrom
feat/build-test-workflows
Feb 4, 2026
Merged

feat: add build test workflows for external test repos#507
Mossaka merged 3 commits intomainfrom
feat/build-test-workflows

Conversation

@Mossaka
Copy link
Collaborator

@Mossaka Mossaka commented Feb 4, 2026

Summary

  • Add 7 agentic workflows that clone and test external repositories to validate firewall network rules for different language ecosystems
  • Each workflow triggers on PRs and manual dispatch, runs builds/tests, and reports results via PR comments
  • Update postprocess script to include new workflows for local build patching

Workflows Added

Workflow Language Test Projects Network Rules
build-test-node.md Node.js 20 clsx, execa, p-limit defaults, github, node
build-test-go.md Go 1.22 color, env, uuid defaults, github, go
build-test-rust.md Rust stable fd, zoxide defaults, github, rust
build-test-java.md Java 21 gson, caffeine defaults, github, java
build-test-cpp.md C++ fmt, json defaults, github
build-test-deno.md Deno oak, std defaults, github, node, deno.land, jsr.io
build-test-bun.md Bun elysia, hono defaults, github, node, bun.sh

Test Repositories

All test repos are under Mossaka/:

  • gh-aw-firewall-test-node
  • gh-aw-firewall-test-go
  • gh-aw-firewall-test-rust
  • gh-aw-firewall-test-java
  • gh-aw-firewall-test-cpp
  • gh-aw-firewall-test-deno
  • gh-aw-firewall-test-bun

Test plan

  • Verify workflows compile without errors
  • Trigger each workflow manually via workflow_dispatch
  • Verify each workflow clones test repos and runs build/test commands
  • Verify workflows report results in PR comments
  • Verify workflows add appropriate labels on success

🤖 Generated with Claude Code

@Mossaka @claude
feat: add build test workflows for external test repos
5df857e 
Add 7 agentic workflows that clone and test external repositories to
validate firewall network rules work correctly for different language
ecosystems:

- Node.js: clsx, execa, p-limit (npm install/test)
- Go: color, env, uuid (go mod download/test)
- Rust: fd, zoxide (cargo build/test)
- Java: gson, caffeine (mvn compile/test)
- C++: fmt, json (cmake/make)
- Deno: oak, std (deno test)
- Bun: elysia, hono (bun install/test)

Each workflow:
- Triggers on pull_request and workflow_dispatch
- Uses appropriate network allowlists (defaults, github, language-specific)
- Reports results via PR comments with pass/fail tables
- Adds language-specific labels on success

Also updates postprocess-smoke-workflows.ts to include the new workflows
for local build patching in CI.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
Copilot AI review requested due to automatic review settings February 4, 2026 17:35
@github-actions
Copy link

github-actions bot commented Feb 4, 2026

📰 BREAKING: Smoke Copilot is now investigating this pull request. Sources say the story is developing...

@github-actions
Copy link

github-actions bot commented Feb 4, 2026 •
edited
Loading

💫 TO BE CONTINUED... Smoke Claude failed! Our hero faces unexpected challenges...

@github-actions
Copy link

github-actions bot commented Feb 4, 2026 •
edited
Loading

✅ Coverage Check Passed

Overall Coverage

Metric Base PR Delta
Lines 82.44% 82.44% ➡️ +0.00%
Statements 82.47% 82.47% ➡️ +0.00%
Functions 81.77% 81.77% ➡️ +0.00%
Branches 75.59% 75.59% ➡️ +0.00%

Coverage comparison generated by scripts/ci/compare-coverage.ts

@Mossaka
Copy link
Collaborator Author

Mossaka commented Feb 4, 2026

⏳ This PR is pending a new release of GitHub Agentic Workflows (gh-aw) before the workflows can be tested.

Copilot AI reviewed Feb 4, 2026
View reviewed changes
Copy link

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR adds 7 agentic workflows to test firewall network rules for different language ecosystems (Node.js, Go, Rust, Java, C++, Deno, and Bun). Each workflow clones an external test repository under Mossaka/, runs build and test commands, and reports results via PR comments with pass/fail status.

Changes:

  • Added 7 new build test workflow pairs (.md and .lock.yml files) for different language ecosystems
  • Updated postprocess script to include new workflow lock files for build patching
  • Each workflow configures appropriate network rules, runtime environments, and test commands for its language

Reviewed changes

Copilot reviewed 15 out of 15 changed files in this pull request and generated no comments.

File Description
scripts/ci/postprocess-smoke-workflows.ts Added paths for 7 new build test lock.yml files to enable local build patching
.github/workflows/build-test-*.md 7 new workflow definitions specifying test requirements, commands, and expected outputs for each language
.github/workflows/build-test-*.lock.yml 7 auto-generated compiled workflow files from the .md sources

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

@github-actions github-actions bot mentioned this pull request Feb 4, 2026
Open
Mossaka and others added 2 commits February 4, 2026 19:58
@Mossaka
Merge remote-tracking branch 'origin/main' into feat/build-test-workf…
a8a2b06 
…lows
@Mossaka @claude
chore: merge main and regenerate build-test workflows
9eb8687 
Regenerate build-test lock files with gh-aw v0.42.0 after merging
origin/main.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
@github-actions
Copy link

github-actions bot commented Feb 4, 2026 •
edited
Loading

🎬 THE END — Smoke Claude MISSION: ACCOMPLISHED! The hero saves the day! ✨

@github-actions
Copy link

github-actions bot commented Feb 4, 2026 •
edited
Loading

📰 VERDICT: Smoke Copilot has concluded. All systems operational. This is a developing story. 🎤

@github-actions
Copy link

github-actions bot commented Feb 4, 2026

Smoke Test Results

Last 2 Merged PRs:

Test Results:

  • ✅ GitHub MCP: Retrieved merged PRs successfully
  • ✅ Playwright: Page title verified ("GitHub · Change is constant. GitHub keeps you ahead. · GitHub")
  • ✅ File Write: Created /tmp/gh-aw/agent/smoke-test-copilot-21686286525.txt
  • ✅ Bash: File read verification successful

Overall Status: PASS

cc @Mossaka

AI generated by Smoke Copilot

@github-actions
Copy link

github-actions bot commented Feb 4, 2026

Smoke Test Results - Claude Engine

✅ GitHub MCP: Retrieved recent PRs
✅ Playwright: Navigated to github.com (title: "GitHub · Change is constant. GitHub keeps you ahead. · GitHub")
✅ File Write: Created /tmp/gh-aw/agent/smoke-test-claude-21686286609.txt
✅ Bash: Verified file contents

Status: PASS

AI generated by Smoke Claude

@github-actions
Copy link

github-actions bot commented Feb 4, 2026

Build Test: C++ - Repository Not Accessible

❌ Test Failed: Unable to clone test repository

The repository https://github.com/Mossaka/gh-aw-firewall-test-cpp.git returned a 404 error. The repository either:

  • Does not exist yet
  • Is private and requires authentication
  • Has a different URL

Action Required: Please verify the test repository exists and is publicly accessible, or provide the correct repository URL.

Project CMake Build Status
fmt ⚠️ ⚠️ SKIPPED
json ⚠️ ⚠️ SKIPPED

Overall: FAIL (Repository not accessible)

AI generated by Build Test C++

@github-actions
Copy link

github-actions bot commented Feb 4, 2026

Build Test: Deno - FAILED ❌

Status: Repository not accessible

The test repository https://github.com/Mossaka/gh-aw-firewall-test-deno.git could not be cloned:

  • Repository returns 404 (not found or private)
  • No authentication credentials available in workflow

Required Action:

  • Verify the repository exists and is public, or
  • Provide authentication credentials to access private repository

AI generated by Build Test Deno

@github-actions
Copy link

github-actions bot commented Feb 4, 2026

Bun Build Test Results

Status: FAIL ❌

Error

Unable to clone test repository https://github.com/Mossaka/gh-aw-firewall-test-bun.git:

  • Repository requires authentication but no GitHub credentials are available
  • Error: fatal: could not read Username for 'https://github.com': terminal prompts disabled

Summary

Project Install Tests Status
elysia N/A N/A BLOCKED
hono N/A N/A BLOCKED

Overall: FAIL - Cannot proceed without repository access.

Resolution Required

The test repository appears to be private or requires authentication. Please either:

  1. Make the repository public, or
  2. Provide GitHub credentials to the workflow

AI generated by Build Test Bun

@github-actions
Copy link

github-actions bot commented Feb 4, 2026

Build Test: Go - ❌ FAILED

Status: Cannot complete tests

Error

Failed to clone test repository: https://github.com/Mossaka/gh-aw-firewall-test-go.git

Reason: Repository requires authentication but no GITHUB_TOKEN is available in the workflow environment.

Required Actions

  1. Add GITHUB_TOKEN to workflow environment variables, or
  2. Make the test repository public, or
  3. Provide a Personal Access Token with repo scope

Test Results

Project Download Tests Status
color ⏸️ - SKIPPED
env ⏸️ - SKIPPED
uuid ⏸️ - SKIPPED

Overall: FAILED (Authentication required)

AI generated by Build Test Go

@github-actions
Copy link

github-actions bot commented Feb 4, 2026

Build Test: Node.js - FAILED ❌

Error: Unable to access test repository https://github.com/Mossaka/gh-aw-firewall-test-node

Issue Details

The test repository appears to be private or requires authentication that is not available in this workflow context. Attempted access methods:

  • git clone with HTTPS: Authentication required
  • gh CLI: Not configured with GH_TOKEN
  • Direct archive download: Repository not accessible

Required Action

To run these tests, the workflow needs:

  1. The repository to be public, OR
  2. A GH_TOKEN with repository access configured in the workflow

Test Status

Project Install Tests Status
clsx ⚠️ N/A N/A BLOCKED
execa ⚠️ N/A N/A BLOCKED
p-limit ⚠️ N/A N/A BLOCKED

Overall: BLOCKED - Cannot proceed without repository access

AI generated by Build Test Node.js

@github-actions
Copy link

github-actions bot commented Feb 4, 2026

Build Test: Rust - FAILED ❌

Repository Access Issue

Unable to clone test repository: https://github.com/Mossaka/gh-aw-firewall-test-rust.git

Error: Repository not found (404) or requires authentication

Project Build Tests Status
fd ⚠️ - BLOCKED
zoxide ⚠️ - BLOCKED

Overall: FAILED - Cannot proceed with tests without repository access.

Details:

  • API check returned: "Not Found"
  • Git clone requires authentication credentials
  • GITHUB_TOKEN not available in environment

Next Steps:

  1. Verify repository exists and is public: https://github.com/Mossaka/gh-aw-firewall-test-rust
  2. If private, ensure GitHub token is provided to workflow
  3. If repository doesn't exist yet, create it with test projects

AI generated by Build Test Rust

@Mossaka Mossaka merged commit 097e186 into main Feb 4, 2026
72 checks passed
@Mossaka Mossaka deleted the feat/build-test-workflows branch February 4, 2026 20:13
Mossaka added a commit that referenced this pull request Feb 4, 2026
@Mossaka @claude
chore: merge main and resolve build-test conflicts
9d0a317 
Take main's version of build-test lock files since PR #507 was merged first.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

Copilot code review Copilot Copilot left review comments

Assignees

No one assigned

Labels

smoke-claude smoke-copilot

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@Mossaka