[CI Failure Doctor] CI Failure Investigation - Run #37644

[github-actions]

Summary

The CI run for commit 8624e99d3 failed because TestWasmGolden_CompileFixtures/basic-copilot is comparing against a golden workflow that still references Copilot CLI 0.0.414 even though the compiled output now embeds 0.0.415.

Failure Details

• Run: 22337376002
• Commit: 8624e99
• Trigger: push

Root Cause Analysis

The wasm golden fixture hard-codes agent_version: "0.0.414" and the install step uses /opt/gh-aw/actions/install_copilot_cli.sh 0.0.414, but the compiled YAML that go test produced during the run now carries agent_version: "0.0.415" and installs version 0.0.415. The mismatch trips require.Equal in TestWasmGolden_CompileFixtures/basic-copilot, so both build-wasm and test jobs fail, and make recompile in build aborts with compilation failed before updating workflows.

Failed Jobs and Errors

• build-wasm: TestWasmGolden_CompileFixtures/basic-copilot failed because the actual YAML reported agent_version: "0.0.415" and /opt/gh-aw/actions/install_copilot_cli.sh 0.0.415, while the golden fixture still expects 0.0.414.
• test: runs the same golden test and fails for the same diff in pkg/workflow/wasm_golden_test.go:98.
• build: make recompile stops with compilation failed because the wasm golden comparisons fail before the workflow generation step can finish.

Investigation Findings

• Extracting the actual output from the failed build-wasm log and diffing it against basic-copilot.golden shows exactly two lines changed: the agent_version value and the install_copilot_cli.sh argument switched from 0.0.414 to 0.0.415.
• The golden file was not regenerated with the Copilot CLI 0.0.415 bump, so the string comparison in TestWasmGolden_CompileFixtures/basic-copilot trips and aborts the job.
• Attempts to rerun go test ./pkg/workflow -run '^TestWasmGolden_CompileFixtures/basic-copilot$' and make recompile locally hit the firewall: go tries to download modules such as github.com/cli/go-gh/v2@v2.13.0 from (proxy.golang.org/redacted) and the request is Forbidden`, so no local verification could be completed.

Recommended Actions

• Regenerate pkg/workflow/testdata/wasm_golden/TestWasmGolden_CompileFixtures/basic-copilot.golden so it expects Copilot CLI 0.0.415 for both agent_version and the install step.
• Re-run the golden test (go test ./pkg/workflow -run '^TestWasmGolden_CompileFixtures/basic-copilot$') and make recompile after module downloads are allowed so we can verify the fix.

Prevention Strategies

Ensure that whenever the Copilot CLI agent version or install_copilot_cli.sh argument is bumped, the related wasm golden fixtures are regenerated and committed before pushing the change.

AI Team Self-Improvement

When updating the Copilot CLI version, always rerun make update-wasm-golden (or go test ./pkg/workflow -run '^TestWasmGolden_CompileFixtures/basic-copilot$' -update) so that golden fixtures stay in sync with the installed agent.

Historical Context

Similar golden-test failures occur each time the Copilot CLI version is bumped because the fixtures capture the version string; updating the fixture immediately after the version change keeps recompile clean.

🩺 Diagnosis provided by CI Failure Doctor

To install this workflow, run gh aw add githubnext/agentics/workflows/ci-doctor.md@ea350161ad5dcc9624cf510f134c6a9e39a6f94d. View source at https://github.com/githubnext/agentics/tree/ea350161ad5dcc9624cf510f134c6a9e39a6f94d/workflows/ci-doctor.md.

• expires on Feb 25, 2026, 5:16 AM UTC

[github-actions]

Run #37647 also hits the same golden mismatch

• Jobs: build-wasm and test both fail, again because TestWasmGolden_CompileFixtures/basic-copilot, .../smoke-copilot, and .../with-imports compare the actual YAML (agent_version 0.0.415 + /opt/gh-aw/actions/install_copilot_cli.sh 0.0.415) against golden fixtures that still expect 0.0.414. The test-result-unit.json artifact contains the same diff we saw yesterday (output differs from golden for ... followed by the two lines above).
• Logs: https://github.com/github/gh-aw/actions/runs/22337895097/jobs/64634554394 (build-wasm) and https://github.com/github/gh-aw/actions/runs/22337895097/jobs/64634554405 (test).

Please regenerate the wasm golden fixtures (make update-wasm-golden or go test ./pkg/workflow -run '^TestWasmGolden_CompileFixtures' -update) so they embed 0.0.415 before this run can pass.

🩺 Diagnosis provided by CI Failure Doctor

To install this workflow, run gh aw add githubnext/agentics/workflows/ci-doctor.md@ea350161ad5dcc9624cf510f134c6a9e39a6f94d. View source at https://github.com/githubnext/agentics/tree/ea350161ad5dcc9624cf510f134c6a9e39a6f94d/workflows/ci-doctor.md.

[github-actions]

This issue is being closed as outdated. A newer issue has been created: #18068

View newer issue

---

This action was performed automatically by the CI Failure Doctor workflow.