Skip to content

Update wasm golden fixtures for Copilot CLI 0.0.414#17478

Merged
pelikhan merged 2 commits intomainfrom
copilot/fix-wasm-golden-tests
Feb 21, 2026
Merged

Update wasm golden fixtures for Copilot CLI 0.0.414#17478
pelikhan merged 2 commits intomainfrom
copilot/fix-wasm-golden-tests

Conversation

Copy link
Contributor

Copilot AI commented Feb 21, 2026

DefaultCopilotVersion was bumped to 0.0.414 in constants but the three wasm golden fixtures still referenced 0.0.412, breaking TestWasmGolden_CompileFixtures in CI.

Changes

  • Golden fixture updates — replaced both version-bearing strings in each of the three affected fixtures:
    • agent_version: "0.0.412""0.0.414"
    • install_copilot_cli.sh 0.0.412install_copilot_cli.sh 0.0.414
    • Files: basic-copilot.golden, smoke-copilot.golden, with-imports.golden
Original prompt

This section details on the original issue you should resolve

<issue_title>[CI Failure Doctor] CI Failure Investigation - Run #37203</issue_title>
<issue_description>### Summary
Wasm golden fixtures now compare for Copilot CLI 0.0.412 but the pipeline upgraded the CLI to 0.0.414, so the golden output no longer matches and the wasm-focused tests fail.

Failure Details

Root Cause Analysis

The wasm golden tests check the generated workflow snippets, which still expect install_copilot_cli.sh 0.0.412. After bumping the Copilot CLI binary to 0.0.414, the new output contains agent_version: "0.0.414" and the install step now runs install_copilot_cli.sh 0.0.414, so the tests flag the diff.

Failed Jobs and Errors

  • test: TestWasmGolden_CompileFixtures/basic-copilot, TestWasmGolden_CompileFixtures/smoke-copilot, and TestWasmGolden_CompileFixtures/with-imports all failed because golden files still mention CLI 0.0.412.
  • build-wasm: make test-wasm-golden exits with failure because the same wasm golden stretch fails.
Investigation Findings
  • The failure report output recorded the mismatched CLI install step for each fixture and highlighted agent_version: "0.0.414" as the only difference.
  • Regenerating the golden fixtures should update basic-copilot.md, smoke-copilot.md, and with-imports.md to expect the new CLI version and clear the failure.
  • No other jobs in the workflow failed; everything after the wasm tests relies on them, so rerunning the pipeline should succeed after the fixtures are updated.

Recommended Actions

  • Regenerate the wasm golden fixtures via make test-wasm-golden (or go test ./pkg/workflow -run TestWasmGolden_CompileFixtures -count=1) to capture install_copilot_cli.sh 0.0.414 and commit the updated basic-copilot.md, smoke-copilot.md, and with-imports.md.
  • After committing the refreshed fixtures, rerun the workflow so test and build-wasm pass again.

Prevention Strategies

Document the need to rerun the wasm golden fixture generator whenever the Copilot CLI version is bumped so the tests stay in sync with the binary they install.

AI Team Self-Improvement

  • Always regenerate wasm golden fixtures after updating the Copilot CLI binary version so the tests keep tracking the install command.
  • When diagnosing wasm golden failures, compare the agent_version and install_copilot_cli.sh arguments against the golden files.
Historical Context
  • Previous CI Failure Doctor investigations such as [CI Failure Doctor] CI Failure Investigation - Run github/gh-aw#37172 are closed, and no open duplicate issue covers this CLI-version discrepancy.
  • Search results for [CI Failure Doctor] with the cookie label returned only closed issues, so this run appears to be a new investigation.

🩺 Diagnosis provided by CI Failure Doctor

To install this workflow, run gh aw add githubnext/agentics/workflows/ci-doctor.md@ea350161ad5dcc9624cf510f134c6a9e39a6f94d. View source at https://github.com/githubnext/agentics/tree/ea350161ad5dcc9624cf510f134c6a9e39a6f94d/workflows/ci-doctor.md.

  • expires on Feb 22, 2026, 12:14 PM UTC

Comments on the Issue (you are @copilot in this section)


💡 You can make Copilot smarter by setting up custom instructions, customizing its development environment and configuring Model Context Protocol (MCP) servers. Learn more Copilot coding agent tips in the docs.

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
Copilot AI changed the title [WIP] Fix wasm golden tests for Copilot CLI version upgrade Update wasm golden fixtures for Copilot CLI 0.0.414 Feb 21, 2026
@pelikhan pelikhan marked this pull request as ready for review February 21, 2026 12:39
Copilot AI review requested due to automatic review settings February 21, 2026 12:39
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR updates the wasm golden test fixtures to align with the Copilot CLI version bump to 0.0.414, fixing CI test failures in TestWasmGolden_CompileFixtures.

Changes:

  • Updated three wasm golden fixture files to reference Copilot CLI version 0.0.414 instead of 0.0.412

Reviewed changes

Copilot reviewed 3 out of 3 changed files in this pull request and generated no comments.

File Description
pkg/workflow/testdata/wasm_golden/TestWasmGolden_CompileFixtures/basic-copilot.golden Updated agent_version and install_copilot_cli.sh references from 0.0.412 to 0.0.414
pkg/workflow/testdata/wasm_golden/TestWasmGolden_CompileFixtures/smoke-copilot.golden Updated agent_version and install_copilot_cli.sh references from 0.0.412 to 0.0.414
pkg/workflow/testdata/wasm_golden/TestWasmGolden_CompileFixtures/with-imports.golden Updated agent_version and install_copilot_cli.sh references from 0.0.412 to 0.0.414

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

@pelikhan pelikhan merged commit d4f5d51 into main Feb 21, 2026
120 checks passed
@pelikhan pelikhan deleted the copilot/fix-wasm-golden-tests branch February 21, 2026 12:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[CI Failure Doctor] CI Failure Investigation - Run #37203

3 participants