Skip to content

ci: split E2E tests into smoke (pre-merge) and full (post-merge) tiers#740

Merged
ArangoGutierrez merged 3 commits intomainfrom
ci/e2e-test-tiering
Mar 26, 2026
Merged

ci: split E2E tests into smoke (pre-merge) and full (post-merge) tiers#740
ArangoGutierrez merged 3 commits intomainfrom
ci/e2e-test-tiering

Conversation

@ArangoGutierrez
Copy link
Copy Markdown
Collaborator

Summary

  • Add e2e-smoke.yaml — runs 2 high-signal tests (default && !rpm + cluster && minimal) on every PR push (~20-25 min, ~$0.60)
  • Convert e2e.yaml to full-tier post-merge — runs all remaining labels on push to main only
  • Fix broken workflow_run if-conditions that silently skipped all E2E tests
  • Add auto-issue creation on post-merge E2E failures

Test plan

  • Smoke tests (E2E Smoke) appear in PR checks and run
  • Full tests (E2E Full Tests) do NOT appear in PR checks
  • After merge: both smoke and full tiers run on main
  • On full-tier failure: GitHub issue auto-created with e2e-failure label

Cost impact

  • PR pushes: ~$0.60/push (was $0 due to bug — E2E was silently skipped)
  • Merges to main: ~$9-13/merge (smoke + full matrix)

Spec: docs/superpowers/specs/2026-03-25-e2e-test-tiering-design.md

@coveralls
Copy link
Copy Markdown

coveralls commented Mar 26, 2026

Pull Request Test Coverage Report for Build 23588309028

Details

  • 0 of 0 changed or added relevant lines in 0 files are covered.
  • No unchanged relevant lines lost coverage.
  • Overall coverage remained the same at 56.346%

Totals Coverage Status
Change from base Build 23586745948: 0.0%
Covered Lines: 3729
Relevant Lines: 6618

💛 - Coveralls

Signed-off-by: Carlos Eduardo Arango Gutierrez <eduardoa@nvidia.com>
Signed-off-by: Carlos Eduardo Arango Gutierrez <eduardoa@nvidia.com>
Signed-off-by: Carlos Eduardo Arango Gutierrez <eduardoa@nvidia.com>
@ArangoGutierrez ArangoGutierrez merged commit 1412392 into main Mar 26, 2026
17 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants