Skip to content

ci(e2e): warm chat and platform URLs before QA.4 suite#13

Closed
Shaivpidadi wants to merge 1 commit intodevfrom
feat/nova-qa4-warmup-chat-url
Closed

ci(e2e): warm chat and platform URLs before QA.4 suite#13
Shaivpidadi wants to merge 1 commit intodevfrom
feat/nova-qa4-warmup-chat-url

Conversation

@Shaivpidadi
Copy link
Copy Markdown
Member

Summary

  • Extends the E2E warmup step in .github/workflows/e2e.yml to also ping the chat app and platform dashboard (currently only precheck is warmed).
  • Unblocks the QA.4 suite — including pii-decision-log.spec.ts — which has been failing the "passes against staging" acceptance criterion because the chat URL was cold-starting when page.goto('/') ran in the auth fixture.

Context

Recent E2E runs on dev (24855162725, 24843846754, 24843302754) all failed at the first step of every spec:

TimeoutError: page.waitForURL: Timeout 30000ms exceeded.
> 6 | await page.waitForURL(/\/login(\?|$)/);

The existing warmup pings only $STAGING_PRECHECK_URL/api/v1/health, so the Render-hosted chat Next.js server was still cold when Playwright started. Warming it pre-test removes that class of flake and lets the real assertions (redact badge, decision log row) run.

Test plan

  • Re-run E2E workflow after merge and confirm auth + PII decision-log specs pass
  • If any spec still fails, confirm the failure is logical (not cold-start) and that trace artifacts are uploaded

The previous warmup only pinged precheck, leaving the Render-hosted
chat app and platform dashboard cold. Every spec starts with a nav to
the chat app, so cold starts caused the entire QA.4 suite — including
the PII decision-log test — to time out on `/login`.

Warm all three Render services (precheck, chat, platform) in sequence
so `pnpm test:e2e` starts against a hot staging environment. Each
service is given up to 10 retries with a 15s sleep, matching the
previous precheck-only behavior.

Unblocks QA.4 acceptance criterion "Passes against staging".
@vercel
Copy link
Copy Markdown
Contributor

vercel Bot commented Apr 23, 2026

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
chat-agent-example Ready Ready Preview, Comment Apr 23, 2026 8:10pm

@Shaivpidadi
Copy link
Copy Markdown
Member Author

Superseded by #12 (GOV-592), which applies the same warmup fix and also bumps navigation/test timeouts to absorb residual cold-start latency. Deferring to that PR.

@Shaivpidadi Shaivpidadi deleted the feat/nova-qa4-warmup-chat-url branch April 23, 2026 20:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant