Skip to content

ci(playwright): skip E2E tests for Dependabot PRs#518

Merged
gkorland merged 3 commits intostagingfrom
ci/skip-e2e-dependabot
Apr 5, 2026
Merged

ci(playwright): skip E2E tests for Dependabot PRs#518
gkorland merged 3 commits intostagingfrom
ci/skip-e2e-dependabot

Conversation

@gkorland
Copy link
Copy Markdown
Contributor

@gkorland gkorland commented Apr 5, 2026

Summary

Skip Playwright E2E tests for Dependabot-authored PRs since repository secrets (Azure OpenAI API keys) are not available in Dependabot PR runs.

Changes

  • Added if condition to the test job in .github/workflows/playwright.yml
  • Condition: github.event_name != 'pull_request' || github.event.pull_request.user.login != 'dependabot[bot]'
  • Push events (merge to staging/main) are unaffected — full E2E coverage runs there

Testing

  • Verified YAML syntax is valid
  • Condition logic: skips only for pull_request events from dependabot[bot], preserves push events and regular PRs
  • All other CI checks (unit tests, pylint, dependency review, spellcheck) remain unchanged

Memory / Performance Impact

N/A — CI workflow change only.

Related Issues

Fixes persistent Playwright failures on all Dependabot PRs:

Summary by CodeRabbit

  • Chores

    • CI workflow now skips the Playwright end-to-end test job for automated dependency-update pull requests.
    • Project wordlist updated to include "Dependabot" and ensure file newline consistency.
  • Documentation

    • CI docs updated to state the Playwright E2E suite is intentionally skipped on those automated PRs due to unavailable secrets.

Dependabot PRs do not have access to repository secrets (AZURE_API_KEY,
AZURE_API_BASE, AZURE_API_VERSION) required by the LLM-dependent E2E
tests for database schema loading. This causes all Database Connection
and Chat Feature tests to fail with 'Failed to load database schema'.

Skip the Playwright job for Dependabot-authored PRs while preserving
full coverage on push events (merge to staging/main) where secrets are
available. Unit tests, pylint, dependency review, and spellcheck still
run for all PRs.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@overcut-ai
Copy link
Copy Markdown

overcut-ai bot commented Apr 5, 2026

Completed Working on "Code Review"

✅ Code review complete. No issues found - all changes look good! ✅

✅ Workflow completed successfully.


👉 View complete log

@github-actions
Copy link
Copy Markdown

github-actions bot commented Apr 5, 2026

Dependency Review

✅ No vulnerabilities or license issues or OpenSSF Scorecard issues found.

Snapshot Warnings

⚠️: No snapshots were found for the head SHA b3c598e.
Ensure that dependencies are being submitted on PR branches and consider enabling retry-on-snapshot-warnings. See the documentation for more information and troubleshooting advice.

Scanned Files

None

@coderabbitai
Copy link
Copy Markdown
Contributor

coderabbitai bot commented Apr 5, 2026

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro

Run ID: b3f54dbb-744c-46f4-8045-4bcaf9330ca5

📥 Commits

Reviewing files that changed from the base of the PR and between 1869c10 and b3c598e.

📒 Files selected for processing (1)
  • .github/wordlist.txt
✅ Files skipped from review due to trivial changes (1)
  • .github/wordlist.txt

📝 Walkthrough

Walkthrough

Adds a job-level if conditional to the Playwright E2E GitHub Actions workflow to skip the test job for Dependabot pull requests; updates AGENTS.md to document this behavior; .github/wordlist.txt updated to include Dependabot and ensure a trailing newline.

Changes

Cohort / File(s) Summary
GitHub Actions Workflow Configuration
\.github/workflows/playwright.yml
Added a job-level if: condition to skip the test job when the event is a pull request authored by dependabot[bot]; runner, timeout, and steps remain unchanged.
Documentation
AGENTS.md
Updated text to state the Playwright E2E suite is skipped on Dependabot PRs due to unavailable secrets.
Repository Wordlist
\.github/wordlist.txt
Added Dependabot to the wordlist and ensured the file ends with a newline (adjusted handling of Zod entries).

Estimated code review effort

🎯 2 (Simple) | ⏱️ ~10 minutes

Poem

🐇 I scurry past checks with a curious hop,
Dependabot prances and I pause — I stop.
Secrets stay safe in a cozy little den,
I nibble a carrot and wait for green again. 🥕

🚥 Pre-merge checks | ✅ 3
✅ Passed checks (3 passed)
Check name Status Explanation
Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check ✅ Passed The pull request title 'ci(playwright): skip E2E tests for Dependabot PRs' accurately summarizes the main change: adding a conditional to skip Playwright E2E tests for Dependabot pull requests.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch ci/skip-e2e-dependabot

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

@railway-app
Copy link
Copy Markdown

railway-app bot commented Apr 5, 2026

🚅 Deployed to the QueryWeaver-pr-518 environment in queryweaver

Service Status Web Updated (UTC)
QueryWeaver ✅ Success (View Logs) Web Apr 5, 2026 at 6:30 am

@railway-app railway-app bot temporarily deployed to queryweaver / QueryWeaver-pr-518 April 5, 2026 06:05 Destroyed
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@railway-app railway-app bot temporarily deployed to queryweaver / QueryWeaver-pr-518 April 5, 2026 06:08 Destroyed
@railway-app railway-app bot temporarily deployed to queryweaver / QueryWeaver-pr-518 April 5, 2026 06:19 Destroyed
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@gkorland gkorland force-pushed the ci/skip-e2e-dependabot branch from 1869c10 to b3c598e Compare April 5, 2026 06:23
@railway-app railway-app bot temporarily deployed to queryweaver / QueryWeaver-pr-518 April 5, 2026 06:23 Destroyed
@gkorland gkorland merged commit b99f7c8 into staging Apr 5, 2026
13 checks passed
@gkorland gkorland deleted the ci/skip-e2e-dependabot branch April 5, 2026 06:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant