Skip to content

🔍 Multi-Device Docs Testing Report - 2026-03-21 #22074

@github-actions

Description

@github-actions

Test Summary

Note on test methodology: The local dev server (port 4321) was inaccessible from the Playwright container due to Docker bridge network isolation. Tests were run against the live deployed site at https://github.github.com/gh-aw/, which reflects the current canonical deployment.

Results Overview

  • 🟢 Passed: 10 / 10 devices — no layout issues
  • 🟡 Warnings: 2 minor accessibility findings
  • 🔴 Critical: 0

Accessibility Findings

🟡 Warning: 1 button missing accessible text

A button element exists without visible text content or aria-label. Screen readers will not be able to describe its purpose.

Recommendation: Add an aria-label attribute to the button, or add visually-hidden text via a <span class="sr-only"> element.

🟡 Warning: No skip-navigation link detected

The page does not contain a skip-to-main-content link (e.g. (a href="#main-content")). Keyboard-only users must tab through all navigation items on every page load.

Recommendation: Add a visually-hidden focusable link as the first element in (body):

(a href="#main-content" class="sl-sr-only-focusable")Skip to main content(/a)

View Detailed Test Results by Device

Mobile Devices

Device Viewport Overflow Nav Mobile Menu Content Font
iPhone 12 390×844 ✅ None 16px
iPhone 12 Pro Max 428×926 ✅ None 16px
Pixel 5 393×851 ✅ None 16px
Galaxy S21 360×800 ✅ None 16px
  • Mobile menu button present with correct aria-label="Toggle navigation menu" and aria-expanded state
  • No horizontal overflow on any mobile device
  • Sidebar hidden on landing page (expected landing page behavior)

Tablet Devices

Device Viewport Overflow Nav Mobile Menu Content Font
iPad 768×1024 ✅ None 16px
iPad Pro 11 834×1194 ✅ None 16px
iPad Pro 12.9 1024×1366 ✅ None 16px
  • All tablet breakpoints render correctly
  • No content overflow detected

Desktop Devices

Device Viewport Overflow Nav Sidebar Content Font
Desktop HD 1366×768 ✅ None ✅ (interior pages) 16px
Desktop FHD 1920×1080 ✅ None ✅ (interior pages) 16px
Desktop 4K 2560×1440 ✅ None ✅ (interior pages) 16px
  • Sidebar renders on interior documentation pages (verified on Quick Start)
  • Full-width layout adapts cleanly to 4K resolutions
View Interactive Feature Test Results

Navigation

  • ✅ Top navigation links work correctly (Quick Start, Create, Examples, Docs, FAQ, Blog)
  • ✅ Navigation to /setup/quick-start/ succeeds and renders page title correctly
  • ✅ Interior page displays 6 code blocks, sidebar visible, no overflow

Search

  • ✅ Search button present with aria-label="Search" and keyboard shortcut indicator (⌃K)
  • ✅ Search modal opens correctly with role="dialog" and functional text input

Heading Structure (Landing Page)

  • ✅ Single H1: "GitHub Agentic Workflows"
  • ✅ Logical hierarchy: H1 → H2 (Key Features, Guardrails Built-In, Example) → H3 (feature cards)
  • ✅ 55 links, 4 buttons, 1 image found on landing page

Theme Support

  • ✅ Dark/light mode toggle via data-theme attribute — working correctly
View Console Output

No errors from the docs site itself. 8 console errors present from unrelated network testing activity during this automated test run (requests to internal IPs like 172.30.0.10, 172.17.0.1, and example.com from earlier connectivity probing).

Recommendations

  1. Add aria-label to the unlabeled button — locate it with: document.querySelectorAll('button').filter(b => !b.textContent.trim() && !b.getAttribute('aria-label'))
  2. Add a skip-navigation link before the (header) in the Starlight layout to improve keyboard navigation accessibility
  3. Consider adding the Starlight [skipLinks]((starlight.astro.build/redacted) configuration option if not already enabled

References:

Warning

⚠️ Firewall blocked 5 domains

The following domains were blocked by the firewall during workflow execution:

  • 172.30.0.20
  • b7952d9881df
  • localtunnel.me
  • serveo.net
  • www.google.com

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "172.30.0.20"
    - "b7952d9881df"
    - "localtunnel.me"
    - "serveo.net"
    - "www.google.com"

See Network Configuration for more information.

Generated by Multi-Device Docs Tester ·

  • expires on Mar 23, 2026, 2:55 AM UTC

Metadata

Metadata

Assignees

No one assigned

    Labels

    automatedcookieIssue Monster Loves Cookies!documentationImprovements or additions to documentationtesting

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions