[email protected]

Bug Fixes

• Fix "no low surrogate in string" API error: Sanitize accessibility snapshot text using toWellFormed() to remove unpaired Unicode surrogates that break JSON encoding for Claude API (requires Node.js 20+ for sanitization, gracefully degrades on older versions)

[email protected]

Features

• Arrow connectors in screenshot labels: Visual labels now show arrow lines from label to element center, making it clearer which element each label references

Patch Changes

• Bigger label font: Increased label font size from 11px to 12px for better readability
• Fixed screenshot dimensions: Screenshots now use actual viewport size (innerWidth/innerHeight) with scale: 'css' to match visual appearance

[email protected]

Features

• screenshotWithAccessibilityLabels: New utility function that takes a screenshot with Vimium-style visual labels overlaid on interactive elements
  • Labels show aria-ref IDs that can be used with page.locator('aria-ref=e5')
  • Image and accessibility snapshot are automatically included in the response
  • Can be called multiple times to capture multiple screenshots
  • Labels are color-coded by element type
• Media elements in aria labels: Added img, video, audio to INTERACTIVE_ROLES
  • Light blue color scheme for media element labels
  • Agents can now reference images by aria-ref for visual tasks

Patch Changes

• Extension fix: Query playwriter tab group by title instead of caching ID, fixing stale group issues after debugger detach/reattach

[email protected]

Patch Changes

• Fix icon not updating on WS disconnect: maintainLoop now ensures tabs transition to 'connecting' state when WebSocket is not connected, fixing edge cases where handleClose wasn't called
• Increased aria-labels auto-hide timeout: Labels now auto-hide after 30 seconds instead of 5 seconds

[email protected]

Patch Changes

• Internal connection handling improvements