Skip to content

tyler-james-bridges/qai-cli

Repository files navigation

qai

AI-powered QA engineer for your terminal. Scan websites, review PRs, generate tests.

npm version License: MIT Lint

Install

npm install -g qai-cli

Commands

qai scan — Visual QA Analysis

Capture screenshots, detect console/network errors, and get AI-powered bug reports.

# Scan a URL
qai scan https://mysite.com

# Multiple viewports
VIEWPORTS=desktop,mobile,tablet qai scan https://mysite.com

# Focus on accessibility
FOCUS=accessibility qai scan https://mysite.com

qai review — PR Code Review

Deep code review with full codebase context. Not just the diff — traces through dependencies, callers, and related tests.

# Review a PR
qai review 42

# Review current branch against main
qai review --base main

qai generate — Test Generation

Auto-generate Playwright E2E tests from URLs or unit tests from source files.

# Generate E2E tests by crawling a site
qai generate https://mysite.com

# Generate unit tests from source
qai generate src/billing.ts

Playwright Integration

Use qai inside your existing Playwright test suite:

import { test, expect } from '@playwright/test';
import { analyzeWithAI, attachScreenshots } from 'qai-cli';

test('homepage has no critical issues', async ({ page }, testInfo) => {
  await page.goto('/');

  const report = await analyzeWithAI(page, {
    viewports: ['desktop', 'mobile'],
    focus: 'all',
  });

  await attachScreenshots(testInfo, report);
  expect(report.criticalBugs).toHaveLength(0);
});

GitHub Action

- name: QAI Scan
  uses: tyler-james-bridges/qai-cli@main
  with:
    url: ${{ env.PREVIEW_URL }}
    viewports: desktop,mobile
  env:
    ANTHROPIC_API_KEY: ${{ secrets.ANTHROPIC_API_KEY }}

AI Providers

Works with any major LLM. Set one env var:

Provider Env Var Default Model
Anthropic ANTHROPIC_API_KEY claude-sonnet-4
OpenAI OPENAI_API_KEY gpt-4o
Google GEMINI_API_KEY gemini-pro
Ollama OLLAMA_HOST llama3

Features

  • Multi-viewport — Desktop, tablet, mobile screenshots
  • Console errors — JavaScript errors and warnings
  • Network errors — Failed APIs, slow requests, 4xx/5xx
  • Visual regression — Pixel-level comparison with baselines
  • Structured reports — JSON + Markdown output
  • CI/CD ready — GitHub Action + exit codes for pipelines

How It Compares

Feature qai Paragon CodeRabbit Cursor BugBot
Open source
Visual QA scanning
PR code review
Test generation
Multi-provider (Claude, GPT-4, Gemini, Ollama)
Local/offline mode (Ollama)
CLI + library + GitHub Action SaaS only GitHub only GitHub only
Free ✅ (bring your own key) Paid Freemium Freemium

License

MIT

About

No description, website, or topics provided.

Resources

Stars

1 star

Watchers

0 watching

Forks

Releases

No releases published

Packages

 
 
 

Contributors