-
Notifications
You must be signed in to change notification settings - Fork 116
QE Analysis Reports - March 28 Hackathon #3772
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. Weβll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Changes from all commits
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -17,4 +17,13 @@ CLAUDE.local.md | |
| .env | ||
| .idea/ | ||
| .agents/ | ||
| .worktrees/ | ||
| .worktrees/ | ||
|
|
||
| # Additional ignores | ||
| .devcontainer/ | ||
| .claude/ | ||
| .agentic-qe/ | ||
| .claude-flow/ | ||
| .mcp.json | ||
| *.db | ||
|
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Overly broad
|
||
| node_modules/ | ||
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1 +1,164 @@ | ||
| See [AGENTS.md](AGENTS.md) | ||
| # For Superplane project instructions See [AGENTS.md](AGENTS.md) | ||
|
|
||
| ## Agentic QE v3 | ||
|
|
||
| This project uses **Agentic QE v3** - a Domain-Driven Quality Engineering platform with 13 bounded contexts, ReasoningBank learning, HNSW vector search, and Agent Teams coordination (ADR-064). | ||
|
|
||
| --- | ||
|
|
||
| ### CRITICAL POLICIES | ||
|
|
||
| #### Integrity Rule (ABSOLUTE) | ||
| - NO shortcuts, fake data, or false claims | ||
| - ALWAYS implement properly, verify before claiming success | ||
| - ALWAYS use real database queries for integration tests | ||
| - ALWAYS run actual tests, not assume they pass | ||
|
|
||
| **We value the quality we deliver to our users.** | ||
|
|
||
| #### Test Execution | ||
| - NEVER run `npm test` without `--run` flag (watch mode risk) | ||
| - Use: `npm test -- --run`, `npm run test:unit`, `npm run test:integration` when available | ||
|
|
||
| #### Data Protection | ||
| - NEVER run `rm -f` on `.agentic-qe/` or `*.db` files without confirmation | ||
| - ALWAYS backup before database operations | ||
|
|
||
| #### Git Operations | ||
| - NEVER auto-commit/push without explicit user request | ||
| - ALWAYS wait for user confirmation before git operations | ||
|
|
||
| --- | ||
|
|
||
| ### Quick Reference | ||
|
|
||
| ```bash | ||
| # Run tests | ||
| npm test -- --run | ||
|
|
||
| # Check quality | ||
| aqe quality assess | ||
|
|
||
| # Generate tests | ||
| aqe test generate <file> | ||
|
|
||
| # Coverage analysis | ||
| aqe coverage <path> | ||
| ``` | ||
|
|
||
| ### Using AQE MCP Tools | ||
|
|
||
| AQE exposes tools via MCP with the `mcp__agentic-qe__` prefix. You MUST call `fleet_init` before any other tool. | ||
|
|
||
| #### 1. Initialize the Fleet (required first step) | ||
|
|
||
| ```typescript | ||
| mcp__agentic-qe__fleet_init({ | ||
| topology: "hierarchical", | ||
| maxAgents: 15, | ||
| memoryBackend: "hybrid" | ||
| }) | ||
| ``` | ||
|
|
||
| #### 2. Generate Tests | ||
|
|
||
| ```typescript | ||
| mcp__agentic-qe__test_generate_enhanced({ | ||
| targetPath: "src/services/auth.ts", | ||
| framework: "vitest", | ||
| strategy: "boundary-value" | ||
| }) | ||
| ``` | ||
|
|
||
| #### 3. Analyze Coverage | ||
|
|
||
| ```typescript | ||
| mcp__agentic-qe__coverage_analyze_sublinear({ | ||
| paths: ["src/"], | ||
| threshold: 80 | ||
| }) | ||
| ``` | ||
|
|
||
| #### 4. Assess Quality | ||
|
|
||
| ```typescript | ||
| mcp__agentic-qe__quality_assess({ | ||
| scope: "full", | ||
| includeMetrics: true | ||
| }) | ||
| ``` | ||
|
|
||
| #### 5. Store and Query Patterns (with learning persistence) | ||
|
|
||
| ```typescript | ||
| // Store a learned pattern | ||
| mcp__agentic-qe__memory_store({ | ||
| key: "patterns/coverage-gap/{timestamp}", | ||
| namespace: "learning", | ||
| value: { | ||
| pattern: "...", | ||
| confidence: 0.95, | ||
| type: "coverage-gap", | ||
| metadata: { /* domain-specific */ } | ||
| }, | ||
| persist: true | ||
| }) | ||
|
|
||
| // Query stored patterns | ||
| mcp__agentic-qe__memory_query({ | ||
| pattern: "patterns/*", | ||
| namespace: "learning", | ||
| limit: 10 | ||
| }) | ||
| ``` | ||
|
|
||
| #### 6. Orchestrate Multi-Agent Tasks | ||
|
|
||
| ```typescript | ||
| mcp__agentic-qe__task_orchestrate({ | ||
| task: "Full quality assessment of auth module", | ||
| domains: ["test-generation", "coverage-analysis", "security-compliance"], | ||
| parallel: true | ||
| }) | ||
| ``` | ||
|
|
||
| ### MCP Tool Reference | ||
|
|
||
| | Tool | Description | | ||
| |------|-------------| | ||
| | `fleet_init` | Initialize QE fleet (MUST call first) | | ||
| | `fleet_status` | Get fleet health and agent status | | ||
| | `agent_spawn` | Spawn specialized QE agent | | ||
| | `test_generate_enhanced` | AI-powered test generation | | ||
| | `test_execute_parallel` | Parallel test execution with retry | | ||
| | `task_orchestrate` | Orchestrate multi-agent QE tasks | | ||
| | `coverage_analyze_sublinear` | O(log n) coverage analysis | | ||
| | `quality_assess` | Quality gate evaluation | | ||
| | `memory_store` | Store patterns with namespace + persist | | ||
| | `memory_query` | Query patterns by namespace/pattern | | ||
| | `security_scan_comprehensive` | SAST/DAST scanning | | ||
|
|
||
| ### Configuration | ||
|
|
||
| - **Enabled Domains**: test-generation, test-execution, coverage-analysis, quality-assessment, defect-intelligence, requirements-validation (+6 more) | ||
| - **Learning**: Enabled (transformer embeddings) | ||
| - **Max Concurrent Agents**: 15 | ||
| - **Background Workers**: pattern-consolidator, routing-accuracy-monitor, coverage-gap-scanner, flaky-test-detector | ||
|
|
||
| ### V3 QE Agents | ||
|
|
||
| QE agents are in `.claude/agents/v3/`. Use with Task tool: | ||
|
|
||
| ```javascript | ||
| Task({ prompt: "Generate tests", subagent_type: "qe-test-architect", run_in_background: true }) | ||
| Task({ prompt: "Find coverage gaps", subagent_type: "qe-coverage-specialist", run_in_background: true }) | ||
| Task({ prompt: "Security audit", subagent_type: "qe-security-scanner", run_in_background: true }) | ||
| ``` | ||
|
|
||
| ### Data Storage | ||
|
|
||
| - **Memory Backend**: `.agentic-qe/memory.db` (SQLite) | ||
| - **Configuration**: `.agentic-qe/config.yaml` | ||
|
|
||
| --- | ||
| *Generated by AQE v3 init - 2026-03-28T08:27:45.923Z* | ||
|
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. CLAUDE.md overwritten with external tooling configurationHigh Severity The project's |
||


There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Broader
.claude/ignore conflicts with existing specific entryLow Severity
The
.claude/entry ignores the entire.claude/directory, which makes the existing.claude/settings.local.jsonentry on line 15 redundant. More importantly, if the project ever needs to track files inside.claude/(e.g., theagents/v3/directory referenced in the newCLAUDE.mdinstructions, or shared configuration), they would be silently ignored. This is a leftover from external tooling setup.