Skip to content

Bench: raise the tool-only recall floor to 1.0 and the false-positive ceiling to 26 - #2385

Merged
remigiusz-antczak merged 1 commit into
mainfrom
feat/bench-floor-1
Nov 15, 2026
Merged

remigiusz-antczak merged 1 commit into
mainfrom
feat/bench-floor-1

Conversation

@remigiusz-antczak

Copy link
Copy Markdown
Collaborator

The CI real-hub job measured 11/11 recall and 26 false positives on the clean twins after the CWE-22 taint rule stopped firing on send_from_directory's file name. Both values are now frozen so a regression in any seeded class fails CI.

Tests: 2/2 (py_compile; CI real-hub job on the merged rule measured recall 1.0, 26 false positives)

🤖 Generated with Claude Code

… ceiling to 26

The CI real-hub job measured 11/11 recall and 26 false positives on the clean twins after the CWE-22 taint rule stopped firing on send_from_directory's file name. Both values are now frozen so a regression in any seeded class fails CI.

Tests: 2/2 (py_compile; CI real-hub job on the merged rule measured recall 1.0, 26 false positives)

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@remigiusz-antczak
remigiusz-antczak merged commit 3e86a87 into main Nov 15, 2026
13 checks passed
@remigiusz-antczak
remigiusz-antczak deleted the feat/bench-floor-1 branch November 15, 2026 18:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant