docs: add OWASP LLM Top 10 mapping tutorial#1940
Open
SchmeatMilk wants to merge 1 commit into
Open
Conversation
New tutorial (docs/source/owasp_top10.rst) showing defenders how to run garak against a target and interpret results against the OWASP LLM Top 10 (LLM01-LLM10). Wired into the 'Using garak' toctree in index.rst. Motivation: bridges garak's probe/detector vocabulary to the industry-standard OWASP taxonomy, so findings can be reported to non-technical stakeholders. Co-authored-by: SEB (AI assistance) Signed-off-by: Malik <malik@seb.security>
Collaborator
There was a problem hiding this comment.
This is not the preferred path to activate OWASP probes. garak supports activating probes based on tags and owasp:llm?? tags exist on probes related to those weaknesses, also the --taxonomy option can be used to have the report html organized based on tags from an existing report.jsonl that can also be used for this use case.
Changes to how probes are selected are expected to land in main soon. Guidance on how to update this PR will be added once the feature branch that already includes #1831 merges to main.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Adds a new tutorial,
docs/source/owasp_top10.rst, showing defenders how to run garak against a target and interpret results against the OWASP LLM Top 10 (LLM01–LLM10). Wired into the "Using garak" toctree inindex.rst.The tutorial maps garak probe families (e.g.
prompt_injection,leakage) to the corresponding OWASP category, so findings can be reported to non-technical stakeholders in industry-standard language. It is framed for defenders / authorized red teams and includes a responsible-disclosure note.Not duplicating an existing PR
Checked open PRs (
gh pr list --repo nvidia/garak --state open); no open PR adds an OWASP Top 10 walkthrough. Related PRs (#1920 retag, #1856 intent stubs) are unrelated to this doc.AI assistance disclosure
This contribution was prepared with AI assistance (SEB). The submitting human (Malik) has reviewed every changed line. Changes are documentation-only (a new
.rst+ one toctree entry); no code or test behaviour is altered.Test commands run
git status/git diff --statconfirm only the two doc files changed..rstcontent reviewed for valid reStructuredText.Co-authored-by: SEB (AI assistance)
Signed-off-by: Malik malik@seb.security