Skip to content

Add Google Content Safety API (industry service for CSAM detection) #23

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
cassidyjames merged 6 commits into from
Mar 25, 2026
Merged

Add Google Content Safety API (industry service for CSAM detection) #23

Changes from all commits
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
955a696
add: Google Content Safety API (industry service for CSAM detection)
sreeprasad Oct 16, 2025
23c3233
Merge branch 'main' into add-google-content-safety-api
cassidyjames Nov 5, 2025
4d5eb6f
Correctly alphabetize Content Safety API
cassidyjames Nov 5, 2025
1265d17
Content Safety API: update link and description
cassidyjames Nov 5, 2025
0dc9ff3
Merge branch 'main' into add-google-content-safety-api
cassidyjames Mar 25, 2026
acf069f
Content Safety API: expand details/rationale
cassidyjames Mar 25, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -35,6 +35,10 @@ Help contribute by opening a pull request to add more resources and tools!

## Classification

* [Content Safety API by Google](https://protectingchildren.google/tools-for-partners/#learn-about-our-tools)
* uses machine learning to detect novel CSAM, nudity, and sexually explicit content in images and videos
* free service, but requires registration
* not open source itself, but can be [used via Coop](https://roostorg.github.io/coop/SIGNALS.html#content-safety-api-by-google), which is open source
* [CoPE by Zentropi](https://huggingface.co/zentropi-ai/cope-a-9b)
* small language model trained for accurate, fast, steerable content classification based on developer-defined content policies
* [Detoxify by Unitary AI](https://github.com/unitaryai/detoxify)
Expand Down