Skip to content

Conversation

@Clevero
Copy link

@Clevero Clevero commented Oct 19, 2019

URLhaus provides a list of URLs that are serving malware.
https://urlhaus.abuse.ch/

It would be cool if cuckoo could raise a signature when one of those domains is queried.

I hope this belongs to here since there is an external file needed and the path for this file needs to be changed in order to work. But I wanted to share it, so if anything needs to be changed I would be glad to change that.

The file can be downloaded with a cronjob every 5 minutes:

#!/bin/bash

wget https://urlhaus.abuse.ch/downloads/text/ -O /tmp/urlhaus.raw.txt

# remove http:// and https://
cat /tmp/urlhaus.raw.txt | sed -e 's|^[^/]*//||' -e 's|/.*$||' >> /tmp/urlhaus.plain.txt
rm /tmp/urlhaus.raw.txt

# remove dupicate domains
sort -u /tmp/urlhaus.plain.txt > /var/lib/peekaboo/urlhaus.txt
rm /tmp/urlhaus.plain.txt```

URLhaus provides a list of URLs that are serving malware.
https://urlhaus.abuse.ch/

It would be cool if cuckoo could raise a signature when one of those domains is queried. 

I hope this belongs to here since there is an external file needed and the path for this file needs to be changed in order to work. But I wanted to share it, so if anything needs to be changed I would be glad to change that.

The file can be downloaded with a cronjob every 5 minutes:

```bash
#!/bin/bash

wget https://urlhaus.abuse.ch/downloads/text/ -O /tmp/urlhaus.raw.txt

# remove http:// and https://
cat /tmp/urlhaus.raw.txt | sed -e 's|^[^/]*//||' -e 's|/.*$||' >> /tmp/urlhaus.plain.txt
rm /tmp/urlhaus.raw.txt

# remove dupicate domains
sort -u /tmp/urlhaus.plain.txt > /var/lib/peekaboo/urlhaus.txt
rm /tmp/urlhaus.plain.txt```
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant