Fetch all the URLs that Google and Wayback Machine knows of the target except:
- for image, css and other static files
- urls with same path but parameter value difference
Usage:
git clone https://github.com/g0ttfrid/archiveweb && cd archiveweb
pip3 install -r requirements.txt
usage: archiveweb.py -t example.com
optional arguments:
-h, --help show this help message and exit
-t TARGET, --target TARGET
insert domain/subdomain
-x EXT, --ext EXT get result w/ specific extensions (-x asp,aspx)