Skip to content

Crawler is a C++ & Node.js application that allows you to crawl web pages, save them locally, and extract hyperlinks from the page body. It provides a simple command-line interface where you can enter the starting URL and specify the maximum number of crawls. The crawler follows the hyperlinks recursively, saves the web pages in specified directo

Notifications You must be signed in to change notification settings

ssharmapavitra/webcrawler

About

Crawler is a C++ & Node.js application that allows you to crawl web pages, save them locally, and extract hyperlinks from the page body. It provides a simple command-line interface where you can enter the starting URL and specify the maximum number of crawls. The crawler follows the hyperlinks recursively, saves the web pages in specified directo

Topics

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages