There are no reviews yet. Be the first to send feedback to the community and the maintainers!
Repository Details
Implementation of a web crawler in Go. The program searches for links to internal page of a certain domain (e.g. reddit.com) and crawls them recursively in order to obtain a sitemap containing the links between the pages.