• This repository has been archived on 26/Aug/2024
  • Stars
    star
    4
  • Rank 3,304,323 (Top 66 %)
  • Language
    Go
  • License
    MIT License
  • Created almost 9 years ago
  • Updated about 8 years ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

An incredibly fast web scraper which indexes content on AWS S3, used in production at Sparrho. Fetched nearly 22,000 sources in less than 20 minutes from the US-East datacenter.