• Stars
    star
    3
  • Rank 3,963,521 (Top 79 %)
  • Language
    Python
  • Created almost 7 years ago
  • Updated almost 7 years ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Configure sites to be crawled via simple django app (proxied with nginx, backed by postgres) and run tasks via celery that will parse websites with selenium/phantomjs. All parts in their own docker containers.