spirospolitis/common-crawl-retriever spirospolitis/common-crawl-retriever

  • Stars
    star
    2
  • Language
    Python
  • Created about 4 years ago
  • Updated about 4 years ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
spirospolitis/common-crawl-retriever
github

spirospolitis

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

An opinionated method for retrieving, filtering and indexing Common Crawl content, based on Spark and ElasticSearch.

More Repositories

1

evtx-convert

Convert Windows Event Log .evtx files to other formats.
Python
3
star
2

twitter-watchdog

A Python configurable application to monitor Twitter for tweets, based on topics. Writes to file (JSON, CSV), Kafka, Hadoop and MonoDB. Not entirely tested :-)
Python
2
star
3

aueb-msc-data-science

My repo of assignments for the AUEB M.Sc. in Data Science (2018-2020)
Jupyter Notebook
2
star