Discover adbar/microblog-explorer Open Source project

Stars
1
Language
Python
Created over 12 years ago
Updated over 11 years ago

adbar

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Perform crawls of social networks (identi.ca, reddit, friendfeed) to gather internal and external links and identify their language

trafilatura

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

Python

3,298

German-NLP

Curated list of open-access/open-source/off-the-shelf resources and tools developed with a particular focus on German

449

simplemma

Simple multilingual lemmatizer for Python, especially useful for speed and efficiency

Python

136

htmldate

Fast and robust date extraction from web pages, with Python or on the command-line

Python

117

courlan

Clean, filter and sample URLs to optimize data collection – Python & command-line – Deduplication, spam, content and language filters

Python

109

geokelone

integrates spatial and textual data processing tools into a modular software package which features preprocessing, geocoding, disambiguation and visualization

Python

german-reddit

Extraction of a German Reddit Corpus

Python

tweets-tools

Diverse tools used with Twitter data

Python

flux-toolchain

Filtering and Language-identification for URL Crawling Seeds (FLUCS) a.k.a. FLUX-Toolchain

Perl

jlcl-style

Experiments to modernize the LaTeX class of the JLCL

TeX

trafilatura_gui

Python

toponyms

Old prototype for toponym extraction in historical texts written in German

url-compressor

A fast pattern-based URL compression for lists of links

Pascal

zeitcrawler

Automatically exported from code.google.com/p/zeitcrawler

Java

vardial-experiments

Experiments conducted on the occasion of the VarDial shared tasks

Python

coronakorpus

Material zum Aufbau eines deutschsprachigen COVID-19-Webkorpus / Building a corpus in German dedicated to coronavirus

adbar/microblog-explorer

adbar

Reviews

Repository Details

More Repositories