adbar/german-reddit

Stars
3
Rank 3,866,896 (Top 79 %)
Language
Python
License
MIT License
Created over 8 years ago
Updated over 7 years ago

adbar/german-reddit

adbar

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Extraction of a German Reddit Corpus

trafilatura

Python & command-line tool to gather text on the Web: web crawling/scraping, extraction of text, metadata, comments

German-NLP

Curated list of open-access/open-source/off-the-shelf resources and tools developed with a particular focus on German

simplemma

Simple multilingual lemmatizer for Python, especially useful for speed and efficiency

htmldate

Fast and robust date extraction from web pages, with Python or on the command-line

courlan

Clean, filter and sample URLs to optimize data collection – includes spam, content type and language filters

geokelone

integrates spatial and textual data processing tools into a modular software package which features preprocessing, geocoding, disambiguation and visualization

tweets-tools

Diverse tools used with Twitter data

flux-toolchain

Filtering and Language-identification for URL Crawling Seeds (FLUCS) a.k.a. FLUX-Toolchain

jlcl-style

Experiments to modernize the LaTeX class of the JLCL

trafilatura_gui

toponyms

Old prototype for toponym extraction in historical texts written in German

zeitcrawler

Automatically exported from code.google.com/p/zeitcrawler

url-compressor

A fast pattern-based URL compression for lists of links

coronakorpus

Material zum Aufbau eines deutschsprachigen COVID-19-Webkorpus / Building a corpus in German dedicated to coronavirus

vardial-experiments

Experiments conducted on the occasion of the VarDial shared tasks

microblog-explorer

Perform crawls of social networks (identi.ca, reddit, friendfeed) to gather internal and external links and identify their language