Discover adbar/courlan Open Source project

Stars
70
Rank 435,244 (Top 9 %)
Language
Python
License
Apache License 2.0
Created almost 9 years ago
Updated about 1 month ago

adbar

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Clean, filter and sample URLs to optimize data collection – includes spam, content type and language filters

trafilatura

Python & command-line tool to gather text on the Web: web crawling/scraping, extraction of text, metadata, comments

Python

2,979

German-NLP

Curated list of open-access/open-source/off-the-shelf resources and tools developed with a particular focus on German

409

simplemma

Simple multilingual lemmatizer for Python, especially useful for speed and efficiency

Python

129

htmldate

Fast and robust date extraction from web pages, with Python or on the command-line

Python

111

geokelone

integrates spatial and textual data processing tools into a modular software package which features preprocessing, geocoding, disambiguation and visualization

Python

german-reddit

Extraction of a German Reddit Corpus

Python

tweets-tools

Diverse tools used with Twitter data

Python

flux-toolchain

Filtering and Language-identification for URL Crawling Seeds (FLUCS) a.k.a. FLUX-Toolchain

Perl

jlcl-style

Experiments to modernize the LaTeX class of the JLCL

TeX

trafilatura_gui

Python

toponyms

Old prototype for toponym extraction in historical texts written in German

zeitcrawler

Automatically exported from code.google.com/p/zeitcrawler

Java

url-compressor

A fast pattern-based URL compression for lists of links

Pascal

coronakorpus

Material zum Aufbau eines deutschsprachigen COVID-19-Webkorpus / Building a corpus in German dedicated to coronavirus

vardial-experiments

Experiments conducted on the occasion of the VarDial shared tasks

Python

microblog-explorer

Perform crawls of social networks (identi.ca, reddit, friendfeed) to gather internal and external links and identify their language

Python

adbar/courlan

adbar

Reviews

Repository Details

More Repositories