mediacloud/glimpse

This repository has been archived on 30/May/2023
Stars
2
Language
Python
License
Apache License 2.0
Created about 3 years ago
Updated about 2 years ago

mediacloud/glimpse

mediacloud

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Get a glimpse of attention to a topic on social media.

backend

Media Cloud is an open source, open data platform that allows researchers to answer quantitative questions about the content of online media.

sentence-splitter

Text to sentence splitter using heuristic algorithm by Philipp Koehn and Josh Schroeder.

cliff-annotator

A lightweight server to allow HTTP requests to the Stanford Named Entity Recognized and a heavily modified CLAVIN geoparser.

api-client

Public client for consuming content from the Media Cloud Online News Archive & Directory.

web-tools

The shared repository for Media Cloud web apps (Explorer, Source Manager, Topic Mapper)

date_guesser

A library to extract a publication date from a web page, along with a measure of the accuracy.

nyt-news-labeler

Tag news stories based on models trained on the NYT corpus.

api-tutorial-notebooks

A set of jupyter notebooks demonstrating how to use the Media Cloud API.

Jupyter Notebook

feed_seeker

Find rss, atom, xml, and rdf feeds on webpages

metadata-lib

How Media Cloud approaches extracting metadata from online news stories

web-search

Code that drives the public web-based tools for the Media Cloud Online News Archive and Directory.

copy-kvs

Copy a lot of objects between various key-value stores (MongoDB GridFS, PostgreSQL BLOBs, Amazon S3)

rss-fetcher

Intelligently fetch lists of URLs from a large collection of RSS Feeds as part of the Media Cloud Directory.

cliff-api-client

A Python client for the CLIFF geoparsing tool

email-templates

Templates for emails that Media Cloud sends.

wayback-news-client

A client library to access the Wayback Machine news archive search.

word-embeddings-server

Helpful micro-service to return results from word2vec models

docker-compose-just-quieter

Docker Compose CLI utility wrapper which makes `docker-compose` quieter.

postgresql-citus-aws-graviton2

PostgreSQL built for AWS Graviton2

sitemap-tools

simple toolkit of tools for consuming sitemaps

fernandos-csv-randomizer

Fernando's CSV randomizer -- reads a CSV file, picks a specified number of random rows and writes them to a separate file

cliff-homepage

A simple homepage for the CLIFF project

hausastemmer

Hausa language stemmer (Bimba et al., 2015)

clavin-build-geonames-index

Builds and releases CLAVIN GeoNames.org index as a binary

sous-chef

Configurable Data Analytics Pipeline

news-search-api

Internal API server that offers search access to the Media Cloud Online News Archive (in Elasticsearch).

story-indexer

The core pipeline used to ingest online news stories in the Media Cloud archive.