pushshift/google_bigquery

Stars
8
Rank 2,099,232 (Top 42 %)
Language
License
MIT License
Created over 6 years ago
Updated over 6 years ago

pushshift/google_bigquery

pushshift

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

api

telegram

Pushshift Telegram Ingest

tiktok

Module to access TikTok Private API

reddit_sse_stream

A Server Side Event stream to deliver Reddit comments and submissions in near real-time to a client.

zreader

Read compressed NDJSON .zst files easily

rinzler

A high performance indexing and search system for managing big data

Parallel-NDJSON-Reader

Parallel NDJSON Reader for Python

Reddit-Bot-Detector

Script to extract highly probable bots for further analysis

imdb_to_json

Fetch movie data from IMDB and output in JSON format.

tradier

Tradier API Examples

trump_tweets

Code example and data for all available Trump Tweets

token_manager

Code to handle multiple Twitter user access tokens when making requests

ndjson_processor

High Speed multiprocessing ndjson processor

python-zstandard-compression-test

Python script to test the zstandard module

US_Election_Data

Code to grab election data from CNN's election data API

gab_mastodon

Ingest scripts and Elasticsearch Mapping for Gab's new Mastodon Site

Big-Data-Scripts

Miscellaneous Python and Perl Scripts for working with Big Data files that are new-line delimited JSON Objects

tweet-id_components

Go program to extract tweet id components

Docker-Reddit-Sphinxsearch

Docker container for sphinxsearch -- used for adding Reddit comments for search

ps_proxy_manager

Pushshift Proxy Manager

ap_story_fetcher

Associated Press Story Fetcher

officer_dot_com

Example code to start parsing data from the website officer.com

realdonaldtrump

Archive of tweets from the @realdonaldtrump Twitter account

parse_wiki_tables

Simple Example to parse out data from Wikipedia tables using selectolax

scrape_subreddit_categories

binary_search

Example of a binary search implementation using real data (Reddit author info)

meetup

Code for ingesting meetup.com streams (comments, photos, etc.)

extract_json_from_html

This script will make it much easier to extract a JSON object from HTML (e.g. getting Tiktok data)

archiver

Server to handle POST requests with raw data which then archives the data permanently

discord-pushshift-bot

Discord Pushshift Bot

browser_extension_parser

Parser module for Facebook observations returned from the browser extension