rmax/scrapydo

Stars
46
Rank 613,923 (Top 13 %)
Language
Jupyter Notebook
License
MIT License
Created over 9 years ago
Updated over 7 years ago

rmax/scrapydo

rmax

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Crochet-based blocking API for Scrapy.

scrapy-redis

Redis-based components for Scrapy.

dirbot-mysql

Scrapy project based on dirbot to show how to use Twisted's adbapi to store the scraped data in MySQL.

scrapy-inline-requests

A decorator to write coroutine-like spider callbacks.

django-dummyimage

Dynamic Dummy Image Generator For Django!

scrapy-boilerplate

Small set of utilities to simplify writing Scrapy spiders.

databrewer

The missing datasets manager. Like hombrew but for datasets. CLI-tool for search and discover datasets!

databrewer-recipes

DataBrewer Recipes Repository.

django-on-tornado

Run django on tornado webserver

webfaction-stuff

random stuff to manage your own webfaction hosting

parsel-cli

Parsel Command Line Interface

leveldict

LevelDB dict-like wrappers.

cookiecutter-scrapycloud

A bare minimum Scrapy project template ready for Scrapinghub's Scrapy Cloud service.

Facebook-Hacker-Cup-Results

txrho

misc stuff on top twisted/cyclone

Django-Dash-2010

Repository for Django Dash 2010

awesome-codename

Generate awesome codenames

Random-Code

dask-avro

Avro reader for Dask.

mit-ocw-crawler

MIT's OCW Crawler

anaconda-manylinux-builder

Scripts to build manylinux wheels in Travis CI and upload them in Anaconda.org

persistent-homology-examples

Examples of computing the persistent homology of miscellaneous data sets.

yatiri

programming-challenges

My attempt to improve my algorithm skills. Starting from basic.

dask-kafka

Dask-Kafka reader

dotfiles

My dot files. DEPRECATED. Go -> https://github.com/rmax/dotfiles-ng

dockerfiles

Collection of dockerfiles.

scrapy-slidebot

A collection of Spiders to download slides as PDFs from popular sites like slideshare and speakerdeck.

gyst

A pythonic tool to post gists

haanga-benchs

Haanga's benchmarks port over Tornado Framework

scrapyorg-infinit-crawler

rmax.github.io

code-katas

fastavro-codecs

login_signup

friendly login+signup form

lmbot

cookiecutter-datapackage

rmax

ipynb

Assorted collection of iPython notebooks.

django-ipcountry

dask-elasticsearch

An Elasticsearch reader for Dask

python-benchmarks

Assorted python-based benchmarks

binary-repr

Converts integers to binary representation.

django_inline_example

django dynamic inline example

yammh3

Yet another Murmurhash3 bindings.

my-django-project-template

pmwiki-authelgg

omp-thread-count

A small Python module to get the actual number of threads used by OMP via Cython bindings.

zend-ajax-form-test

rho-blogs-crawler

A Scrapy project to export my legacy blogs

dotfiles-ng

YADM-managed dot files