Explore @Gerapy Open Source projects

@Gerapy

Gerapy

Stars
3,562
Global Org. Rank 6,059 (Top 2 %)
Registered about 7 years ago
Most used languages

Python
91.7 %

HTML
8.3 %

Gerapy

Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js

GerapyAutoExtractor

Auto Extractor Module

GerapyPyppeteer

Downloader Middleware to support Pyppeteer in Scrapy & Gerapy

GerapyPlaywright

Downloader Middleware to support Playwright in Scrapy & Gerapy

GerapySelenium

Downloader Middleware to support Selenium in Scrapy & Gerapy

GerapyProxy

A package for supporting proxy in Scrapy & Gerapy

GerapyRabbitMQ

Distribution Support for Scrapy & Gerapy using RabbitMQ

GerapyRedis

Distribution Support for Scrapy & Gerapy using Redis

GerapyPrometheusExporter

Gerapy Prometheus Exporter

Docs

Document of Gerapy

Acinonyx

A package which can simplify your multiprocessing implementation

GerapyItemPipeline

Item Pipeline Components for Gerapy & Scrapy