There are no reviews yet. Be the first to send feedback to the community and the maintainers!
scrapy-splash
Scrapy+Splash for JavaScript integrationscrapy-playwright
🎠Playwright integration for Scrapyscrapy-djangoitem
Scrapy extension to write scraped items using Django modelsscrapy-zyte-smartproxy
Zyte Smart Proxy Manager (formerly Crawlera) middleware for Scrapyscrapy-jsonrpc
Scrapy extension to control spiders using JSON-RPCscrapy-deltafetch
Scrapy spider middleware to ignore requests to pages containing items seen in previous crawlsscrapy-magicfields
Scrapy middleware to add extra fields to items, like timestamp, response fields, spider attributes etc.scrapy-jsonschema
Scrapy schema validation pipeline and Item builder using JSON Schemascrapy-monkeylearn
A Scrapy pipeline to categorize items using MonkeyLearnscrapy-zyte-api
Zyte API integration for Scrapyscrapy-headless
scrapy-pagestorage
A scrapy extension to store requests and responses information in storage servicescrapy-querycleaner
Scrapy spider middleware to clean up query parameters in request URLsscrapy-splitvariants
Scrapy spider middleware to split an item into multiple items using a multi-valued keyscrapy-streaming
scrapy-dotpersistence
A scrapy extension to sync `.scrapy` folder to an S3 bucketscrapy-streamitem
Scrapy support for working with streamcorpus Stream Items.scrapy-crawlera-fetch
Scrapy Downloader Middleware for Crawlera Fetch APIscrapy-feedexporter-sftp
scrapy-statsd
scrapy-bigml
Scrapy pipeline for writing items to BigML datasetsscrapy-spider-metadata
scrapy-hcf
Scrapy spider middleware to use Scrapinghub's Hub Crawl Frontier as a backend for URLsscrapy-snowflake-stage-exporter
Snowflake database loading utility with Scrapy integrationscrapy-feedexporter-azure-storage
scrapy-feedexporter-onedrive
Export to OneDrivescrapy-incremental
scrapy-feedexporter-dropbox
Scrapy feed exporter for Dropboxscrapy-feedexporter-google-sheets
Love Open Source and this site? Check out how you can help us