Spidermon
Overview
Spidermon is an extension for Scrapy spiders. The package provides useful tools for data validation, stats monitoring, and notification messages. This way you leave the monitoring task to Spidermon and just check the reports/notifications.
Requirements
- Python Version: 3.8, 3.9, 3.10 or 3.11
Install
The quick way:
pip install spidermon
For more details see the install section in the documentation: https://spidermon.readthedocs.io/en/latest/installation.html
Documentation
Documentation is available online at https://spidermon.readthedocs.io/ and in the docs
directory.