Welcome to Spidermon’s documentation!¶
Spidermon is a framework to build monitors for Scrapy spiders. It offers the following features:
- It can check the output data produced by Scrapy (or other sources) and
verify it against a schema or model that defines the expected structure,
data types and value restrictions. It supports data validation based on two
external libraries:
- jsonschema: https://github.com/Julian/jsonschema
- Schematics: https://github.com/schematics/schematics
- It allows you to define conditions that should trigger an alert based on Scrapy stats.
- It supports notifications via email, Slack and Telegram.
- It can generate custom reports.
Contents¶
- Installation
- Getting started
- Monitoring your jobs
- Item Validation
- Comparing Spider Executions
- Expression Monitors
- Settings
- Configure a Slack bot for Spidermon
- Configure a Telegram bot for Spidermon
- “How-to” guides
- Actions
- Release notes
- 1.12.2 (2020-05-07)
- 1.12.1 (2020-05-07)
- 1.12.0 (2020-01-09)
- 1.11.0 (2019-08-02)
- 1.10.2 (2019-07-01)
- 1.10.1 (2019-07-01)
- 1.10.0 (2019-06-12)
- 1.9.0 (2019-03-11)
- 1.8.0 (2019-01-08)
- 1.7.0 (2018-12-04)
- 1.6.0 (2018-11-09)
- 1.5.0 (2018-09-19)
- 1.4.0 (2018-08-17)
- 1.3.0 (2018-08-02)
- 1.2.0 (2018-04-04)
- 1.1.0 (2018-03-23)
- 1.0.0 (2018-03-08)