Welcome to Spidermon’s documentation!

Spidermon is a framework to build monitors for Scrapy spiders. It offers the following features:

  • It can check the output data produced by Scrapy (or other sources) and verify it against a schema or model that defines the expected structure, data types and value restrictions. It supports data validation based on the jsonschema library (https://github.com/Julian/jsonschema).

  • It allows you to define conditions that should trigger an alert based on Scrapy stats.

  • It supports notifications via email, Slack, Telegram and Discord.

  • It can generate custom reports.

Contents