Prometheus Compliance Tests
This repo contains code to test compliance with various Prometheus standards. Anyone taking part in CNCF's Prometheus Conformance Program will need to run the tests in here against their own implementations.
If you are reading this as someone testing their own implementation or considering to do so: There is a LOT of work that's planned but not executed yet. If you have time or headcount to invest in uplifting everyone's compliance, please talk to us.
There are several software categories something can be tested in. If something does not seem to fit existing categories, please also talk to us.
Alert Generator
The alert_generator directory contains a shim at the moment. It will test correct generation and emitting of alerts towards Alertmanager.
OpenMetrics
The openmetrics directory contains a reference to the OpenMetrics test suite.
PromQL
The promql directory contains code to test compliance with the native Prometheus PromQL implementation.
Remote Write Sender
The remote_write_sender directory contains code to test compliance with the Prometheus Remote Write specification as a sender.