• Stars
    star
    344
  • Rank 118,771 (Top 3 %)
  • Language
    Go
  • License
    Apache License 2.0
  • Created almost 8 years ago
  • Updated 2 months ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

A Prometheus exporter for NATS metrics

License Build Coverage

The Prometheus NATS Exporter

The Prometheus NATS Exporter consists of both a package and an application that exports NATS server metrics to Prometheus for monitoring. The exporter aggregates metrics from the server monitoring endpoints you choose (varz, connz, subz, routez, healthz) from a NATS server into a single Prometheus exporter endpoint.

Build

make build

If you want to run tests, you can do this.

make install-tools
make test
make lint

# If you want to see the coverage locally, then run this.
# make test-cover

Run

Start the prometheus-nats-exporter executable, and poll the varz metrics endpoints of the NATS server located on localhost configured with a monitor port of 5555.

prometheus-nats-exporter -varz "http://localhost:5555"

To run with docker, you can use the following image:

docker run natsio/prometheus-nats-exporter:latest

Usage

prometheus-nats-exporter <flags> url
  -D	Enable debug log level.
  -DV
    	Enable debug and trace log levels.
  -V	Enable trace log level.
  -a string
    	Network host to listen on. (default "0.0.0.0")
  -addr string
    	Network host to listen on. (default "0.0.0.0")
  -channelz
    	Get streaming channel metrics.
  -connz
    	Get connection metrics.
  -connz_detailed
    	Get detailed connection metrics for each client. Enables flag "-connz" implicitly.
  -healthz
        Get health metrics.
  -gatewayz
    	Get gateway metrics.
  -leafz
    	Get leaf metrics.
  -http_pass string
    	Set the password for HTTP scrapes. NATS bcrypt supported.
  -http_user string
    	Enable basic auth and set user name for HTTP scrapes.
  -jsz string
    	Select JetStream metrics to filter (e.g streams, accounts, consumers, all)
  -l string
    	Log file name.
  -log string
    	Log file name.
  -p int
    	Port to listen on. (default 7777)
  -path string
    	URL path from which to serve scrapes. (default "/metrics")
  -port int
    	Port to listen on. (default 7777)
  -prefix string
    	Replace the default prefix for all the metrics.
  -r string
    	Remote syslog address to write log statements.
  -remote_syslog string
    	Write log statements to a remote syslog.
  -replicatorVarz
    	Get replicator general metrics.
  -ri int
    	Interval in seconds to retry NATS Server monitor URL. (default 30)
  -routez
    	Get route metrics.
  -s	Write log statements to the syslog.
  -serverz
    	Get streaming server metrics.
  -subz
    	Get subscription metrics.
  -syslog
    	Write log statements to the syslog.
  -tlscacert string
    	Client certificate CA for verification (used with HTTPS).
  -tlscert string
    	Server certificate file (Enables HTTPS).
  -tlskey string
    	Private key for server certificate (used with HTTPS).
  -use_internal_server_id
    	Enables using ServerID from /varz
  -use_internal_server_name
        Enables using ServerName from /varz
  -varz
    	Get general metrics.
  -version
    	Show exporter version and exit.

The URL parameter

The url parameter is a standard url. Both http and https (when TLS is configured) is supported.

e.g. http://denver1.foobar.com:8222

Monitoring

The NATS Prometheus exporter exposes metrics through an HTTP interface, and will default to: http://0.0.0.0:7777/metrics.

When --http_user and --http_pass is used, you will need to set the username password in prometheus. See basic_auth in the prometheus configuration documentation. If using a bcrypted password use a very low cost as scrapes occur frequently.

It will return output that is readable by Prometheus.

The returned data looks like this:

# HELP gnatsd_varz_in_bytes in_bytes
# TYPE gnatsd_varz_in_bytes gauge
gnatsd_varz_in_bytes{server_id="http://localhost:8222"} 0
# HELP gnatsd_varz_in_msgs in_msgs
# TYPE gnatsd_varz_in_msgs gauge
gnatsd_varz_in_msgs{server_id="http://localhost:8222"} 0
# HELP gnatsd_varz_max_connections max_connections
# TYPE gnatsd_varz_max_connections gauge
gnatsd_varz_max_connections{server_id="http://localhost:8222"} 65536

The NATS Prometheus Exporter API

The NATS prometheus exporter also provides a simple and easy to use API that allows it to run embedded in your code.

Import the exporter package

    // import the API like this
    import (
      "github.com/nats-io/prometheus-nats-exporter/exporter"
    )

API Usage

In just a few lines of code, configure and launch an instance of the exporter.

	// Get the default options, and set what you need to.  The listen address and port
	// is how prometheus can poll for collected data.
	opts := exporter.GetDefaultExporterOptions()
	opts.ListenAddress = "localhost"
	opts.ListenPort = 8888
	opts.GetVarz = true
	opts.NATSServerURL = "http://localhost:8222"

	// create an exporter instance, ready to be launched.
	exp := exporter.NewExporter(opts)

	// start collecting data
	exp.Start()

	// when done, simply call Stop()
	exp.Stop()

	// For convenience, you can block until the exporter is stopped
	exp.WaitUntilDone()

Monitoring Walkthrough

For additional information, refer to the walkthrough of monitoring NATS with Prometheus and Grafana. The NATS Prometheus Exporter can be used to monitor NATS Streaming as well. Refer to the walkthrough/streaming documentation.

More Repositories

1

nats-server

High-Performance server for NATS.io, the cloud and edge native messaging system.
Go
14,523
star
2

nats.go

Golang client for NATS, the cloud native messaging system.
Go
5,149
star
3

nats-streaming-server

NATS Streaming System Server
Go
2,495
star
4

nats.js

Node.js client for NATS, the cloud native messaging system.
JavaScript
1,477
star
5

nats.rs

Rust client for NATS, the cloud native messaging system.
Rust
933
star
6

nats.rb

Ruby client for NATS, the cloud native messaging system.
Ruby
880
star
7

nats.py

Python3 client for NATS
Python
797
star
8

stan.go

NATS Streaming System
Go
705
star
9

nats.net

The official C# Client for NATS
C#
639
star
10

nats-operator

NATS Operator
Go
571
star
11

nats.java

Java client for NATS
Java
541
star
12

jetstream

JetStream Utilities
Dockerfile
452
star
13

k8s

NATS on Kubernetes with Helm Charts
Go
416
star
14

natscli

The NATS Command Line Interface
Go
414
star
15

nats.c

A C client for NATS
C
367
star
16

nuid

NATS Unique Identifiers
Go
357
star
17

nats-top

A top-like tool for monitoring NATS servers.
Go
331
star
18

stan.js

Node.js client for NATS Streaming
JavaScript
293
star
19

nats.ws

WebSocket NATS
JavaScript
290
star
20

nats-surveyor

NATS Monitoring, Simplified.
Go
204
star
21

nats.ex

Elixir client for NATS, the cloud native messaging system. https://nats.io
Elixir
189
star
22

nats.ts

TypeScript Node.js client for NATS, the cloud native messaging system
TypeScript
178
star
23

graft

A RAFT Election implementation in Go.
Go
176
star
24

nats-streaming-operator

NATS Streaming Operator
Go
173
star
25

nats.net.v2

Full Async C# / .NET client for NATS
C#
170
star
26

nats-architecture-and-design

Architecture and Design Docs
Go
164
star
27

nats.deno

Deno client for NATS, the cloud native messaging system
TypeScript
149
star
28

nack

NATS Controllers for Kubernetes (NACK)
Go
139
star
29

stan.net

The official NATS .NET C# Streaming Client
C#
137
star
30

jsm.go

JetStream Management Library for Golang
Go
132
star
31

nats-docker

Official Docker image for the NATS server
Dockerfile
123
star
32

nkeys

NATS Keys
Go
120
star
33

nats-pure.rb

Ruby client for NATS, the cloud native messaging system.
Ruby
117
star
34

nats-kafka

NATS to Kafka Bridging
Go
116
star
35

stan.py

Python Asyncio NATS Streaming Client
Python
113
star
36

nats.zig

Zig Client for NATS
109
star
37

go-nats-examples

Single repository for go-nats example code. This includes all documentation examples and any common message pattern examples.
Go
108
star
38

nginx-nats

NGINX client module for NATS, the cloud native messaging system.
C
105
star
39

nats.docs

NATS.io Documentation on Gitbook
HTML
103
star
40

nats-box

A container with NATS utilities
HCL
99
star
41

stan.java

NATS Streaming Java Client
Java
92
star
42

not.go

A reference for distributed tracing with the NATS Go client.
Go
91
star
43

nsc

Tool for creating nkey/jwt based configurations
Go
88
star
44

nats-site

Website content for https://nats.io. For technical issues with NATS products, please log an issue in the proper repository.
Markdown
87
star
45

jparse

Small, Fast, Compliant JSON parser that uses events parsing and index overlay
Java
86
star
46

elixir-nats

Elixir NATS client
Elixir
76
star
47

nats-account-server

A simple HTTP/NATS server to host JWTs for nats-server 2.0 account authentication.
Go
73
star
48

jwt

JWT tokens signed using NKeys for Ed25519 for the NATS ecosystem.
Go
71
star
49

nats.py2

A Tornado based Python 2 client for NATS
Python
62
star
50

nats-general

General NATS Information
61
star
51

spring-nats

A Spring Cloud Stream Binder for NATS
Java
58
star
52

terraform-provider-jetstream

Terraform Provider to manage NATS JetStream
Go
54
star
53

nats.cr

Crystal client for NATS
Crystal
44
star
54

nats-streaming-docker

Official Docker image for the NATS Streaming server
Python
44
star
55

nats-rest-config-proxy

NATS REST Configuration Proxy
Go
33
star
56

nats-connector-framework

A pluggable service to bridge NATS with other technologies
Java
32
star
57

demo-minio-nats

Demo of syncing across clouds with minio
Go
27
star
58

java-nats-examples

Repo for java-nats-examples
Java
26
star
59

asyncio-nats-examples

Repo for Python Asyncio examples
Python
25
star
60

stan.rb

Ruby NATS Streaming Client
Ruby
21
star
61

nats-mq

Simple bridge between NATS streaming and MQ Series
Go
21
star
62

jetstream-leaf-nodes-demo

Go
20
star
63

go-nats

[ARCHIVED] Golang client for NATS, the cloud native messaging system.
Go
20
star
64

nats-on-a-log

Raft log replication using NATS.
Go
20
star
65

nats-replicator

Bridge to replicate NATS Subjects or Channels to NATS Subject or Channels
Go
19
star
66

nkeys.js

NKeys for JavaScript - Node.js, Browsers, and Deno.
TypeScript
18
star
67

latency-tests

Latency and Throughput Test Framework
HCL
14
star
68

nats-jms-bridge

NATS to JMS Bridge for request/reply
Java
12
star
69

nats-connector-redis

A Redis Publish/Subscribe NATS Connector
Java
12
star
70

node-nuid

A Node.js implementation of NUID
JavaScript
10
star
71

nats-java-vertx-client

Java
10
star
72

nats.swift

Swift client for NATS, the cloud native messaging system.
Swift
10
star
73

sublist

History of the original sublist
Go
9
star
74

nkeys.py

NATS Keys for Python
Python
8
star
75

nats-siddhi-demo

A NATS with Siddhi Event Processing Reference Architecture
8
star
76

node-nats-examples

Documentation samples for node-nats
JavaScript
8
star
77

jwt.js

JWT tokens signed using nkeys for Ed25519 for the NATS JavaScript ecosystem
TypeScript
7
star
78

jetstream-gh-action

Collection of JetStream related Actions for GitHub Actions
Go
7
star
79

kubecon2020

Go
7
star
80

nats-spark-connector

Scala
7
star
81

java-nats-server-runner

Run the Nats Server From your Java code.
Java
6
star
82

kotlin-nats-examples

Repo for Kotlin Nats examples.
Kotlin
6
star
83

js-nuid

TypeScript
6
star
84

ts-nats-examples

typescript nats examples
TypeScript
5
star
85

go-nats-streaming

[ARCHIVED] NATS Streaming System
Go
5
star
86

integration-tests

Repository for integration test suites of any language
Java
5
star
87

homebrew-nats-tools

Repository hosting homebrew taps for nats-io tools
Ruby
5
star
88

ts-nkeys

A public-key signature system based on Ed25519 for the NATS ecosystem in typescript for ts-nats and node-nats
TypeScript
4
star
89

nats-steampipe-plugin

Example steampipe plugin for NATS
Go
4
star
90

nkeys.rb

NATS Keys for Ruby
Ruby
4
star
91

advisories

Advisories related to the NATS project
HTML
3
star
92

kinesis-bridge

Bridge Amazon Kinesis to NATS streams.
Go
3
star
93

not.java

A reference for distributed tracing with the NATS Java client.
Java
2
star
94

deploy

Deployment for NATS
Ruby
2
star
95

nats.c.deps

C
2
star
96

stan2js

NATS Streaming to JetStream data migration tool.
Go
2
star
97

netlify-slack

Trivial redirector website
1
star
98

cliprompts

cli prompt utils
Go
1
star
99

ruby-nats-examples

Repo for Ruby Examples
Ruby
1
star
100

nats-mendix

CSS
1
star