2016-01-24 22:38:06 +00:00
|
|
|
# statsd exporter [![Build Status](https://travis-ci.org/prometheus/statsd_exporter.svg)][travis]
|
|
|
|
|
|
|
|
[![CircleCI](https://circleci.com/gh/prometheus/statsd_exporter/tree/master.svg?style=shield)][circleci]
|
|
|
|
[![Docker Repository on Quay](https://quay.io/repository/prometheus/statsd-exporter/status)][quay]
|
|
|
|
[![Docker Pulls](https://img.shields.io/docker/pulls/prom/statsd-exporter.svg)][hub]
|
2013-07-02 16:29:40 +00:00
|
|
|
|
2015-10-10 00:34:28 +00:00
|
|
|
`statsd_exporter` receives StatsD-style metrics and exports them as Prometheus metrics.
|
2013-07-05 21:45:20 +00:00
|
|
|
|
|
|
|
## Overview
|
|
|
|
|
2015-06-18 12:23:23 +00:00
|
|
|
### With StatsD
|
|
|
|
|
2013-07-05 21:51:30 +00:00
|
|
|
To pipe metrics from an existing StatsD environment into Prometheus, configure
|
2015-10-10 00:34:28 +00:00
|
|
|
StatsD's repeater backend to repeat all received packets to a `statsd_exporter`
|
|
|
|
process. This exporter translates StatsD metrics to Prometheus metrics via
|
2013-07-05 21:51:30 +00:00
|
|
|
configured mapping rules.
|
2013-07-05 21:45:20 +00:00
|
|
|
|
2015-10-10 00:34:28 +00:00
|
|
|
+----------+ +-------------------+ +--------------+
|
|
|
|
| StatsD |---(UDP repeater)--->| statsd_exporter |<---(scrape /metrics)---| Prometheus |
|
|
|
|
+----------+ +-------------------+ +--------------+
|
2013-07-05 21:45:20 +00:00
|
|
|
|
2015-06-18 12:23:23 +00:00
|
|
|
### Without StatsD
|
|
|
|
|
2015-10-10 00:34:28 +00:00
|
|
|
Since the StatsD exporter uses the same UDP protocol as StatsD itself, you can
|
|
|
|
also configure your applications to send StatsD metrics directly to the exporter.
|
2015-06-18 12:23:23 +00:00
|
|
|
In that case, you don't need to run a StatsD server anymore.
|
|
|
|
|
|
|
|
We recommend this only as an intermediate solution and recommend switching to
|
|
|
|
[native Prometheus instrumentation](http://prometheus.io/docs/instrumenting/clientlibs/)
|
|
|
|
in the long term.
|
|
|
|
|
2016-04-23 21:50:41 +00:00
|
|
|
### DogStatsD extensions
|
|
|
|
|
|
|
|
The exporter will convert DogStatsD-style tags to prometheus labels. See
|
|
|
|
[Tags](http://docs.datadoghq.com/guides/dogstatsd/#tags) in the DogStatsD
|
|
|
|
documentation for the concept description and
|
|
|
|
[Datagram Format](http://docs.datadoghq.com/guides/dogstatsd/#datagram-format)
|
|
|
|
for specifics. It boils down to appending
|
|
|
|
`|#tag:value,another_tag:another_value` to the normal StatsD format. Tags
|
|
|
|
without values (`#some_tag`) are not supported.
|
|
|
|
|
2013-07-05 21:45:20 +00:00
|
|
|
## Building and Running
|
|
|
|
|
|
|
|
$ go build
|
2015-10-10 00:34:28 +00:00
|
|
|
$ ./statsd_exporter --help
|
|
|
|
Usage of ./statsd_exporter:
|
2015-03-23 12:45:29 +00:00
|
|
|
-statsd.listen-address=":9125": The UDP address on which to receive statsd metric lines.
|
|
|
|
-statsd.mapping-config="": Metric mapping configuration file name.
|
|
|
|
-web.listen-address=":9102": The address on which to expose the web interface and generated Prometheus metrics.
|
|
|
|
-web.telemetry-path="/metrics": Path under which to expose metrics.
|
2013-07-05 21:45:20 +00:00
|
|
|
|
|
|
|
## Tests
|
|
|
|
|
|
|
|
$ go test
|
|
|
|
|
|
|
|
## Metric Mapping and Configuration
|
|
|
|
|
2015-10-10 00:34:28 +00:00
|
|
|
The `statsd_exporter` can be configured to translate specific dot-separated StatsD
|
2013-07-05 21:51:30 +00:00
|
|
|
metrics into labeled Prometheus metrics via a simple mapping language. A
|
|
|
|
mapping definition starts with a line matching the StatsD metric in question,
|
|
|
|
with `*`s acting as wildcards for each dot-separated metric component. The
|
|
|
|
lines following the matching expression must contain one `label="value"` pair
|
|
|
|
each, and at least define the metric name (label name `name`). The Prometheus
|
|
|
|
metric is then constructed from these labels. `$n`-style references in the
|
|
|
|
label value are replaced by the n-th wildcard match in the matching line,
|
|
|
|
starting at 1. Multiple matching definitions are separated by one or more empty
|
|
|
|
lines. The first mapping rule that matches a StatsD metric wins.
|
2013-07-05 21:45:20 +00:00
|
|
|
|
2013-07-05 22:32:52 +00:00
|
|
|
Metrics that don't match any mapping in the configuration file are translated
|
|
|
|
into Prometheus metrics without any labels and with certain characters escaped
|
|
|
|
(`_` -> `__`; `-` -> `__`; `.` -> `_`).
|
|
|
|
|
2016-05-02 18:53:00 +00:00
|
|
|
In general, the different metric types are translated as follows:
|
2013-07-05 22:32:52 +00:00
|
|
|
|
2016-05-02 18:53:00 +00:00
|
|
|
StatsD gauge -> Prometheus gauge
|
2015-06-07 14:11:38 +00:00
|
|
|
|
2016-05-02 18:53:00 +00:00
|
|
|
StatsD counter -> Prometheus counter
|
2015-06-07 14:11:38 +00:00
|
|
|
|
2016-05-02 18:53:00 +00:00
|
|
|
StatsD timer -> Prometheus summary <-- indicates timer quantiles
|
|
|
|
-> Prometheus counter (suffix `_total`) <-- indicates total time spent
|
|
|
|
-> Prometheus counter (suffix `_count`) <-- indicates total number of timer events
|
2013-07-05 22:32:52 +00:00
|
|
|
|
2016-05-02 18:53:00 +00:00
|
|
|
If `-statsd.add-suffix` is set, the exporter appends the metric type (`_gauge`,
|
|
|
|
`_counter`, `_timer`) to the resulting metrics. This is enabled by default for
|
|
|
|
backward compatibility but discouraged to use. Instead, it is better to
|
|
|
|
explicitly define the full metric name in your mapping and run the exporter
|
|
|
|
with `-statsd.add-suffix=false`.
|
|
|
|
|
|
|
|
An example mapping configuration with `-statsd.add-suffix=false`:
|
2013-07-05 21:45:20 +00:00
|
|
|
|
2017-05-23 22:12:17 +00:00
|
|
|
# comments are allowed
|
2013-07-05 21:45:20 +00:00
|
|
|
test.dispatcher.*.*.*
|
2016-05-02 18:53:00 +00:00
|
|
|
name="dispatcher_events_total"
|
2013-07-05 21:45:20 +00:00
|
|
|
processor="$1"
|
|
|
|
action="$2"
|
|
|
|
outcome="$3"
|
|
|
|
job="test_dispatcher"
|
2015-06-07 14:11:38 +00:00
|
|
|
|
2013-07-05 21:45:20 +00:00
|
|
|
*.signup.*.*
|
2016-05-02 18:53:00 +00:00
|
|
|
name="signup_events_total"
|
2013-07-05 21:45:20 +00:00
|
|
|
provider="$2"
|
|
|
|
outcome="$3"
|
2015-04-16 19:50:52 +00:00
|
|
|
job="${1}_server"
|
2015-06-07 14:11:38 +00:00
|
|
|
|
2013-07-05 21:51:30 +00:00
|
|
|
This would transform these example StatsD metrics into Prometheus metrics as
|
|
|
|
follows:
|
2013-07-05 21:45:20 +00:00
|
|
|
|
2016-05-02 18:53:00 +00:00
|
|
|
test.dispatcher.FooProcessor.send.success
|
|
|
|
=> dispatcher_events_total{processor="FooProcessor", action="send", outcome="success", job="test_dispatcher"}
|
2015-06-07 14:11:38 +00:00
|
|
|
|
2016-05-02 18:53:00 +00:00
|
|
|
foo_product.signup.facebook.failure
|
|
|
|
=> signup_events_total{provider="facebook", outcome="failure", job="foo_product_server"}
|
2015-06-07 14:11:38 +00:00
|
|
|
|
2016-05-02 18:53:00 +00:00
|
|
|
test.web-server.foo.bar
|
|
|
|
=> test_web__server_foo_bar{}
|
2015-06-07 14:11:38 +00:00
|
|
|
|
|
|
|
## Using Docker
|
|
|
|
|
2015-10-10 00:34:28 +00:00
|
|
|
You can deploy this exporter using the [prom/statsd-exporter](https://registry.hub.docker.com/u/prom/statsd-exporter/) Docker image.
|
2015-06-07 14:11:38 +00:00
|
|
|
|
|
|
|
For example:
|
|
|
|
|
|
|
|
```bash
|
2015-10-10 00:34:28 +00:00
|
|
|
docker pull prom/statsd-exporter
|
2015-06-07 14:11:38 +00:00
|
|
|
|
2016-02-01 15:54:59 +00:00
|
|
|
docker run -d -p 9102:9102 -p 9125:9125/udp \
|
2015-06-07 14:11:38 +00:00
|
|
|
-v $PWD/statsd_mapping.conf:/tmp/statsd_mapping.conf \
|
2015-10-10 00:34:28 +00:00
|
|
|
prom/statsd-exporter -statsd.mapping-config=/tmp/statsd_mapping.conf
|
2015-06-07 14:11:38 +00:00
|
|
|
```
|
2016-01-24 22:38:06 +00:00
|
|
|
|
|
|
|
|
|
|
|
[travis]: https://travis-ci.org/prometheus/statsd_exporter
|
|
|
|
[circleci]: https://circleci.com/gh/prometheus/statsd_exporter
|
|
|
|
[quay]: https://quay.io/repository/prometheus/statsd-exporter
|
|
|
|
[hub]: https://hub.docker.com/r/prom/statsd-exporter/
|