telegraf/README.md

246 lines
7.1 KiB
Markdown
Raw Normal View History

2015-08-04 21:04:34 +00:00
# Telegraf - A native agent for InfluxDB [![Circle CI](https://circleci.com/gh/influxdb/telegraf.svg?style=svg)](https://circleci.com/gh/influxdb/telegraf)
2015-05-20 05:26:13 +00:00
Telegraf is an agent written in Go for collecting metrics from the system it's
running on, or from other services, and writing them into InfluxDB.
2015-06-19 16:34:27 +00:00
Design goals are to have a minimal memory footprint with a plugin system so
that developers in the community can easily add support for collecting metrics
from well known services (like Hadoop, Postgres, or Redis) and third party
APIs (like Mailchimp, AWS CloudWatch, or Google Analytics).
2015-06-19 16:34:27 +00:00
We'll eagerly accept pull requests for new plugins and will manage the set of
plugins that Telegraf supports. See the
[contributing guide](CONTRIBUTING.md) for instructions on
writing new plugins.
2015-06-19 16:34:27 +00:00
## Installation:
2015-05-20 05:26:13 +00:00
### Linux deb and rpm packages:
2015-08-20 21:18:45 +00:00
Latest:
2015-12-01 02:08:49 +00:00
* http://get.influxdb.org/telegraf/telegraf_0.2.3_amd64.deb
* http://get.influxdb.org/telegraf/telegraf-0.2.3-1.x86_64.rpm
##### Package instructions:
* Telegraf binary is installed in `/opt/telegraf/telegraf`
* Telegraf daemon configuration file is in `/etc/opt/telegraf/telegraf.conf`
* On sysv systems, the telegraf daemon can be controlled via
`service telegraf [action]`
* On systemd systems (such as Ubuntu 15+), the telegraf daemon can be
controlled via `systemctl [action] telegraf`
### Linux binaries:
Latest:
2015-12-01 02:08:49 +00:00
* http://get.influxdb.org/telegraf/telegraf_linux_amd64_0.2.3.tar.gz
* http://get.influxdb.org/telegraf/telegraf_linux_386_0.2.3.tar.gz
* http://get.influxdb.org/telegraf/telegraf_linux_arm_0.2.3.tar.gz
##### Binary instructions:
These are standalone binaries that can be unpacked and executed on any linux
system. They can be unpacked and renamed in a location such as
`/usr/local/bin` for convenience. A config file will need to be generated,
see "How to use it" below.
2015-06-19 16:34:27 +00:00
2015-06-20 01:53:35 +00:00
### OSX via Homebrew:
```
brew update
brew install telegraf
```
### From Source:
Telegraf manages dependencies via `godep`, which gets installed via the Makefile
if you don't have it already. You also must build with golang version 1.4+.
1. [Install Go](https://golang.org/doc/install)
2. [Setup your GOPATH](https://golang.org/doc/code.html#GOPATH)
3. Run `go get github.com/influxdb/telegraf`
4. Run `cd $GOPATH/src/github.com/influxdb/telegraf`
5. Run `make`
2015-06-20 01:53:35 +00:00
### How to use it:
* Run `telegraf -sample-config > telegraf.conf` to create an initial configuration.
* Or run `telegraf -sample-config -filter cpu:mem -outputfilter influxdb > telegraf.conf`.
to create a config file with only CPU and memory plugins defined, and InfluxDB
output defined.
* Edit the configuration to match your needs.
* Run `telegraf -config telegraf.conf -test` to output one full measurement
sample to STDOUT. NOTE: you may want to run as the telegraf user if you are using
the linux packages `sudo -u telegraf telegraf -config telegraf.conf -test`
* Run `telegraf -config telegraf.conf` to gather and send metrics to configured outputs.
* Run `telegraf -config telegraf.conf -filter system:swap`.
to run telegraf with only the system & swap plugins defined in the config.
## Telegraf Options
2015-05-20 05:26:13 +00:00
Telegraf has a few options you can configure under the `agent` section of the
config.
2015-05-20 05:26:13 +00:00
* **hostname**: The hostname is passed as a tag. By default this will be
2015-10-15 22:17:34 +00:00
the value returned by `hostname` on the machine running Telegraf.
You can override that value here.
2015-10-15 22:17:34 +00:00
* **interval**: How often to gather metrics. Uses a simple number +
unit parser, e.g. "10s" for 10 seconds or "5m" for 5 minutes.
* **debug**: Set to true to gather and send metrics to STDOUT as well as
InfluxDB.
2015-05-20 05:26:13 +00:00
## Plugin Options
There are 5 configuration options that are configurable per plugin:
2015-05-20 05:26:13 +00:00
* **pass**: An array of strings that is used to filter metrics generated by the
2015-08-10 19:42:59 +00:00
current plugin. Each string in the array is tested as a prefix against metric names
and if it matches, the metric is emitted.
2015-08-10 19:42:59 +00:00
* **drop**: The inverse of pass, if a metric name matches, it is not emitted.
* **tagpass**: (added in 0.1.5) tag names and arrays of strings that are used to filter metrics by
2015-08-10 19:42:59 +00:00
the current plugin. Each string in the array is tested as an exact match against
the tag name, and if it matches the metric is emitted.
* **tagdrop**: (added in 0.1.5) The inverse of tagpass. If a tag matches, the metric is not emitted.
2015-08-10 19:42:59 +00:00
This is tested on metrics that have passed the tagpass test.
* **interval**: How often to gather this metric. Normal plugins use a single
global interval, but if one particular plugin should be run less or more often,
you can configure that here.
2015-06-19 16:38:31 +00:00
### Plugin Configuration Examples
2015-08-10 19:42:59 +00:00
This is a full working config that will output CPU data to an InfluxDB instance
2015-08-14 15:54:40 +00:00
at 192.168.59.103:8086, tagging measurements with dc="denver-1". It will output
measurements at a 10s interval and will collect per-cpu data, dropping any
measurements which begin with `cpu_time`.
2015-08-14 15:54:40 +00:00
2015-08-10 19:42:59 +00:00
```
[tags]
dc = "denver-1"
[agent]
interval = "10s"
# OUTPUTS
[outputs]
[[outputs.influxdb]]
url = "http://192.168.59.103:8086" # required.
database = "telegraf" # required.
precision = "s"
# PLUGINS
[plugins]
[[plugins.cpu]]
percpu = true
totalcpu = false
drop = ["cpu_time"]
```
2015-08-10 19:42:59 +00:00
Below is how to configure `tagpass` and `tagdrop` parameters (added in 0.1.5)
```
[plugins]
[[plugins.cpu]]
percpu = true
totalcpu = false
drop = ["cpu_time"]
# Don't collect CPU data for cpu6 & cpu7
[plugins.cpu.tagdrop]
cpu = [ "cpu6", "cpu7" ]
[[plugins.disk]]
[plugins.disk.tagpass]
# tagpass conditions are OR, not AND.
# If the (filesystem is ext4 or xfs) OR (the path is /opt or /home)
# then the metric passes
fstype = [ "ext4", "xfs" ]
path = [ "/opt", "/home" ]
2015-08-10 19:42:59 +00:00
```
Additional plugins (or outputs) of the same type can be specified,
just define another instance in the config file:
```
[[plugins.cpu]]
percpu = false
totalcpu = true
```
## Supported Plugins
**You can view usage instructions for each plugin by running**
`telegraf -usage <pluginname>`.
Telegraf currently has support for collecting metrics from:
* aerospike
2015-09-04 23:05:50 +00:00
* apache
2015-10-19 17:38:16 +00:00
* bcache
* disque
* elasticsearch
* exec (generic JSON-emitting executable plugin)
* haproxy
* httpjson (generic JSON-emitting http service plugin)
2015-11-03 21:00:23 +00:00
* jolokia (remote JMX with JSON over HTTP)
* leofs
* lustre2
* memcached
* mongodb
* mysql
* nginx
2015-10-16 12:13:09 +00:00
* phpfpm
2015-09-04 23:05:50 +00:00
* ping
* postgresql
* procstat
* prometheus
* puppetagent
* rabbitmq
* redis
* rethinkdb
* twemproxy
* zfs
2015-10-14 23:53:47 +00:00
* zookeeper
2015-09-04 23:05:50 +00:00
* system
* cpu
* mem
* io
* net
2015-10-14 23:53:47 +00:00
* netstat
2015-09-04 23:05:50 +00:00
* disk
* swap
## Supported Service Plugins
Telegraf can collect metrics via the following services:
* statsd
* kafka_consumer
We'll be adding support for many more over the coming months. Read on if you
want to add support for another service or third-party API.
## Output options
2015-06-19 16:38:31 +00:00
Telegraf also supports specifying multiple output sinks to send data to,
configuring each output sink is different, but examples can be
found by running `telegraf -sample-config`.
2015-06-19 16:38:31 +00:00
## Supported Outputs
2015-06-19 16:38:31 +00:00
* influxdb
* nsq
* kafka
* datadog
2015-09-10 18:42:53 +00:00
* opentsdb
* amqp (rabbitmq)
* mqtt
* librato
* prometheus
2015-11-06 09:27:17 +00:00
* amon
2015-10-22 21:50:19 +00:00
* riemann
2015-06-19 16:38:31 +00:00
## Contributing
2015-06-19 16:38:31 +00:00
Please see the
[contributing guide](CONTRIBUTING.md)
for details on contributing a plugin or output to Telegraf.