dom
/
telegraf
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity
telegraf/plugins/kafka_consumer
History
Cameron Sparr c26ce9c4fe Utilizing new client and overhauling Accumulator interface 
Fixes #280
Fixes #281
Fixes #289
 		2015-10-20 13:53:58 -06:00
..
README.md Adds README for Kafka consumer plugin 2015-07-08 15:45:02 -04:00
kafka_consumer.go Utilizing new client and overhauling Accumulator interface 2015-10-20 13:53:58 -06:00
kafka_consumer_integration_test.go Utilizing new client and overhauling Accumulator interface 2015-10-20 13:53:58 -06:00
kafka_consumer_test.go Use Unix() int64 time for comparing timestamps in kafka consumer 2015-10-16 16:58:52 -06:00

README.md

Kafka Consumer

The Kafka consumer plugin polls a specified Kafka topic and adds messages to InfluxDB. The plugin assumes messages follow the line protocol. Consumer Group is used to talk to the Kafka cluster so multiple instances of telegraf can read from the same topic in parallel.

Testing

Running integration tests requires running Zookeeper & Kafka. The following commands assume you're on OS X & using boot2docker.

To start Kafka & Zookeeper:

docker run -d -p 2181:2181 -p 9092:9092 --env ADVERTISED_HOST=`boot2docker ip` --env ADVERTISED_PORT=9092 spotify/kafka

To run tests:

ZOOKEEPER_PEERS=$(boot2docker ip):2181 KAFKA_PEERS=$(boot2docker ip):9092 go test