dom

telegraf

History

Cameron Sparr 733ba07312 Changing AddValues to AddFields and temp disabling adding w time Currently adding with time is broken, because InfluxDB does not support using precision for timestamp truncation both with and without timestamps. This will be re-enabled once we fix InfluxDB to use the precision argument for truncation in all cases, and a "unit" argument in the line-protocol for adding points with non-nanosecond stamps Fixes #175		2015-09-16 16:59:48 -07:00
..
README.md	Adds README for Kafka consumer plugin	2015-07-08 15:45:02 -04:00
kafka_consumer.go	Changing AddValues to AddFields and temp disabling adding w time	2015-09-16 16:59:48 -07:00
kafka_consumer_integration_test.go	Adding Kafka docker container and utilizing it in unit tests	2015-08-04 16:30:05 -06:00
kafka_consumer_test.go	Fix for issue #93 , just use github path instead of gopkg.in	2015-08-06 11:59:07 -06:00

README.md

Kafka Consumer

The Kafka consumer plugin polls a specified Kafka topic and adds messages to InfluxDB. The plugin assumes messages follow the line protocol. Consumer Group is used to talk to the Kafka cluster so multiple instances of telegraf can read from the same topic in parallel.

Testing

Running integration tests requires running Zookeeper & Kafka. The following commands assume you're on OS X & using boot2docker.

To start Kafka & Zookeeper:

docker run -d -p 2181:2181 -p 9092:9092 --env ADVERTISED_HOST=`boot2docker ip` --env ADVERTISED_PORT=9092 spotify/kafka

To run tests:

ZOOKEEPER_PEERS=$(boot2docker ip):2181 KAFKA_PEERS=$(boot2docker ip):9092 go test