Commit Graph

262 Commits

Author SHA1 Message Date
Daniel Nelson e52f7056ba
Fix parse of unix timestamp with more than ns precision () 2019-05-14 11:29:44 -07:00
javicrespo 761705c299 Add syslog output plugin () 2019-05-08 11:21:51 -07:00
Daniel Nelson 74c9d7ace2
Update logfile documentation 2019-05-03 10:55:11 -07:00
javicrespo bcf7516a23 Add in process log rotation () 2019-05-03 10:25:28 -07:00
Daniel Nelson 7978ebef40
Add --service-display-name option for use with Windows service () 2019-04-30 18:34:19 -07:00
Daniel Nelson d2fbf2414a
Add --section-filter to usage 2019-04-25 20:39:41 -07:00
Greg 6436005553 Add cli support for outputting sections of the config () 2019-04-25 20:34:40 -07:00
Greg 32f0cb16f5 Update naoina/toml library dependency () 2019-04-25 20:19:58 -07:00
Daniel Nelson 2faf37e5c1
Fix docs for metric buffer limit to reflect current behavior () 2019-04-17 15:46:20 -07:00
Pierre Tessier 267a9f182b Add wavefront serializer plugin () 2019-04-05 14:46:12 -07:00
Daniel Nelson 6feb6c1853
Add support for ${} env vars in configuration file () 2019-03-29 16:02:10 -07:00
Daniel Nelson 4e3244c575
Fix aggregator window and shutdown of multiple aggregators () 2019-03-29 15:40:33 -07:00
Daniel Nelson 99a390b8e6
Fix open error handling in file output () 2019-03-22 13:59:30 -07:00
Daniel Nelson eeb0e094c2
Remove test directory with .. prefix 2019-03-18 12:47:47 -07:00
Daniel Nelson 0b5811e193
Fix panic when rejecting empty batch () 2019-03-04 12:36:19 -08:00
Daniel Nelson c57f2d9d48
Ignore tracking for metrics added to aggregator () 2019-03-01 11:21:31 -08:00
Daniel Nelson 598a79bf62
Remove 'inputs.' prefix when logging loaded inputs ()
* Remove 'inputs.' prefix when logging loaded inputs

* Remove prefix from aggregators name
2019-02-26 18:31:43 -08:00
Daniel Nelson 03f40b3588
Remove prefix from aggregators name 2019-02-26 18:22:12 -08:00
Greg 85617887c4 Add option to disable timestamp adjustment in grok parser () 2019-02-26 17:35:57 -08:00
Greg Linton 8d90609198 Remove 'inputs.' prefix when logging loaded inputs 2019-02-26 17:03:13 -07:00
Douglas Drinka 1886676e14 Support configuring a default timezone in JSON parser () 2019-02-25 11:30:33 -08:00
Greg 10ac030502 Unify time parsing in json/csv parsers () 2019-02-05 17:43:35 -08:00
Daniel Nelson 1a81e49d05
Return error loading config on non-200 response 2019-02-05 15:15:58 -08:00
Greg 458d3109c0 Set skip rows and columns in csv parser () 2019-01-23 11:37:24 -08:00
Daniel Nelson b34c5e0d04
Update the buffer_size internal metric after writes () 2019-01-22 13:43:51 -08:00
Daniel Nelson da80276802
Use lifo order in metric buffer () 2019-01-15 11:48:52 -08:00
Daniel Nelson 0fd08dd65a
Add a copy of the input metric when adding to aggregator () 2019-01-08 11:56:44 -08:00
Daniel Nelson 3621bcf5a6
Add basic unittest for templating engine 2019-01-07 14:14:00 -08:00
Daniel Nelson 4fd5fa006b
Allow non-tls config downloading 2019-01-04 10:40:44 -08:00
emily f42d9378ba Add cloud_pubsub input plugin () 2019-01-03 16:20:07 -08:00
Samuel-BF f530ca6e7c Use godirwalk in globpath () 2018-12-18 14:23:25 -08:00
Daniel Nelson 544262a23a
Apply global and plugin level metric modifications before filtering () 2018-12-18 14:20:43 -08:00
Samuel-BF 8906e2796b Add size to filecount input () 2018-12-13 12:25:49 -08:00
Greg 74d8523db6 Aggregate early metrics, rather than ignore () 2018-12-10 16:07:08 -08:00
Daniel Nelson 0a506a93fe
Remove metrics from the buffer on write () 2018-11-29 12:58:48 -08:00
Daniel Nelson 574fa5a6be
Add support for fetching config over https () 2018-11-05 14:19:46 -08:00
Daniel Nelson 6e5c2f8bb6
Remove outputs blocking inputs when output is slow () 2018-11-05 13:34:28 -08:00
Trevor Pounds ee056278f5 Enable gofmt code simplification () 2018-10-19 13:32:54 -07:00
Samuel-BF 589d0587f6 Add ability to specify bytes options as strings with units (KB, MiB, ...) () 2018-10-19 11:17:18 -07:00
Samuel-BF f259229a35 Improve performance of globpath with some patterns () 2018-10-12 14:48:11 -07:00
Kevin Conaway 7bb219222a Add internal function for telegraf version () 2018-10-09 13:45:07 -07:00
Mihai Todor f3da717a88 Add entity-body compression to http output () 2018-10-05 15:06:41 -07:00
Rudy a1f9f63463 Add new config for csv column explicit type conversion () 2018-10-03 18:19:44 -07:00
Daniel Nelson c3bab78ea8 Fix case of timezone/grok_timezone options. () 2018-10-03 13:58:21 -06:00
Daniel Nelson 7553c8fd13
Remove metric recreation when filtering () 2018-09-28 14:48:20 -07:00
Lee Jaeyong 6b7d64f1d6 Add ability to define a custom service name when installing as a Windows service () 2018-09-27 18:41:24 -07:00
Lee Jaeyong a086ea6989 Use time.AfterFunc to avoid need for goroutine in WaitTimeout () 2018-09-26 19:15:38 -07:00
Daniel Nelson fe0b964d3e
Document that proc/agg/outputs are not run as part of --test 2018-09-20 15:00:05 -07:00
Daniel Nelson 1e3e28428d
Clean up csv_trim_space after building parser config 2018-09-20 12:55:58 -07:00
Lee Jaeyong dfe8e3b473 Fix config file types of csv_skip_rows and csv_skip_columns () 2018-09-20 12:43:39 -07:00
Daniel Nelson a75c789e3e
Remove warning not to set flush_interval below interval 2018-09-18 18:13:20 -07:00
Daniel Nelson b5299f4cc4
Fix cleanup of csv parser options, use per file parser () 2018-09-18 09:23:45 -07:00
Daniel Nelson 1aa969aabc
Use separate mutexes for write and aggregation in running_output 2018-09-12 00:23:50 -07:00
Lance O'Connor c80aab0445 Add Splunk Metrics serializer () 2018-09-11 13:01:08 -07:00
Daniel Nelson 23a8498963
Fix locking if output is an AggregatingOutput 2018-09-10 15:14:14 -07:00
Daniel Nelson 1ca17652cd
Fix parsing and documentation for json_string_fields () 2018-09-10 11:55:08 -07:00
Greg 4ef058c120 Document all supported cli arguments () 2018-09-10 11:53:04 -07:00
Gunnar f70d6519e7 Add Azure Monitor output plugin () 2018-09-05 14:50:32 -07:00
maxunt 889745a112 Add csv parser () 2018-08-24 16:40:41 -07:00
maxunt 2729378b7f Add name, time, path and string field options to JSON parser () 2018-08-22 19:26:48 -07:00
estk edb6e1f655 Implement a lock based ring buffer for internal/buffer. () 2018-08-20 13:47:48 -07:00
Daniel Nelson 886d8cc840
Drop message batches in kafka output if too large () 2018-08-17 13:51:21 -07:00
Daniel Nelson feb75d493a
Lock buffer when adding metrics ()
This function is not thread-safe but is currently used by multiple
goroutines in RunningOutput
2018-08-07 11:22:10 -07:00
Shanshi Shi e538433959 Preserve metric type when using filters in output plugins () 2018-08-01 16:39:54 -06:00
Daniel Nelson 93ed28e745 Add support for configuring an AWS endpoint_url () 2018-07-31 16:07:21 -06:00
maxunt 774a9f0492 Add file input plugin and grok parser () 2018-07-13 23:22:59 -07:00
maxunt 9ebf16636d Add parse_multivalue to collectd parser () 2018-07-11 17:29:23 -07:00
maxunt 39206677f8 Add new measurement with results of pgrep lookup to procstat input () 2018-06-19 11:47:13 -07:00
Daniel Nelson acba20af1a
Fix TLS and SSL config option parsing () 2018-06-06 18:29:59 -07:00
Piotr Popieluch dfe7b5eec2 Don't skip metrics during startup in aggregate phase () 2018-06-05 16:30:53 -07:00
Piotr Popieluch e0071f365a Print the enabled aggregator and processor plugins on startup () 2018-05-31 11:56:49 -07:00
Daniel Nelson 0d21296aed
Expose graphite_tag_support option in graphite output data format 2018-05-21 16:39:15 -07:00
Daniel Nelson de355b76d6
Simplify testing with TLS () 2018-05-04 16:33:23 -07:00
Daniel Nelson 7c0754ebe5
Move usage string to internal to fix `go run` 2018-05-04 14:16:21 -07:00
Bob Shannon 0b4f4b089f Add TLS support to socket_writer and socket_listener plugins () 2018-04-17 17:02:04 -07:00
Daniel Nelson c8d2ba2bc8
Remove RateLimiter tests due to race conditions
These tests are fundamentally racy, removing to improve reliability of
test cases.
2018-04-16 18:52:52 -07:00
jvassev 2c19d74829 Prevent loading config twice in K8S ()
When config dir is mounted from configmap, filepath.Walk() finds the same
.conf file twice as 20-acme.conf is a link to ..data/20-acme.conf for example.

This patch skips all folder names starting with '..' which is pretty
uncommon and mainly used by Kubernetes mounts.
2018-04-11 16:51:19 -07:00
Daniel Nelson beeab2c509
Sort field names when running --test 2018-04-04 16:30:22 -07:00
Daniel Nelson b99cd14129
Add influx uint support as a runtime option () 2018-03-29 13:31:43 -07:00
Daniel Nelson 1c0f63a90d
Add new line protocol parser and serializer, influxdb output () 2018-03-27 17:30:51 -07:00
Daniel Nelson 8147d60973
Fix metric buffer limit in internal plugin after reload 2018-02-19 20:55:28 -08:00
Paul Myjavec 12d62e60b3 Use CircleCI 2.0 for builds () 2018-02-01 15:05:39 -08:00
Piotr Popieluch 601dc99606 Align aggregator period with internal ticker to avoid skipping metrics ()
By the time the aggregator.run() was called about 600ms already passed since setting now which was skewing up the aggregation intervals and skipping metrics.
2018-01-18 17:37:53 -08:00
atzoum 317de40ac4 Add support for dropwizard input format () 2018-01-08 15:11:36 -08:00
Daniel Nelson b0c2bb870e
Escape environment variables during config toml parsing () 2018-01-04 15:28:00 -08:00
Maximilien Richer 5f215c22fe Fix typos in comments () 2017-10-31 17:00:06 -07:00
Daniel Nelson d0b690f040 Fix short tests on darwin () 2017-09-08 13:03:37 -07:00
Daniel Nelson 28d16188b3 Fix panic when handling string fields with escapes () 2017-08-30 21:16:37 -07:00
Daniel Nelson 573bd4aa32 Start first aggregator period at startup time ()
Fixes issue where metrics collected immediately after startup would not
be aggregated.
2017-07-24 18:25:05 -07:00
Daniel Nelson 31ce98fa91 Don't match pattern on any error ()
This prevents a pattern with no wildcards from matching in case
permissions is denied.
2017-07-21 14:28:14 -07:00
DanKans d903a9142d Fix filtering when both pass and drop match an item ()
Adjust logic in functions responsible for passing metrics in order to be able
to process them correctly in case where pass and drop are defined together.
2017-07-21 10:53:57 -07:00
DanKans 34c042c7dc Fix combined tagdrop/tagpass filtering () 2017-07-19 13:08:40 -07:00
Daniel Nelson b165ce4cd5 Prevent possible deadlock when using aggregators ()
Looping the metrics back through the same channel could result in a
deadlock, by using a new channel and locking the processor we can ensure
that all stages can make continual progress.
2017-07-13 15:34:21 -07:00
Daniel Nelson 5d2c093105 Prevent Write from being called concurrently () 2017-07-12 12:03:23 -07:00
Daniel Nelson 1388e2cf92 Do not allow metrics with trailing slashes ()
It is not possible to encode a measurement, tag, or field whose last
character is a backslash due to it being an unescapable character.
Because the tight coupling between line protocol and the internal metric
model, prevent metrics like this from being created.

Measurements with a trailing slash are not allowed and the point will be
dropped.  Tags and fields with a trailing a slash will be dropped from
the point.
2017-07-11 15:54:38 -07:00
Seuf 2092443cd7 Add Kafka 0.9+ consumer support () 2017-06-07 18:22:28 -07:00
Daniel Nelson 052e88ad5e
Fix grammar 2017-04-27 14:59:18 -07:00
Patrick Hemmer 06baf7cf78 use AddError everywhere () 2017-04-24 11:13:26 -07:00
Daniel Nelson 360b10c4de Clarify precision documentation () 2017-04-12 10:42:11 -07:00
Daniel Nelson 2c98e5ae66 Add collectd parser () 2017-04-12 10:41:26 -07:00