Commit Graph

37 Commits

Author SHA1 Message Date
Ayrdrie 40432353ef Add support for comma in logparser timestamp format (#4311) 2018-06-21 14:19:15 -07:00
Daniel Nelson cdf6bcc72a Add special syslog timestamp parser that uses current year (#4190)
Previously it was impossible to parse syslog timestamps without the date
being reported as year 0, due to the year not being specified
2018-05-23 16:37:14 -07:00
Daniel Nelson 11c11da831 Remove dead link from logparser sample config 2018-05-02 11:49:51 -07:00
Daniel Nelson 54f9e9e133 Document one field per line requirement in logparser 2018-04-30 16:15:51 -07:00
Daniel Nelson e8a3178b4a Allow grok pattern to contain newlines (#4005) 2018-04-10 18:16:21 -07:00
Scott Anderson f692f656fd Add details about why not all logstash patterns are supported (#3971) 2018-04-04 14:42:58 -07:00
Daniel Nelson 222a68d72e Add new line protocol parser and serializer, influxdb output (#3924) 2018-03-27 17:30:51 -07:00
Daniel Nelson bb6d50f011 Add support for decimal timestamps to ts-epoch modifier (#3358) 2017-10-19 16:36:32 -07:00
Daniel Nelson b06e2a0c3d Add polling method to logparser and tail inputs (#3213) 2017-09-11 11:56:04 -07:00
Daniel Nelson 9b99dcac64 Discard logging from tail library (#3128) 2017-08-16 12:06:07 -07:00
Daniel Nelson 064071ba51 Test for nil metric before reading tags in logparser 2017-08-15 11:43:16 -07:00
Daniel Nelson 8da8608fb9 Skip compilcation of logparser and tail on solaris (#3113)
Allows compilation for solaris
2017-08-10 12:36:11 -07:00
Daniel Nelson d9ddf7bfd0 Add path tag to logparser containing path of logfile (#3098) 2017-08-07 16:16:31 -07:00
Daniel Nelson a3307476c7 Fix panic in logparser if file cannot be opened (#3055) 2017-07-25 17:08:03 -07:00
Daniel Nelson 6bbed7aa90 Allow dos line endings in tail and logparser (#2920)
Parsing dos line ending delimited line protocol is still illegal in most
cases.
2017-06-16 13:16:48 -07:00
Sebastian Borza 1b3c2cdedf Add timezone support to logparser timestamps (#2882) 2017-06-05 14:45:11 -07:00
Daniel Nelson 99888bd614 Return an error if no valid patterns. (#2753) 2017-05-02 14:54:38 -07:00
Patrick Hemmer 5ebe43f86f use AddError everywhere (#2372) 2017-04-24 11:13:26 -07:00
Daniel Nelson f005ea4a27 Improve logparser README (#2664) 2017-04-14 13:47:43 -07:00
Daniel Nelson 1876441ed7 Update grok version (#2662) 2017-04-12 17:10:17 -07:00
Daniel Nelson 5b9b04a4fc Use fork of hpcloud/tail (#2595) 2017-03-29 14:25:33 -07:00
Patrick Hemmer c65cfb6a6e remove sleep from tests (#2555) 2017-03-24 12:03:36 -07:00
Cameron Sparr a38ebcbe54 log error message when invalid regex is used
closes #2178
2017-02-28 12:48:14 +00:00
njwhite 360b3a8b9f Make Logparser Plugin Check For New Files (#2141)
* Make Logparser Plugin Check For New Files

Check in the Gather metric to see if any new files matching the glob
have appeared. If so, start tailing them from the beginning.

* changelog update for #2141
2017-02-01 14:11:39 +00:00
Cameron Sparr 48fc28331e Fix & unit test logparser CLF pattern with IPv6
deals partially with #1973

see also https://github.com/vjeantet/grok/issues/17
2016-12-20 15:57:32 +00:00
Cameron Sparr cab1118c31 Check if metric is nil before calling SetAggregate
fixes #2146
2016-12-13 12:27:10 +00:00
Cameron Sparr db7a4b24b6 Implement telegraf's own full metric type
main reasons behind this:
- make adding/removing tags cheap
- make adding/removing fields cheap
- make parsing cheaper
- make parse -> decorate -> write out bytes metric flow much faster

Refactor serializer to use byte buffer
2016-12-01 18:17:02 +00:00
Cameron Sparr d627bdbbdb logparser: allow numbers in ident & auth parameters
fixes #1810
2016-10-10 11:27:35 +01:00
Cameron Sparr c7834209d2 Major Logging Overhaul
in this commit:

- centralize logging output handler.
- set global Info/Debug/Error log levels based on config file or flags.
- remove per-plugin debug arg handling.
- add a I!, D!, or E! to every log message.
- add configuration option to specify where to send logs.

closes #1786
2016-10-03 17:13:03 +01:00
Cameron Sparr 4bc6fdb09e Removing INFLUXDB_HTTP_LOG from logparser usage/docs
this log format is likely soon going to be removed from a future
influxdb release, so we should not be recommending that users base any
of their log parsing infra on this.
2016-08-04 16:42:59 +01:00
Cameron Sparr 2b43b385de Begin implementing generic timestamp logparser capability 2016-08-04 16:08:55 +01:00
Cameron Sparr dabb6f5466 Internally name all patterns for log parsing flexibility
closes #1436

This also fixes the bad behavior of waiting until runtime to return log
parsing pattern compile errors when a pattern was simply unfound.

closes #1418

Also protect against user error when the telegraf user does not have
permission to open the provided file. We will now error and exit in this
case, rather than silently waiting to get permission to open it.
2016-07-18 15:44:58 +01:00
Cameron Sparr 281a4d5500 Change resp_code from field to tag in logparser
closes #1479
2016-07-18 13:33:11 +01:00
Cameron Sparr 5dc4cce157 Fixup adding 'measurement' to logparser grok
closes #1434
2016-07-18 12:28:55 +01:00
Nathaniel Cook 8c7edeb53b allow measurement to be defined for logparser_grok plugin 2016-07-18 12:20:24 +01:00
Jack Zampolin c873937356 Add note about influxdb compatability (#1465) 2016-07-10 12:11:43 +02:00
Cameron Sparr cb3c54a1ae logparser input plugin
closes #102
closes #328
2016-06-21 14:23:01 +01:00