Daniel Nelson
b5299f4cc4
Fix cleanup of csv parser options, use per file parser ( #4712 )
2018-09-18 09:23:45 -07:00
Daniel Nelson
710c101fe0
Undeprecate logparser
...
Until dynamic file tailing can be added to the tail plugin.
2018-09-07 16:13:46 -07:00
Adrián López
e50b0c17ad
Document how to parse telegraf logs ( #4285 )
2018-08-14 14:53:25 -06:00
Daniel Nelson
83c4b81abe
Copy grok documentation from logparser to data format doc ( #4475 )
2018-07-27 18:28:33 -07:00
Daniel Nelson
14d25af4d4
Remove DS_Store files
2018-07-13 23:23:47 -07:00
maxunt
774a9f0492
Add file input plugin and grok parser ( #4332 )
2018-07-13 23:22:59 -07:00
Ayrdrie
9fe90d71f4
Add plugin development framework ( #4324 )
2018-07-02 16:34:40 -07:00
Daniel Nelson
9bd5e10133
Fix syslog timestamp parsing with single digit day of month ( #4334 )
2018-06-29 18:05:46 -07:00
maxunt
a10262c5d6
Add log message when tail is added or removed from a file ( #4322 )
2018-06-29 16:15:33 -07:00
Ayrdrie
61e197d254
Add support for comma in logparser timestamp format ( #4311 )
2018-06-21 14:19:15 -07:00
Daniel Nelson
14d97e5416
Add special syslog timestamp parser that uses current year ( #4190 )
...
Previously it was impossible to parse syslog timestamps without the date
being reported as year 0, due to the year not being specified
2018-05-23 16:37:14 -07:00
Daniel Nelson
239333ad90
Remove dead link from logparser sample config
2018-05-02 11:49:51 -07:00
Daniel Nelson
377547aa4c
Document one field per line requirement in logparser
2018-04-30 16:15:51 -07:00
Daniel Nelson
55cfc383f3
Allow grok pattern to contain newlines ( #4005 )
2018-04-10 18:16:21 -07:00
Scott Anderson
a50acadc44
Add details about why not all logstash patterns are supported ( #3971 )
2018-04-04 14:42:58 -07:00
Daniel Nelson
1c0f63a90d
Add new line protocol parser and serializer, influxdb output ( #3924 )
2018-03-27 17:30:51 -07:00
Daniel Nelson
4deb6238a3
Add support for decimal timestamps to ts-epoch modifier ( #3358 )
2017-10-19 16:36:32 -07:00
Daniel Nelson
32f313a6a6
Add polling method to logparser and tail inputs ( #3213 )
2017-09-11 11:56:04 -07:00
Daniel Nelson
ca394fcfb2
Discard logging from tail library ( #3128 )
2017-08-16 12:06:07 -07:00
Daniel Nelson
9bc13f143e
Test for nil metric before reading tags in logparser
2017-08-15 11:43:16 -07:00
Daniel Nelson
287a44de5e
Skip compilcation of logparser and tail on solaris ( #3113 )
...
Allows compilation for solaris
2017-08-10 12:36:11 -07:00
Daniel Nelson
3e27134872
Add path tag to logparser containing path of logfile ( #3098 )
2017-08-07 16:16:31 -07:00
Daniel Nelson
a26fc52181
Fix panic in logparser if file cannot be opened ( #3055 )
2017-07-25 17:08:03 -07:00
Daniel Nelson
3ecfd32df5
Allow dos line endings in tail and logparser ( #2920 )
...
Parsing dos line ending delimited line protocol is still illegal in most
cases.
2017-06-16 13:16:48 -07:00
Sebastian Borza
035905d65e
Add timezone support to logparser timestamps ( #2882 )
2017-06-05 14:45:11 -07:00
Daniel Nelson
f7f1eaef65
Return an error if no valid patterns. ( #2753 )
2017-05-02 14:54:38 -07:00
Patrick Hemmer
06baf7cf78
use AddError everywhere ( #2372 )
2017-04-24 11:13:26 -07:00
Daniel Nelson
b90a5b48a1
Improve logparser README ( #2664 )
2017-04-14 13:47:43 -07:00
Daniel Nelson
3e0c55bff9
Update grok version ( #2662 )
2017-04-12 17:10:17 -07:00
Daniel Nelson
2d7f612bd7
Use fork of hpcloud/tail ( #2595 )
2017-03-29 14:25:33 -07:00
Patrick Hemmer
1402c158b7
remove sleep from tests ( #2555 )
2017-03-24 12:03:36 -07:00
Cameron Sparr
b9457a1092
log error message when invalid regex is used
...
closes #2178
2017-02-28 12:48:14 +00:00
njwhite
2932db8480
Make Logparser Plugin Check For New Files ( #2141 )
...
* Make Logparser Plugin Check For New Files
Check in the Gather metric to see if any new files matching the glob
have appeared. If so, start tailing them from the beginning.
* changelog update for #2141
2017-02-01 14:11:39 +00:00
Cameron Sparr
a90afd95c6
Fix & unit test logparser CLF pattern with IPv6
...
deals partially with #1973
see also https://github.com/vjeantet/grok/issues/17
2016-12-20 15:57:32 +00:00
Cameron Sparr
12db3b9120
Check if metric is nil before calling SetAggregate
...
fixes #2146
2016-12-13 12:27:10 +00:00
Cameron Sparr
db7a4b24b6
Implement telegraf's own full metric type
...
main reasons behind this:
- make adding/removing tags cheap
- make adding/removing fields cheap
- make parsing cheaper
- make parse -> decorate -> write out bytes metric flow much faster
Refactor serializer to use byte buffer
2016-12-01 18:17:02 +00:00
Cameron Sparr
d627bdbbdb
logparser: allow numbers in ident & auth parameters
...
fixes #1810
2016-10-10 11:27:35 +01:00
Cameron Sparr
c7834209d2
Major Logging Overhaul
...
in this commit:
- centralize logging output handler.
- set global Info/Debug/Error log levels based on config file or flags.
- remove per-plugin debug arg handling.
- add a I!, D!, or E! to every log message.
- add configuration option to specify where to send logs.
closes #1786
2016-10-03 17:13:03 +01:00
Cameron Sparr
4bc6fdb09e
Removing INFLUXDB_HTTP_LOG from logparser usage/docs
...
this log format is likely soon going to be removed from a future
influxdb release, so we should not be recommending that users base any
of their log parsing infra on this.
2016-08-04 16:42:59 +01:00
Cameron Sparr
2b43b385de
Begin implementing generic timestamp logparser capability
2016-08-04 16:08:55 +01:00
Cameron Sparr
dabb6f5466
Internally name all patterns for log parsing flexibility
...
closes #1436
This also fixes the bad behavior of waiting until runtime to return log
parsing pattern compile errors when a pattern was simply unfound.
closes #1418
Also protect against user error when the telegraf user does not have
permission to open the provided file. We will now error and exit in this
case, rather than silently waiting to get permission to open it.
2016-07-18 15:44:58 +01:00
Cameron Sparr
281a4d5500
Change resp_code from field to tag in logparser
...
closes #1479
2016-07-18 13:33:11 +01:00
Cameron Sparr
5dc4cce157
Fixup adding 'measurement' to logparser grok
...
closes #1434
2016-07-18 12:28:55 +01:00
Nathaniel Cook
8c7edeb53b
allow measurement to be defined for logparser_grok plugin
2016-07-18 12:20:24 +01:00
Jack Zampolin
c873937356
Add note about influxdb compatability ( #1465 )
2016-07-10 12:11:43 +02:00
Cameron Sparr
cb3c54a1ae
logparser input plugin
...
closes #102
closes #328
2016-06-21 14:23:01 +01:00