Commit graph

3725 commits

Author SHA1 Message Date
Jordan Sissel
837874e53a Allow -f and -e flags together.
The purpose of this is to permit one-offs for production debugging.
Something like:

    % bin/logstash -f production.conf -e 'output { stdout { ... } }'
2014-03-18 15:28:14 -07:00
Aaron Mildenstein
3d67833cff Merge pull request #1015 from pieterlexis/collectd_NaN
NaN value handling in the CollectD input (LOGSTASH-1763)
2014-03-18 15:00:49 -05:00
Jordan Sissel
d4b9694d94 Merge pull request #1170 from Ludovicus/LOGSTASH-1824
LOGSTASH-1824 Fix the TCP input so it passes unit tests and does not drop messages
2014-03-18 12:30:42 -07:00
Jordan Sissel
53bc20d4f0 Merge pull request #1173 from colinsurprenant/utf8fields
Utf8fields
2014-03-18 12:21:00 -07:00
Jordan Sissel
6ead8ef5bd Promote geoip and useragent filters to milestone 3
These filters both have tests and have been around for a while. GOOD JOB
FILTERS!
2014-03-18 11:55:10 -07:00
Jordan Sissel
bbb4f72557 Add teardown to flush elasticsearch on agent shutdown
Prior to this, some events could be lost if logstash was shutdown.
2014-03-17 22:39:47 -07:00
Colin Surprenant
03526d9a6f main message codec support and headers transcoding 2014-03-14 21:34:57 -04:00
Colin Surprenant
5d5d8e2235 proper utf8 support in plugins which assigned non utf8 event field values 2014-03-14 21:33:51 -04:00
Colin Surprenant
6796736def Fieldreference replacement 2014-03-14 14:55:25 -04:00
Luis Ortiz
c99d6b5752 PRQ-144: Fix the TCP input so it passes unit tests and does not drop messages under load. 2014-03-14 16:31:26 +00:00
Jordan Sissel
9971b0a75e Update version 2014-03-12 17:48:26 -07:00
Jordan Sissel
a3748172ed Improve documentation for 'http' protocol selection 2014-03-12 16:58:55 -07:00
Jordan Sissel
75e6abd985 Fix help being printed twice.
The bug was caused by 'agent.parse' failing with Clamp::HelpWanted and
then we would continue onward to try and actually run the agent.

Now we only run the agent if parsing args succeeds.

Fixes LOGSTASH-1952
2014-03-12 16:40:48 -07:00
Colin Surprenant
cdc263e44e explicit return for explicit explicitness 2014-03-12 16:02:21 -07:00
Colin Surprenant
d083dcb264 actually encode to UTF-8 when input charset is non UTF-8 + basic specs 2014-03-12 16:02:21 -07:00
Jordan Sissel
a4f72686c7 Add missing 'require "socket"'
Audited files using 'Socket.gethostname' but didn't require "socket"
using the following command:

    ack -L 'require "socket"' $(ack -l 'Socket.gethostname' lib)

Fixes LOGSTASH-1974
2014-03-12 15:48:44 -07:00
Jordan Sissel
d30a9e5bfc Merge pull request #1158 from darren-fhf/master
Fix bug LOGSTASH-1225 "Cannot Clone Fixnum"
2014-03-12 15:21:24 -07:00
Michael Hart
2435c63770 updates as per code review 2014-03-11 11:42:39 -04:00
Michael Hart
ef816ae23c Fix event::overwrite to copy timestamp properly 2014-03-11 11:16:37 -04:00
Darren Holloway
b783f9ded8 Fix bug LOGSTASH-1225 "Cannot Clone Fixnum"
The clone {} filter will throw an exception if any of the values in the
    event map are numbers. Problem is that numbers are not clonable.

    This is a single-line fix that wraps the .clone call in a try block and
    does a simple set-by-value if the clone raises an exception.

    Included under spec/filters/clone.rb is a test case that fails without
    the change in lib/logstash/event.rb and passes with the fix applied.
2014-03-08 13:54:54 -08:00
Greg Mefford
ffe8166288 json_lines codec documentation is special since it isn't used with the file input.
Also fixed formatting issues with the config examples in the synopsis section.
2014-03-06 00:22:02 -05:00
Kurt Hurtado
b06679c993 Merge pull request #1106 from kurtado/doc/output/graphite
Doc/output/graphite
2014-02-28 12:03:06 -08:00
Kurt Hurtado
1566e3b0e8 Merge pull request #1115 from kurtado/doc/filter/geoip
geoip touchup
2014-02-28 12:01:58 -08:00
Kurt Hurtado
97c80115e8 Merge pull request #1130 from kurtado/doc/input/gelf
gelf input docs
2014-02-28 12:01:36 -08:00
Kurt Hurtado
24ee1cdcb3 Merge pull request #1129 from kurtado/doc/output/gelf
For you Graylog2 fans out there
2014-02-28 12:01:24 -08:00
Kurt Hurtado
f858e1d962 Merge pull request #1131 from kurtado/doc/input/elasticsearch
elasticsearch input
2014-02-28 12:01:12 -08:00
Kurt Hurtado
76cd72f98b Merge pull request #1135 from kurtado/doc/output/nagios
alert: nagios
2014-02-28 12:00:59 -08:00
Aaron Mildenstein
9134b32301 Prepare for version bump 2014-02-28 13:15:57 -06:00
Kurt Hurtado
89c2280075 alert: nagios 2014-02-27 16:28:54 -08:00
Kurt Hurtado
6e80b2d13f elasticsearch input 2014-02-27 13:14:36 -08:00
Kurt Hurtado
482a96eadf escape underscores 2014-02-27 00:19:24 -08:00
Kurt Hurtado
75f3214f65 additional fields, underscores 2014-02-27 00:13:14 -08:00
Kurt Hurtado
e2818ac884 gelfin 2014-02-27 00:03:43 -08:00
Kurt Hurtado
56edca98d9 Repeat after me: Logstash is a proper noun. 2014-02-26 18:04:35 -08:00
Kurt Hurtado
8c8ed3fb87 For you Graylog2 fans out there 2014-02-26 18:01:55 -08:00
Miah Johnson
ec5533d486 clean trailing whitespace. 2014-02-26 10:02:50 -08:00
Richard Pijnenburg
5f698a21c9 rename PUNCT to PUNCTUATION 2014-02-25 21:46:40 +01:00
Richard Pijnenburg
6d1ffc3583 Merging funct filter in fingerprint filter 2014-02-25 21:41:47 +01:00
Jordan Sissel
806fea34b3 Use __FILE__-relative path for the default template.
Users reported this (or similar) error:
Errno::ENOENT: No such file or directory -
lib/logstash/outputs/elasticsearch/elasticsearch-template.json

This is because the file being searched-for was relative to $PWD, not
relative to the elasticsearch output plugin file itself.

Tested works like this:

    % logstash/bin/logstash -e 'output { elasticsearch {  embedded => true } }'

Prior to this patch, the above command line would fail with this error:

    Errno::ENOENT: No such file or directory - lib/logstash/outputs/elasticsearch/elasticsearch-template.json
    ...
        get_template at /home/jls/projects/logstash/lib/logstash/outputs/elasticsearch.rb:285
2014-02-25 12:04:35 -08:00
Richard Pijnenburg
6e9bd0b6eb Merge pull request #933 from awesometown/master
Moved 'success' message into the begin block so it doesn't get printed if there's an error
2014-02-25 09:57:59 +00:00
Richard Pijnenburg
f43bda7f4a Merge pull request #950 from AKoetsier/master
Fixes exception when not specifying yamlmibdir
2014-02-25 09:24:06 +00:00
Richard Pijnenburg
cd2c61271a Merge pull request #1076 from mjr5749/patch-1
Fix syntax errors in kv examples
2014-02-25 09:21:47 +00:00
Kurt Hurtado
679bba0f58 awesome description 2014-02-24 23:23:14 -08:00
Kurt Hurtado
30a469927c geoip touchup 2014-02-24 22:23:11 -08:00
Jordan Sissel
2e5b082be9 Only abort on 'embedded => true' if we are *NOT* JRuby.
As it turns out, programming is this terrible journey where we have
humans using some kind of silly error prone process whereby intent of
function is converted to instructions.

I am bad at programming sometimes.
2014-02-24 15:41:36 -08:00
Lance O'Connor
0ba3cc2eb3 Fix the 2yyp typo, and properly attribute post_string to come *after* the event 2014-02-24 21:18:31 +00:00
Lance O'Connor
fe87534dd9 Modified syntax as per suggestion 2014-02-24 21:09:16 +00:00
Lance O'Connor
b3ccedc34a Close LOGSTASH-1933:
Add two (2) new config stanzas to IRC output:

pre_string: Message you want emitted to IRC server before the event text
post_string: Message you want emitted to the IRC server after the event text

[12:32]  <logstash> This is a pre message
[12:32]  <logstash> This is the actual message
[12:32]  <logstash> Tis is a post message

In both cases, they are sent as seperate messages to the IRC server, leaving the
event text unmodified.

(N.B. My 1st real modification to the ruby codebase, so someone who knows ruby
should really validate I did this correctly.)
2014-02-24 20:35:07 +00:00
subsection
068078fde8 Added warning when registering insecure state 2014-02-24 16:52:35 +01:00
James Turnbull
1ebd045de8 Minor updates to elasticsearch output docs 2014-02-22 16:27:09 -05:00