Commit graph

3729 commits

Author SHA1 Message Date
Bob Corsaro
1ba0c4dce6 Merge remote-tracking branch 'logstash/master'
Conflicts:
	lib/logstash/inputs/redis.rb
	lib/logstash/outputs/redis.rb
2011-05-26 10:20:02 -04:00
Pete Fritchman
e21ef0e48f don't cancel an event if our types don't match, just pass on filtering it 2011-05-23 15:55:01 -07:00
Pete Fritchman
c7f8960458 Merge remote branch 'origin/master' 2011-05-22 21:56:56 -07:00
Pete Fritchman
409e062aac not all config keys have options (see date filter) 2011-05-22 21:56:43 -07:00
Jordan Sissel
b2c8e486ae - remove empty method 2011-05-22 21:24:36 -07:00
Pete Fritchman
7e920fd4f7 always log backtrace with catch-all rescues 2011-05-22 16:28:37 -07:00
Pete Fritchman
dce1b469e7 in every 'generic' rescue case, send the backtrace to logger.debug 2011-05-22 16:15:34 -07:00
Pete Fritchman
ba645845da remove eventmachine requirement for redis output 2011-05-22 15:03:23 -07:00
Pete Fritchman
06112f4d7b sleep between input/output retries and warn when a major thread is shutting down 2011-05-21 18:01:24 -07:00
Pete Fritchman
72274fba2e minor cleanup and raise exception stating we're not supported 2011-05-21 18:00:43 -07:00
Pete Fritchman
a97410c0a3 allow marking a config item as :deprecated 2011-05-21 17:22:00 -07:00
Pete Fritchman
4627a8e6d7 support debug_format: ruby or json debug output. also fix HAVE_AWESOME_PRINT hack; if require ap already failed in logging.rb, it just returns false here 2011-05-21 00:44:13 -07:00
Pete Fritchman
3c342ef147 Merge remote branch 'origin/master' 2011-05-21 00:32:44 -07:00
Pete Fritchman
14e6cb0220 be more liberal with what we catch for bunny connect problems 2011-05-21 00:23:26 -07:00
Jordan Sissel
809690fc5a Merge branch 'master' of github.com:logstash/logstash 2011-05-21 00:10:23 -07:00
Pete Fritchman
11b95e57db LOGSTASH-90: only process events that match our @type. also don't tag _grokparsefailure if we don't have any patterns. 2011-05-20 23:54:17 -07:00
Pete Fritchman
21eb144b8c support message_format to build a @message when the the input is raw json 2011-05-20 23:30:57 -07:00
Pete Fritchman
569af86ce1 allow inputs to specify a data format 2011-05-20 23:03:10 -07:00
Pete Fritchman
cbae31f46d better logging in amqp output if we have trouble converting an event to json 2011-05-20 19:19:25 -07:00
Jordan Sissel
27784a4c5a Merge branch 'master' of github.com:logstash/logstash 2011-05-20 12:23:26 -07:00
Pete Fritchman
594576a21e fix GELF output: support extra fields properly (_ prefix) and pass timestamp as unixtime 2011-05-20 01:23:56 -07:00
Pete Fritchman
ef30963992 patterns_dir should be specific to our grok filter instance, not global 2011-05-19 16:57:56 -07:00
Pete Fritchman
5eb607ed7b LOGSTASH-93: make config patterns_dir and --grok-patterns-dir work 2011-05-19 14:50:53 -07:00
Pete Fritchman
dc60484f0f LOGSTASH-88: fix typo which broke tcp inputs, and better exception logging 2011-05-19 14:15:02 -07:00
Jordan Sissel
e90f1b1107 - refactor agent so it compiles under jruby 1.6.1 2011-05-18 15:42:52 -07:00
Jordan Sissel
5a789a9e75 - remove old breaks. 2011-05-18 12:21:18 -07:00
kjoconnor
4419c6ddee Typo 2011-05-17 13:38:58 -07:00
kjoconnor
fbbf548643 Typo 2011-05-17 13:35:41 -07:00
kjoconnor
cd308b40a1 Typo 2011-05-17 13:28:58 -07:00
Jordan Sissel
286edff713 - remove beanstalk-client due to possible license conflicts (it's GPL3) 2011-05-16 12:08:52 -07:00
Bob Corsaro
39fa1a8615 Merge remote-tracking branch 'logstash/master' 2011-05-16 11:55:47 -04:00
Jordan Sissel
ffeade9083 - disable signal-invoked shutdown for now. Need to refactor so it'll be
easier to do this.
2011-05-16 00:59:46 -07:00
Jordan Sissel
9ba030bedd - force quit if shutdown procses takes longer than 10 seconds.
- use begin/rescue/retry instead of loops
- Make amqp support shutdowns properly
2011-05-16 00:45:44 -07:00
Jordan Sissel
cc403795ff - add filterworker 2011-05-15 14:58:43 -07:00
Bob Corsaro
ea29f9ebb0 channel input 2011-05-15 17:46:58 -04:00
Bob Corsaro
20f8cf8ea0 Merge branch 'logstash-master' 2011-05-15 17:38:25 -04:00
Jordan Sissel
a61da6a8f3 - clean up some log messages
- make SIGINT (^C) and SIGTERM start the shutdown sequence.
- Wrap LogStash::Outputs::Base#recieve with #handle which checks
  for the shutdown event and automatically handles it.
2011-05-15 00:40:17 -07:00
Jordan Sissel
28ca682b3f - Add LogStash::Plugin for generalizing threads/workers involved in the
pipeline. This allows us to do cascading shutdowns of inputs then
  filters then outputs.

  - If all inputs finish, start shtdown.
  - If all plugins are finished, then exit.
  - A special 'event' gets passed down during shutdown
  (LogStash::SHUTDOWN)

  At this point, doing 'echo "foo" | logstash -f foo.conf' will result
  in a shutdown after the "foo" line has been fully processed. As
  intended!

- Refactored the input/filter/output thread launchers to separate
  methods.
- Have 'stdin' finish if it reads EOF
- Currently only stdout and amqp outputs support shutdown properly.
2011-05-15 00:02:59 -07:00
Jordan Sissel
68399e0023 - Move defaults to be part of the config, not the docs. 2011-05-14 22:41:32 -07:00
Jordan Sissel
0af1e8740e Merge pull request #23 from dokipen/redis-doc
Redis doc
2011-05-14 22:36:42 -07:00
Jordan Sissel
9c6c79450a - set exchange durability to 'true' by default (was false)
- support persistent messages in amqp. Verified with rabbitmq and
  tested manually.
  https://logstash.jira.com/browse/LOGSTASH-81
2011-05-14 18:23:49 -07:00
Jordan Sissel
1e30c0de99 - support clustername in elasticsearch url as the 'path' name
example: elasticsearch:///mycluster
2011-05-14 18:12:06 -07:00
Jordan Sissel
a345bb9988 - Allow dynamic strings for facility and level.
- Level now supports strings (INFO, I) case-insensitive, in addition to
  the old numbers (0-7)

  Resolves LOGSTASH-83
2011-05-14 17:28:54 -07:00
Jordan Sissel
0726603b19 - add note about why we're making a hash 2011-05-12 10:08:10 -07:00
Jordan Sissel
a513a517c6 - durable queues! 2011-05-10 22:18:51 -07:00
Bob Corsaro
ad8aa8695c Merge branch 'redis-pubsub'
Conflicts:
	lib/logstash/inputs/redis.rb
2011-05-10 06:38:29 -04:00
Bob Corsaro
3997a60761 Adds redis pubsub channel support 2011-05-10 06:37:29 -04:00
Bob Corsaro
c2c04998d7 Redis input docs 2011-05-10 06:07:51 -04:00
Bob Corsaro
f8dce8d5df Redis output docs 2011-05-10 06:05:48 -04:00
Jordan Sissel
bb21c3b55d - move requires to #register 2011-05-09 23:58:49 -07:00