Logstash - transport and process your logs, events, or other data
Find a file
2014-08-07 09:07:06 +03:00
acceptance_spec Also add improved tests 2014-05-06 16:59:01 +02:00
bin logstash boot sequence cleanup & drip support fix 2014-07-13 20:02:42 -04:00
bot Warm welcome to bot,may it serves you well 2013-03-11 07:13:54 +01:00
docs Reference github issues now. 2014-07-07 23:19:49 +00:00
lib LOGSTASH-2276 fixed if/else branch mixup in rabbitmq input 2014-08-07 09:07:06 +03:00
locales Fixes spelling in en.yml 2014-07-18 09:47:03 -07:00
patterns Add tilde to UNIXPATH 2014-07-25 17:50:22 -07:00
pkg Adding delaycompress to logrotate 2014-08-01 17:39:13 +00:00
spec config grammar: Allow spaces in [field references][like this] 2014-08-01 17:35:48 +00:00
test/jenkins - purge old and unused 'test' directory (everything is rspec now) 2013-06-23 22:57:42 -07:00
tools logstash boot sequence cleanup & drip support fix 2014-07-13 20:02:42 -04:00
.gitignore Ignore RubyMine/IntelliJ dirs 2014-07-15 13:18:56 -07:00
.tailor - add .tailor config 2012-12-03 16:04:27 -08:00
.travis.yml rspec wasn't in PATH, adding --debug flag to jvm args 2013-09-25 14:33:32 -06:00
CHANGELOG changelog for 1.4.2 2014-06-24 14:12:01 +02:00
CONTRIBUTING.md Reference github issues now. 2014-07-07 23:19:49 +00:00
CONTRIBUTORS Updates contributors 2014-02-14 18:52:07 -02:00
dripmain.rb logstash boot sequence cleanup & drip support fix 2014-07-13 20:02:42 -04:00
extract_services.rb - Merge META-INF/services/* files from dependency jars. (#486) 2013-05-28 16:46:43 -07:00
gembag.rb use bundler compatible ruby version string 2014-07-14 17:41:06 -04:00
LICENSE it's 2013! 2013-01-01 21:07:00 -08:00
logstash-event.gemspec . 2013-09-11 11:02:20 -07:00
logstash.gemspec replace json parsers with JrJackson and Oj 2014-06-12 17:53:30 -04:00
Makefile call vendor-geoip instead of $(GEOIP) in prepare-tarball 2014-07-23 13:39:56 -07:00
pull_release_note.rb Make release note from JIRA and Github 2013-03-11 07:11:23 +01:00
README.md Update to reflect new JRuby default and USE_RUBY env option 2014-07-16 16:38:17 -07:00
require-analyze.rb - hacky script to analyze the DEBUG=require csv output grouped by 2013-12-07 12:13:04 -08:00
STYLE.md - clean up style guide a bit 2013-01-03 17:23:36 -08:00

Logstash

Logstash is a tool for managing events and logs. You can use it to collect logs, parse them, and store them for later use (like, for searching). Speaking of searching, Logstash comes with a web interface for searching and drilling into all of your logs.

It is fully free and fully open source. The license is Apache 2.0, meaning you are pretty much free to use it however you want in whatever way.

For more info, see http://logstash.net/

logstash-contrib

AKA "Where'd that plugin go??"

Since version 1.4.0 of Logstash, some of the community-contributed plugins were moved to a new home in the Elasticsearch logstash-contrib repo. If you can't find a plugin here which you've previously used, odds are it is now located there. The good news is that these plugins are simple to install using the Logstash manual plugin installation script.

Need Help?

Need help? Try #logstash on freenode irc or the logstash-users@googlegroups.com mailing list.

You can also find documentation on the http://logstash.net site.

Developing

Here's how to get started:

# Install jruby
make vendor-jruby

Now install dependencies:

# Install logstash ruby dependencies
bin/logstash deps

Other commands:

# to use Logstash gems or libraries in irb, use the following
# this gets you an 'irb' shell with Logstash's environment
bin/logstash irb

# Run Logstash
bin/logstash agent [options]

# If running bin/logstash agent yields complaints about log4j/other things
# This will download the elasticsearch jars so Logstash can use them.
make vendor-elasticsearch

Notes about using other rubies. If you don't use rvm, you can probably skip this paragraph. Logstash works with other rubies, and if you wish to use your own ruby instead of the JRuby the Makefile gives you, you must set USE_RUBY=1 in your environment.

Testing

There are a few ways to run the tests. For development, using bin/logstash rspec <some spec> will suffice:

% bin/logstash rspec spec/filters/grok.rb
...................

Finished in 0.123 seconds
19 examples, 0 failures

Alternately, if you have just built the tarball, you can run the tests specifically on those like so:

make tarball-test

If you want to run all the tests from source, do:

make test

Building

Building is not required. You are highly recommended to download the releases we provide from the Logstash site!

If you want to build the release tarball yourself, run:

make tarball

You can build rpms and debs, if you need those. Building rpms requires you have fpm, then do this:

make package

Project Principles

  • Community: If a newbie has a bad time, it's a bug.
  • Software: Make it work, then make it right, then make it fast.
  • Technology: If it doesn't do a thing today, we can make it do it tomorrow.

Contributing

All contributions are welcome: ideas, patches, documentation, bug reports, complaints, and even something you drew up on a napkin.

Programming is not a required skill. Whatever you've seen about open source and maintainers or community members saying "send patches or die" - you will not see that here.

It is more important to me that you are able to contribute.

For more information about contributing, see the CONTRIBUTING file.