Commit graph

84 commits

Author SHA1 Message Date
Jordan Sissel
cf7bcdcddb - add rubygems to the agent runner entry point 2011-04-09 02:49:04 -07:00
Jordan Sissel
0d5451e8cf - got logstash-web working in jruby now 2011-04-02 09:38:10 -07:00
Jordan Sissel
f9173f2cbc - remove extra requires 2011-03-19 12:42:57 -07:00
Jordan Sissel
90b72b4c5a - Move agent flags and settings management into logstash/agent.rb 2011-03-19 00:24:56 -07:00
Jordan Sissel
bbbcf321ef remove old 2011-03-18 22:41:10 -07:00
Pete Fritchman
f65d21bf38 * logstash -v sets debug loglevel, better passing of logger
* fix grok filters to keep one set of @@grokpiles per event type
* use a LogStash::File::Manager for watching globs and missing files
2011-02-20 20:57:45 -08:00
Jordan Sissel
a3ebbec089 - More work towards a config file format. 2011-02-19 19:12:55 -08:00
Pete Fritchman
c081a9eec7 first cut at jruby/threaded logstash 2011-02-16 11:41:48 -08:00
Jordan Sissel
e8f43c15d2 - add additional library checks
- add todo
2011-02-12 22:40:18 -08:00
Jordan Sissel
def6f44d2b - Fix test runner 2010-12-26 21:01:42 -08:00
Jordan Sissel
71ce64cf16 - Log to STDERR, but redirect STDERR/STDOUT according to the log
settings.
2010-12-22 17:18:19 -08:00
Jordan Sissel
29b4a684d6 - Add -v verbose flag 2010-12-07 14:54:13 -08:00
Jordan Sissel
08bd889e84 - don't require 'daemons' anymore 2010-12-07 11:21:50 -08:00
Jordan Sissel
1aa5365e40 - Add '-d' (daemonize)
- Add '-l LOGFILE' (log to a file instead of STDOUT)
- Give the agent's logger to each input/output/filter.
2010-12-07 11:18:39 -08:00
Jordan Sissel
2b14cba4eb - Push a logstash-test script to aid in debugging common logstash setup
problems.
2010-11-29 21:01:25 -08:00
Jordan Sissel
052f62c966 - Move web to lib/logstash/web 2010-11-16 03:38:44 +00:00
Pete Fritchman
3014715d78 automatically include the right lib dir 2010-11-01 01:31:15 +00:00
Pete Fritchman
7e80e89c39 show usage when we encouner option-related problems 2010-10-31 04:54:25 +00:00
Pete Fritchman
f7ad0a0a9a create base classes for inputs/outputs/filters 2010-10-31 04:46:12 +00:00
Pete Fritchman
b9592108b2 mark bin/logstash as executable 2010-10-26 09:40:37 +00:00
Jordan Sissel
694aae5088 - Update packaging
- Split config files
2010-10-18 07:27:03 +00:00
Jordan Sissel
ae50ca1d82 - Move LogStash::Components::Agent to LogStash::Agent 2010-10-18 00:26:02 +00:00
Jordan Sissel
af762f69bb testing websockets 2010-10-17 23:24:48 +00:00
Jordan Sissel
4684f65995 - Purge post-refactor. The older stuff can be found in /tags/pre-agent-refactor 2010-10-17 10:30:22 +00:00
Jordan Sissel
791f15f633 - Add the new refactored agent model.
An agent can read from any input, apply filters, and pass to any output.
    * Inputs are files, amqp, stomp, http server, syslog server, etc.
    * Outputs are similar.
    * Filters are for manipulating events (parsing, adding data, trimming
      private data, etc)
  Inputs so far: amqp, file.
  Outputs so far: amqp, stdout.
  Filters so far: grok (pattern discovery only)

  A sample custom agent is in examples/test.rb
2010-10-17 10:27:38 +00:00
Jordan Sissel
d9c8381754 - Add base for unified invocation binary 2010-10-17 07:13:38 +00:00
Jordan Sissel
8965fa6c49 - Rewrite Agent for local-running only. The goal here is mainly to make the
agent EventMachine-safe. Later I'll pull the index/parse functionality into a module
  that can be included into the agent for optional local-only or network modes.
2010-04-13 07:03:36 +00:00
Jordan Sissel
3a02fb6abd - migrate up some code 2009-11-08 06:14:46 +00:00
Jordan Sissel
1c5c6b8c03 - don't require a file we don't have naymore 2009-11-08 06:10:15 +00:00
Jordan Sissel
b9a273885f - search.rb use new LogStash::StopWatch class 2009-10-25 03:19:11 +00:00
Pete Fritchman
04d2cee11e - fix pid/dying? logic
- handle exceptions from get_ferret (trying to search unindexed log types)
- die if we can't create a new index
2009-10-21 02:38:26 +00:00
Jordan Sissel
1b7e57b8d0 - Update Clients::Search to block on the search ops.
Clients::Search#search now returns [hits, results_array]
2009-10-21 02:06:38 +00:00
Jordan Sissel
a35abbbdad - factor out search client
- make web and bin/search.rb use the new search client class
2009-10-21 01:58:42 +00:00
Jordan Sissel
15b830abc4 - use new BaseConfig for search tool
- limit search results to 100 for now
2009-10-21 01:32:55 +00:00
Jordan Sissel
f42fe931e1 - Use File.basename($0) 2009-10-21 01:03:47 +00:00
Jordan Sissel
875a6a9fee - make the agent use LogStash::Program 2009-10-21 01:02:38 +00:00
Jordan Sissel
a2c4c15918 - Add workaround for signal/syscall interruption bug in ruby 1.8.5 2009-10-21 00:47:56 +00:00
Jordan Sissel
1ac4ed62a6 - facter out common program activities to LogStash::Program 2009-10-21 00:41:32 +00:00
Pete Fritchman
3db7ad4a77 - handle pidfile better on shutdown
- INT just calls TERM
2009-10-21 00:13:11 +00:00
Jordan Sissel
9ad4e04f89 - open with happier mode (create if not exist, open readwrite) 2009-10-20 21:53:29 +00:00
Pete Fritchman
f3ba581fcb - we want "w+" for the pidfile open because it may not exist yet 2009-10-20 21:24:41 +00:00
Pete Fritchman
a6bb2b9405 - rename agent.rb to logstash-agent 2009-10-20 20:59:47 +00:00
Jordan Sissel
2edda3d34c - Add locking to our pidfile. 2009-10-20 20:59:08 +00:00
Pete Fritchman
a9bc1324f0 - If one of our children dies, send ourselves a SIGTERM and do a clean
shutdown. We want our OS/watcher/whatever to know logstash is dead,
  rather than continue to run with random children dead.
- Remove pidfile on shutdown
2009-10-20 20:35:16 +00:00
Pete Fritchman
24169ef165 - refactor agent to be a real daemon
- refactor configs (all inherit from BaseConfig)
- move beef of agent code to lib/net/clients/
- use optionparser's ".order" instead of ".parse"
2009-10-20 17:40:44 +00:00
Jordan Sissel
26082d9309 - Proper daemonizing
- Add --logfile for directing STDOUT and STDERR to a file.
- Require logfile if we are to daemonize
- Set parent process $0 to 'logstash (supervisor)'
2009-10-20 06:59:02 +00:00
Pete Fritchman
c151016413 - support daemonizing
- support a pid file
- set $0 on our indexer & parser children
- handle INT and TERM signals (clean up children)
- switch to waitpid/WNOHANG/sleep(5) loop instead of Process.waitall because
  of a lame bug with ruby 1.8.5 and SIGTERM
2009-10-20 04:55:34 +00:00
Pete Fritchman
c02eb62bcc - remove hacks/testing files that we won't be packaging up 2009-10-20 01:20:58 +00:00
Pete Fritchman
d4459ebf46 - consolidate to one logstashd that forks parsers & indexers
- use logger for output
- stop handling QuitRequests
- re-up broadcast interval to 30 (was @ 5 for debugging)
- add debug output (logstashd -d ...)
2009-10-19 19:03:49 +00:00
Jordan Sissel
405a813f68 - Move search's Directory querying to be synchronous 2009-10-19 10:19:49 +00:00