github-mirrors/logstash
1
0
Fork 0
mirror of https://github.com/elastic/logstash.git synced 2025-04-24 06:37:19 -04:00
Code Issues Projects Releases Packages Wiki Activity
10927 commits 258 branches 379 tags 173 MiB
Commit graph

10927 commits

This branch
This branch
All branches
Author SHA1 Message Date
Jordan Sissel
5e51250c20 - before forwarding the indexeventrequest to the indexer, generate a new 
message id for it.
 2009-11-06 09:39:39 +00:00
Jordan Sissel
ef35581319 - disable agent index request buffering for now (need to debug parser race/halting-bug condition) 
- set response code in Indexer's IndexEventRequestHandler
 2009-11-06 09:32:01 +00:00
Jordan Sissel
c9fa9c87af - BaseConfig subclasses MQRPC::Config now 
- Update servers and clients to use MQRPC properly
 2009-11-06 08:57:20 +00:00
Jordan Sissel
790b081a31 - Move all messages to use MQRPC 2009-11-06 08:26:47 +00:00
Jordan Sissel
1f85aad3d5 - Purge old network code now implemented by MQRPC 2009-11-06 08:17:13 +00:00
Jordan Sissel
6d41874029 - Version bump. 2009-10-29 07:03:08 +00:00
Jordan Sissel
1331382bac - Graph the current query hits over the past 24 hours from current time. 2009-10-29 06:58:28 +00:00
Jordan Sissel
8af13cdef5 - set body margin to 5px 2009-10-29 06:57:26 +00:00
Jordan Sissel
ea91012694 - Add flot 0.6 2009-10-29 06:56:29 +00:00
Jordan Sissel
20ce5e4acd - Add graphpoints.json template 2009-10-28 08:21:34 +00:00
Jordan Sissel
728221d326 - Add #searchhits to the search client. Takes a log type and array of queries, 
returns a hash of query => hitcount
- Fix LogStash::Operation behavior. If 'wait_until_finish' was called after the
  operation finished, not before, we would deadlock. Now any wait_until_finish
  call will succeed and return immediately if the operation has already finished.
  It will still block normally if the operation has not finished.
- Comment-out the sliding window stuff
- Add 'graphpoints' action for the web. Querying this will return an array of
  [timestamp_in_ms, hits] for the query for some period of timestamps for your
  query. Makes happy use of the Operation class so we can send a pile of search
  requests in parallel and wait until they finish. 24 queries (one for every
  hour) takes less than a second.
 2009-10-28 08:21:14 +00:00
Jordan Sissel
8b826e5215 - Attempt to use sliding windows 2009-10-26 18:54:40 +00:00
Jordan Sissel
0e68c317cb - Add my attempt at a locking 'sliding window' class that would prevent 
new additions if the 'want' buffer was full.
 2009-10-26 06:20:56 +00:00
Jordan Sissel
03707d1e20 - set durable on queues 2009-10-26 06:16:55 +00:00
Jordan Sissel
5dcd3ff22f - we should send a reply to the client sending the indexrequest 2009-10-26 06:14:11 +00:00
Jordan Sissel
473ee8cd74 - Add ':' to URIPATH 2009-10-25 09:46:00 +00:00
Jordan Sissel
4e9eb6ae28 - write File::Tail::Since state per file to ~/.rb_since_d/uid.filepath 
This relieves contention for the single ~/.rb_since file

  Also try to write to /var/run/rb_since/uid.filepath first, if we can.
 2009-10-25 09:41:36 +00:00
Jordan Sissel
c055692ca0 - Add 'first' link to search results 2009-10-25 09:13:21 +00:00
Jordan Sissel
cf6986d8e5 - Add 'last' link to jump to end of search results 
- Increase default 'limit' from 20 to 100.
 2009-10-25 09:11:24 +00:00
Jordan Sissel
c3ab5803ea - Add changelog 
- version to 0.3.3
 2009-10-25 04:54:29 +00:00
Jordan Sissel
a5886b21ff - reformat for readability 
- fix bug where 'prev' wasn't including log_type
 2009-10-25 04:49:14 +00:00
Jordan Sissel
9af8615fe0 - Support message buffering again, but now support both buffering and 
non-buffering (ie; send message now). This is akin to TCP_NODELAY but is
  configurable on a per-message basis by calling 'message.want_buffer(true)'
 2009-10-25 04:29:06 +00:00
Jordan Sissel
f35a1ea88a - Follow symlink if pattern_dir is one 2009-10-25 04:27:27 +00:00
Jordan Sissel
78cfbff565 - uri paths can have /[@{}]/ in it 2009-10-25 04:26:10 +00:00
Jordan Sissel
226027c024 - Disable message buffering internal to logstash. Previously, sendmsg() would 
push into an array which would get flushed when full or once per second.
  This was causing any normally-fast search request to take a minimum of 1 second.

  The original need for buffering was due to features of STOMP (not used
  anymore) that would limit the number of messages we could handle at once. We
  would buffer multiple messages to a single STOMP queue message so that we
  could handle multiple messages. This may not be a problem anymore with AMQP.

  Set BUFFER_DELAY_MESSAGES to true in socket.rb if you want to re-enable this.

- Add 'timestamp' attribute for all messages. This attribute is set
  automatically when it is sent with MessageSocket#sendmsg.
- Add blocking on MessageSocket#initialize to wait for the AMQP thread. Uses
  the same mutex/conditionvariable method we use to block LogStash::Operation
  instances.
- Removed old 'USE_MARSHAL' support as I think we're pretty happy with JSON now.
 2009-10-25 03:24:02 +00:00
Jordan Sissel
b9a273885f - search.rb use new LogStash::StopWatch class 2009-10-25 03:19:11 +00:00
Jordan Sissel
646a0948ed - Add LogStash::StopWatch class for recording execution time of code 2009-10-25 03:14:42 +00:00
Jordan Sissel
18476af99b - Only ever create one search client, and do it on app startup. 2009-10-25 03:11:04 +00:00
Jordan Sissel
b5ff853c4a - remove file that doesn't need to be in svn 2009-10-25 03:10:42 +00:00
Jordan Sissel
4abe95037a - syslog program names can have periods or underscores 2009-10-23 16:57:27 +00:00
Jordan Sissel
9195abd6de - make get_ferret open a new IndexReader and Searcher every time, otherwise we 
can get stale search results.
 2009-10-23 10:07:10 +00:00
Jordan Sissel
645d17da70 - version bump 2009-10-23 08:44:21 +00:00
Jordan Sissel
4de3175b57 - remove old sanbox we don't need anymore 2009-10-23 08:43:45 +00:00
Jordan Sissel
629c264113 - fix web search config yaml path 
- fix web dependencies
 2009-10-23 08:42:17 +00:00
Jordan Sissel
807461e79e - set default / to /search 2009-10-23 08:12:30 +00:00
Jordan Sissel
ddbf0ebe36 - Add new webapp which is of 'merb-gen core' lineage. Much fewer dependencies than previous version. 2009-10-23 08:11:44 +00:00
Jordan Sissel
5ce84cf45b - Remove 'web' as it requires too many things we don't use. 2009-10-23 08:10:53 +00:00
Jordan Sissel
ddc06fd32b - Update INSTALL docs 2009-10-23 06:56:45 +00:00
Jordan Sissel
b4b831ce9d - version bump for stomp removal 2009-10-21 08:32:13 +00:00
Jordan Sissel
bb22cf63b7 - purge stomp 2009-10-21 08:30:45 +00:00
Pete Fritchman
168ca8cbf5 - include lib/clients/ in logstash-libs RPM 2009-10-21 07:10:27 +00:00
Jordan Sissel
4a3d5f2e8b - explicitly catch Ferret::FileNotFound 2009-10-21 02:47:53 +00:00
Pete Fritchman
04d2cee11e - fix pid/dying? logic 
- handle exceptions from get_ferret (trying to search unindexed log types)
- die if we can't create a new index
 2009-10-21 02:38:26 +00:00
Jordan Sissel
af918884c9 - default search query includes 'AND -@NEEDSPARSING:1' unless we have 
@NEEDSPARSING in the query
 2009-10-21 02:19:36 +00:00
Jordan Sissel
1b7e57b8d0 - Update Clients::Search to block on the search ops. 
Clients::Search#search now returns [hits, results_array]
 2009-10-21 02:06:38 +00:00
Jordan Sissel
a35abbbdad - factor out search client 
- make web and bin/search.rb use the new search client class
 2009-10-21 01:58:42 +00:00
Jordan Sissel
15b830abc4 - use new BaseConfig for search tool 
- limit search results to 100 for now
 2009-10-21 01:32:55 +00:00
Jordan Sissel
f42fe931e1 - Use File.basename($0) 2009-10-21 01:03:47 +00:00
Jordan Sissel
875a6a9fee - make the agent use LogStash::Program 2009-10-21 01:02:38 +00:00
Jordan Sissel
21f04f4e8b - remove debugging 
- abort if @daemonize and no @logfile set
 2009-10-21 01:00:26 +00:00