github-mirrors/logstash
1
0
Fork 0
mirror of https://github.com/elastic/logstash.git synced 2025-04-21 21:27:20 -04:00
Code Issues Projects Releases Packages Wiki Activity
10970 commits 254 branches 379 tags 173 MiB
Commit graph

10970 commits

This branch
This branch
All branches
Author SHA1 Message Date
Jordan Sissel
2ac9f69c55 - Update to work with latest code 2010-10-28 11:00:27 +00:00
Jordan Sissel
2053ceabcb - revert :port addition 2010-10-28 10:59:08 +00:00
Jordan Sissel
b8358e6004 - Add '_' to valid characters in URI paths and query parameters 2010-10-28 10:49:44 +00:00
Jordan Sissel
fb72212e36 - Improve logging. If the logger level == Logger::DEBUG, then we'll log the 
caller file, line number, and method. Example:

  With 'logger.level == Logger::DEBUG'
  I, [2010-10-28T03:38:23.984737 #25011]  INFO -- logtest.rb:9#foo: Hello
     ^ includes source file, line, and method. Source file gets trimmed
     if it's in $: (RUBYLIB path)
                                                  
  With 'logger.level != Logger::DEBUG'
  I, [2010-10-28T03:37:42.235899 #24998]  INFO -- logtest.rb: Hello
                                                     ^ progname, aka $0
 2010-10-28 10:39:13 +00:00
Jordan Sissel
b711b9d870 - Log when we skip something 2010-10-28 09:23:28 +00:00
Jordan Sissel
953fadeb80 - Import from grok svn r3079 (all pattern tests passing) 2010-10-28 09:20:07 +00:00
Jordan Sissel
4a89da7c1c - Refine LogStash::Event to have less Hash feel. 
- Add logging to filter/grok
- Make LogStash::Logger::Formatter only use awesome_inspect for non-strings
 2010-10-28 08:29:34 +00:00
Jordan Sissel
8cb4676420 - Start using our own logger 
- Add LogStash::Time::to_iso8601 to convert DateTime objects to iso8601 format.
- Add a 'date' filter for using a specific field into the real timestamp for
  the event. Example
    filters:
    - date:
        linux-syslog:
          date: %b %e %H:%M:%S
        apache-access:
          timestamp: "%d/%b/%Y:%H:%M:%S %Z"
  Syntax is:
    <tag>:
       <field>: <format>
  Supported format is 'strftime'
 2010-10-28 06:28:32 +00:00
Jordan Sissel
bd65c610b4 - fixa logic for setting debug level 
- start working on our own Logger subclass so we can log objects if necessary
 2010-10-27 09:03:33 +00:00
Jordan Sissel
62af366598 - remove unused 2010-10-27 02:50:35 +00:00
Jordan Sissel
7e9bedea32 - add logging 2010-10-27 02:50:22 +00:00
Jordan Sissel
64c072be20 - Add logging 2010-10-27 02:47:07 +00:00
Jordan Sissel
7821dd483b - update install notes 2010-10-27 02:46:53 +00:00
Pete Fritchman
b9592108b2 mark bin/logstash as executable 2010-10-26 09:40:37 +00:00
Jordan Sissel
7d1fb812b7 - Add standalone 2010-10-26 09:32:29 +00:00
Jordan Sissel
0b44e65eaf - should merge arrays, not append 2010-10-26 09:22:47 +00:00
Jordan Sissel
85d90ba6c4 - move grok parsed fields into a separate 'fields' piece 2010-10-26 09:02:59 +00:00
Jordan Sissel
7096ab9ebd - Use ajax calls to update search 
- Make search interactive
 2010-10-26 06:41:49 +00:00
Jordan Sissel
8fd6ca9422 - Start using haml. 2010-10-25 09:53:11 +00:00
Jordan Sissel
49af98b731 - Pad time fraction so it's sortable. 
- Use strings, not symbols since symbols aren't valid in json (and become
  strings anyway)
 2010-10-25 09:52:35 +00:00
Jordan Sissel
983ded0aff - Start working on a new web interface. Previous one was merb, new one is 
async_sinatra. Initially supporting only ElasticSearch as a backend, will
  add more eventually.

  Example:
    % curl http://localhost:9292/search?q=helloworld

    {"received_timestamp"=>"2010-10-24 09:59:05.969670Z", "tags"=>["linux-syslog"], "message"=>"...", "source"=>"file://snack.home/var/log/user.log"}
    <p>

    {"received_timestamp"=>"2010-10-24 09:59:05.973771Z", "tags"=>["linux-syslog"], "message"=>"...", "source"=>"file://snack.home/var/log/messages"}
    <p>
 2010-10-24 10:00:42 +00:00
Jordan Sissel
b1d2e5e9b1 - Add elasticsearch indexing 2010-10-24 04:40:07 +00:00
Jordan Sissel
46c676e7dc - Add readme 2010-10-21 20:16:21 +00:00
Jordan Sissel
251e170518 - Add code/script for the logstash websockets screencast. 
Uses xdotool to type and do other actions on my behalf.
 2010-10-21 11:14:25 +00:00
Jordan Sissel
6c1ff2abc3 - Hack our hostname into the file url for easy "source" attribution 2010-10-18 09:37:51 +00:00
Jordan Sissel
240ff18dce - disable durable for now 2010-10-18 08:17:58 +00:00
Jordan Sissel
0acb1d13f3 - Add gemspec 2010-10-18 08:05:27 +00:00
Jordan Sissel
694aae5088 - Update packaging 
- Split config files
 2010-10-18 07:27:03 +00:00
Jordan Sissel
b13f9bf8cb - Add logstash.rb 2010-10-18 07:21:15 +00:00
Jordan Sissel
d5d532cbc6 - Move everything into the logstash subdir 2010-10-18 07:19:37 +00:00
Jordan Sissel
ae50ca1d82 - Move LogStash::Components::Agent to LogStash::Agent 2010-10-18 00:26:02 +00:00
Jordan Sissel
4c38c9d8fe - Add MongoDB output 2010-10-18 00:07:36 +00:00
Jordan Sissel
6805a6ef03 - add Event#to_hash 2010-10-18 00:07:21 +00:00
Jordan Sissel
75dd74d398 - remove debug output 2010-10-18 00:06:44 +00:00
Jordan Sissel
af762f69bb testing websockets 2010-10-17 23:24:48 +00:00
Jordan Sissel
0043302675 - Add websocket support (not yet tested) 2010-10-17 18:38:21 +00:00
Jordan Sissel
e79ae10abe 2010-10-17 10:52:36 +00:00
Jordan Sissel
d0c4ccbfdc - Enhance the test example to show the ease of reading from local files 
or simply reading parsed messages from an AMQP topic with the same code
  and only the configuration changed.
 2010-10-17 10:49:58 +00:00
Jordan Sissel
cf06e05019 2010-10-17 10:36:59 +00:00
Jordan Sissel
c6a9bce4fc - Update TODO 2010-10-17 10:36:01 +00:00
Jordan Sissel
141a4c64ed - purge old stuff 2010-10-17 10:32:13 +00:00
Jordan Sissel
9f3114c883 - Purge old web ui 2010-10-17 10:31:26 +00:00
Jordan Sissel
4684f65995 - Purge post-refactor. The older stuff can be found in /tags/pre-agent-refactor 2010-10-17 10:30:22 +00:00
Jordan Sissel
791f15f633 - Add the new refactored agent model. 
An agent can read from any input, apply filters, and pass to any output.
    * Inputs are files, amqp, stomp, http server, syslog server, etc.
    * Outputs are similar.
    * Filters are for manipulating events (parsing, adding data, trimming
      private data, etc)
  Inputs so far: amqp, file.
  Outputs so far: amqp, stdout.
  Filters so far: grok (pattern discovery only)

  A sample custom agent is in examples/test.rb
 2010-10-17 10:27:38 +00:00
Jordan Sissel
1575edcdb1 - Add time wrapper for iso8601 support 2010-10-17 07:27:24 +00:00
Jordan Sissel
d9c8381754 - Add base for unified invocation binary 2010-10-17 07:13:38 +00:00
Jordan Sissel
7a6808418f - Don't use File::Tail anymore 2010-10-17 06:57:01 +00:00
Jordan Sissel
524194d5de 2010-10-17 03:20:05 +00:00
Jordan Sissel
c4c880f51d 2010-10-17 03:19:57 +00:00
Jordan Sissel
d3280be19b - start working on splitting things in to components. I want it to be possible 
to run a single agent that does log reading, parsing, and indexing locally.
 2010-10-17 03:19:45 +00:00