Jordan Sissel
983ded0aff
- Start working on a new web interface. Previous one was merb, new one is
...
async_sinatra. Initially supporting only ElasticSearch as a backend, will
add more eventually.
Example:
% curl http://localhost:9292/search?q=helloworld
{"received_timestamp"=>"2010-10-24 09:59:05.969670Z", "tags"=>["linux-syslog"], "message"=>"...", "source"=>"file://snack.home/var/log/user.log"}
<p>
{"received_timestamp"=>"2010-10-24 09:59:05.973771Z", "tags"=>["linux-syslog"], "message"=>"...", "source"=>"file://snack.home/var/log/messages"}
<p>
2010-10-24 10:00:42 +00:00
Jordan Sissel
b1d2e5e9b1
- Add elasticsearch indexing
2010-10-24 04:40:07 +00:00
Jordan Sissel
46c676e7dc
- Add readme
2010-10-21 20:16:21 +00:00
Jordan Sissel
251e170518
- Add code/script for the logstash websockets screencast.
...
Uses xdotool to type and do other actions on my behalf.
2010-10-21 11:14:25 +00:00
Jordan Sissel
6c1ff2abc3
- Hack our hostname into the file url for easy "source" attribution
2010-10-18 09:37:51 +00:00
Jordan Sissel
240ff18dce
- disable durable for now
2010-10-18 08:17:58 +00:00
Jordan Sissel
0acb1d13f3
- Add gemspec
2010-10-18 08:05:27 +00:00
Jordan Sissel
694aae5088
- Update packaging
...
- Split config files
2010-10-18 07:27:03 +00:00
Jordan Sissel
b13f9bf8cb
- Add logstash.rb
2010-10-18 07:21:15 +00:00
Jordan Sissel
d5d532cbc6
- Move everything into the logstash subdir
2010-10-18 07:19:37 +00:00
Jordan Sissel
ae50ca1d82
- Move LogStash::Components::Agent to LogStash::Agent
2010-10-18 00:26:02 +00:00
Jordan Sissel
4c38c9d8fe
- Add MongoDB output
2010-10-18 00:07:36 +00:00
Jordan Sissel
6805a6ef03
- add Event#to_hash
2010-10-18 00:07:21 +00:00
Jordan Sissel
75dd74d398
- remove debug output
2010-10-18 00:06:44 +00:00
Jordan Sissel
af762f69bb
testing websockets
2010-10-17 23:24:48 +00:00
Jordan Sissel
0043302675
- Add websocket support (not yet tested)
2010-10-17 18:38:21 +00:00
Jordan Sissel
e79ae10abe
2010-10-17 10:52:36 +00:00
Jordan Sissel
d0c4ccbfdc
- Enhance the test example to show the ease of reading from local files
...
or simply reading parsed messages from an AMQP topic with the same code
and only the configuration changed.
2010-10-17 10:49:58 +00:00
Jordan Sissel
cf06e05019
2010-10-17 10:36:59 +00:00
Jordan Sissel
c6a9bce4fc
- Update TODO
2010-10-17 10:36:01 +00:00
Jordan Sissel
141a4c64ed
- purge old stuff
2010-10-17 10:32:13 +00:00
Jordan Sissel
9f3114c883
- Purge old web ui
2010-10-17 10:31:26 +00:00
Jordan Sissel
4684f65995
- Purge post-refactor. The older stuff can be found in /tags/pre-agent-refactor
2010-10-17 10:30:22 +00:00
Jordan Sissel
791f15f633
- Add the new refactored agent model.
...
An agent can read from any input, apply filters, and pass to any output.
* Inputs are files, amqp, stomp, http server, syslog server, etc.
* Outputs are similar.
* Filters are for manipulating events (parsing, adding data, trimming
private data, etc)
Inputs so far: amqp, file.
Outputs so far: amqp, stdout.
Filters so far: grok (pattern discovery only)
A sample custom agent is in examples/test.rb
2010-10-17 10:27:38 +00:00
Jordan Sissel
1575edcdb1
- Add time wrapper for iso8601 support
2010-10-17 07:27:24 +00:00
Jordan Sissel
d9c8381754
- Add base for unified invocation binary
2010-10-17 07:13:38 +00:00
Jordan Sissel
7a6808418f
- Don't use File::Tail anymore
2010-10-17 06:57:01 +00:00
Jordan Sissel
524194d5de
2010-10-17 03:20:05 +00:00
Jordan Sissel
c4c880f51d
2010-10-17 03:19:57 +00:00
Jordan Sissel
d3280be19b
- start working on splitting things in to components. I want it to be possible
...
to run a single agent that does log reading, parsing, and indexing locally.
2010-10-17 03:19:45 +00:00
Jordan Sissel
ae21f3d7c0
- Fix eventmachine-tail usage to match 0.2.x api
2010-05-18 08:11:33 +00:00
Jordan Sissel
4aea3bddb3
- Sync grok-patterns from grok svn HEAD.
2010-05-18 08:11:06 +00:00
Jordan Sissel
c1ecbff37c
- If no timezone is in the date format, assume localtime and move to UTC time.
2010-05-18 08:10:46 +00:00
Jordan Sissel
6b48e99eaa
- Add search form partial
2010-05-04 15:53:27 +00:00
Jordan Sissel
58dc837a14
- Add a title to the graph showing the range (time period)
...
- Add a vertical dash on the graph indicating the current time
- Make / (index) show a better view of the search form
2010-05-04 03:35:33 +00:00
Jordan Sissel
5e955a47ba
- Fix output showing result range if total results is less than the query 'limit'
...
- Show date stamp of each result.
2010-05-03 21:36:07 +00:00
Jordan Sissel
9795bb56b5
- Fix time conversion for the graph
...
- Fix sort (elasticsearch wants an array of fields, not just a string)
- Allow tunable graph steps (default 3600 seconds)
- Skip empty capture vaules
- add elasticsearch_host to BaseConfig
2010-05-02 07:47:01 +00:00
Jordan Sissel
5b9e83ce13
- fix version generation (major.svnrev), current major is 0.
...
- Add missing files to spec
2010-04-27 08:36:54 +00:00
Jordan Sissel
4c95afa52c
- Add files to spec
2010-04-27 08:26:31 +00:00
Jordan Sissel
b4865b76b0
- Move elasticsearch support into LogStash::Net::Clients::ElasticSearch
2010-04-26 09:26:06 +00:00
Jordan Sissel
877e527d91
- Add elasticsearch_host config option
...
- Make LogStash::Log index to elasticsearch
2010-04-26 09:24:09 +00:00
Jordan Sissel
2c299fae25
- Fix search's graph
2010-04-25 20:56:39 +00:00
Jordan Sissel
1cb56a94d4
- Use elasticsearch again for a indexing backend.
...
- Update logstash web to hit elasticsearch (hardcoded host for now)
2010-04-25 09:12:45 +00:00
Jordan Sissel
32ca7fbaea
- copy grok patterns again
2010-04-14 09:19:21 +00:00
Jordan Sissel
5c8bef85db
- just print matching lines
2010-04-14 09:06:36 +00:00
Jordan Sissel
418efeb2fd
- Try full-text search, limit 10 results
2010-04-14 09:03:42 +00:00
Jordan Sissel
5c9922be05
- Add new indexing that uses TokyoCabinet table db for storage.
2010-04-14 07:44:15 +00:00
Jordan Sissel
cbfa08081d
- Copy new patterns from grok
2010-04-14 07:42:33 +00:00
Jordan Sissel
6cd4f63cb4
2010-04-13 08:12:04 +00:00
Jordan Sissel
9cc9b2b952
2010-04-13 08:11:57 +00:00