Commit graph

6066 commits

Author SHA1 Message Date
Richard Pijnenburg
f4930db2f2 Merge pull request #1108 from jamtur01/esdocs
Minor updates to elasticsearch output docs
2014-02-24 09:37:51 +00:00
Pieter Lexis
c23e1b58ce Add tests for the collectd codec 2014-02-23 14:04:05 +01:00
James Turnbull
1ebd045de8 Minor updates to elasticsearch output docs 2014-02-22 16:27:09 -05:00
Ciaran Downey
726fc90b58 Update README with new travis URL 2014-02-21 17:06:00 -08:00
Kurt Hurtado
f8952873eb correct email config hash options 2014-02-21 17:05:10 -08:00
Kurt Hurtado
fad14b7153 minor updates, submitting two PRs as one 2014-02-21 15:54:05 -08:00
Jordan Sissel
f7b7cc3248 Merge pull request #1105 from jordansissel/elasticsearch-deletes-and-more
Elasticsearch deletes and unification (protocol => http)
2014-02-21 15:32:03 -08:00
Kurt Hurtado
fa295a303a Merge pull request #1104 from kurtado/doc/codecs/base
brief description input/output codecs
2014-02-21 12:58:13 -08:00
Kurt Hurtado
cf036bbb4c put the pencil to graphite 2014-02-21 12:23:47 -08:00
Jordan Sissel
2e7198b8f0 Fix typos and test failures 2014-02-21 12:06:40 -08:00
Jordan Sissel
454688fb58 Implement template management
Tests pass against ES 1.0.0:
  % bin/logstash rspec spec/outputs/elasticsearch.rb -e 'index template expected behavior' --fail-fast
  Finished in 27.57 seconds
  15 examples, 0 failures
2014-02-21 11:48:05 -08:00
Jordan Sissel
521cd1aeb7 Set a default node.name
This now causes logstash elasticsearch NodeClients to show up in the
cluster node list as "logstash-<hostname>-<pid>-xxxx"

This should help all users identify logstash nodes among their cluster.
2014-02-21 11:48:05 -08:00
Jordan Sissel
13b11c8ecd Add tests for templates and all 3 protocol settings 2014-02-21 11:48:05 -08:00
Jordan Sissel
473bd0e9b9 Add another strong note about NodeClient and firewalls 2014-02-21 11:48:05 -08:00
Jordan Sissel
cebc71fc1d InetSocketTransportAddress needs port to be a number, silly me. 2014-02-21 11:48:05 -08:00
Jordan Sissel
fb18f76277 Use ftw instead of elasticsearch-ruby for bulk indexing
In tests, using ftw directly results in 30% more events/sec than using
elasticsearch-ruby for bulk requests.
2014-02-21 11:48:05 -08:00
Jordan Sissel
52a53a605c Implement protocol => http in elasticsearch output
Also add `action` setting to allow logstash to signal document
deletions, updates, etc. The goal is to support any bulk request with
this output plugin, but the early target is simply to allow deletes.

This is one step in the path to having only one elasticsearch output
plugin and eventually removing elasticsearch_http.

The following tests pass
    % bin/logstash rspec spec/outputs/elasticsearch.rb
    ...
    Finished in 1 minute 33.94 seconds
    3 examples, 0 failures

Tested manually 'elasticsearch { protocol => http }' with success.

Still to be implemented:
* template management
* tests to cover all protocols: node, transport, and http
* mark elasticsearch_http as deprecated?
2014-02-21 11:48:05 -08:00
Kurt Hurtado
25dd1342dd brief description input/output codecs 2014-02-21 11:39:50 -08:00
Kurt Hurtado
4e8a5e4b52 touch up email doc 2014-02-20 17:28:13 -08:00
Aaron Mildenstein
6140f926b8 Figured out why @types wasn't initializing before register. It needed to be above super (thanks @jordansissel) 2014-02-20 17:30:32 -06:00
Aaron Mildenstein
8a4627c3df New collectd codec to go with the new and improved multithreaded udp input plugin. This makes the collectd input plugin obsolete.
# The Logstash input configuration can be as simple as:

```
input {
  udp {
    port => 28526
    buffer_size => 1452
    codec => collectd { }
  }
}
```
2014-02-20 16:03:00 -06:00
Aaron Mildenstein
0bfaf04ce4 Merge pull request #1098 from untergeek/udp-untergeek
UDP input plugin tweaks
2014-02-19 19:24:23 -06:00
Aaron Mildenstein
3bdcd3cdd4 Improve documentation of settings. 2014-02-19 19:18:50 -06:00
Aaron Mildenstein
134cb63687 Updated to streamline multithreaded UDP 2014-02-19 18:43:02 -06:00
johnarnold
ed3ce1ac5e Added config item for queue_size 2014-02-19 16:22:06 -08:00
johnarnold
11239d6d19 Add Multi-threaded workers and queues to UDP input 2014-02-19 16:22:06 -08:00
Jordan Sissel
4f1272eba5 Merge pull request #1096 from mrsolo/gemfixes
Install cleanups
2014-02-19 16:02:12 -08:00
Bill Hwang
440a5eb583 Remove extra "mail" dependency in logstash.gemspec
Add rescue blocak to bundle install loop in gembag.rb
2014-02-19 12:07:42 -08:00
Aaron Mildenstein
6e2531e8e8 Merge pull request #1095 from jamtur01/docfixes
Fixed some issues in the tutorial
2014-02-19 13:14:03 -06:00
James Turnbull
99f6dee78f Fixed some issues in the tutorial
* Fixed a code formatting issue
* Consistently capitalized Logstash
2014-02-19 13:08:48 -05:00
Aaron Mildenstein
f7519373fc Merge pull request #1094 from untergeek/es-1.0-template
ES 1.0 template
2014-02-19 11:46:18 -06:00
Aaron Mildenstein
199f8d36ed Merge pull request #1093 from untergeek/docfix-untergeek
Docfix untergeek
2014-02-19 11:36:11 -06:00
Aaron Mildenstein
3a04b150fa Added contrib plugin link on doc page. 2014-02-19 11:16:07 -06:00
Aaron Mildenstein
a3747d14f4 Merge branch 'master' of https://github.com/logstash/logstash 2014-02-19 11:12:15 -06:00
Jordan Sissel
bcafd15105 Fix make dependencies 2014-02-19 08:44:58 -08:00
Jordan Sissel
45a7b3d0ef - remove references to 'jar' 2014-02-19 07:39:19 -08:00
Jordan Sissel
6fd20a98a6 Merge pull request #1090 from jamtur01/newlaunch
Fixed docs to reflect bin/logstash and other minor edits
2014-02-19 07:33:57 -08:00
subsection
3d09f7e216 Added option to disable certificate validation 2014-02-19 15:34:15 +01:00
subsection
4900d091ab Added option to disable certificate validation
If a IMAP-server is using a self-signed certificate, this patch adds a "verify_cert" option to the module that is by default set to true (old behavior), but if set to false it will disable the verification check. The result is that IMAP TLS with self-signed certificate will not crash logstash.
2014-02-19 15:17:07 +01:00
James Turnbull
89c06016ec Fixed docs to reflect bin/logstash and other minor edits 2014-02-19 09:01:23 -05:00
Jordan Sissel
6e2de0614a Merge pull request #1089 from jordansissel/link-to-tarball
Link to tarball
2014-02-18 23:40:04 -08:00
Jordan Sissel
25d5f919c2 Update links from flatjar to tar.gz 2014-02-19 06:37:46 +00:00
Jordan Sissel
69efb51518 Update changelog through e9810a64f7 2014-02-19 06:34:59 +00:00
Jordan Sissel
5a026bb981 Build flatjar as well 2014-02-19 06:03:58 +00:00
Jordan Sissel
3265981fe8 Bam, beta 1 2014-02-19 02:58:31 +00:00
Jordan Sissel
715e043459 - More cleanup in prepare
- copy all packages/etc into the right place
2014-02-19 02:56:17 +00:00
Jordan Sissel
126680a50d Use gnu sed's '-i' flag style. FreeBSD/OSX's sed usage is different.
Since we generally build release on Linux platforms (for jenkins, etc),
let's move back to gnu sed.
2014-02-19 02:24:16 +00:00
Kurt Hurtado
566ef18d4c touch up 2014-02-18 16:20:58 -08:00
Kurt Hurtado
fd8a0f8ae6 explain defaults 2014-02-18 15:45:50 -08:00
Jordan Sissel
5e17988f1b Merge pull request #1088 from jordansissel/prep14master
Prep14master
2014-02-18 15:42:33 -08:00