Commit graph

7009 commits

Author SHA1 Message Date
Suyog Rao
bfbb49dc14 Remove elasticsearch_http from default plugins list
Fixes #4002
2015-10-08 13:35:30 +00:00
Jordan Sissel
7e7e4c8719 New plugin config attribute :obsolete
An obsolete setting is one that will cause a configuration error if it
is used.

The purpose of `:obsolete` is to help inform users when a setting has
been completely removed. The lifecycle of a plugin setting is now 4
phases: available, deprecated, obsolete, deleted.

"Available" is the default, and deprecated remains the same as it was
(logging a warning). The new obsolete will cause a configuration error
if such a setting is used. Then later, we can finally delete the config
setting after it's been obsolete for some time.

Fixes #3977

Fixes #3978
2015-10-02 09:31:29 +00:00
Stanislav
3fb87e287b Fix typo in README.md
Fixes #3979
2015-09-30 09:30:24 +00:00
Suyog Rao
cdbd46a5b3 Roadmap: Update with Alvin's changes
Fixes #3972
2015-09-26 03:23:21 +00:00
Pere Urbon-Bayes
e4c198113a Revert "merged from upstream"
This reverts commit a6ab581979.

Fixes #3951
2015-09-25 18:24:57 +00:00
guyboertje
e0ab036b34 Merge branch 'feature/3852' 2015-09-24 15:30:12 +01:00
guyboertje
5b47009648 Add basic defaults module and spec. Use defaults in pipeline and agent
move/rename defaults under config, use Concurrent.processor_count
remove method `filter_workers_count`

add CpuCoreStrategy module functions/tests. Use fifty_percent as default.

use extend self for Module functions

added defaults printing facility

change comment

add tests to defaults printer subsystem

closes #3852
2015-09-24 14:59:05 +01:00
izeye
19cbe3ed49 Correct response code to align with sample in docs
Fixes #3854
2015-09-23 16:39:16 -07:00
Joao Duarte
112b28149e rename teardown to close
remove edge case when running from rubinius

add do_stop and do_close to avoid using super
2015-09-18 16:23:40 -04:00
Colin Surprenant
5adf2b0426 removed started? and use AtomicBoolean for ready?
cleanup @filter_to_output initialization

remove @run_mutex, use ready? to synchonize shutdown agains startup sequence

remove ShutdownSignal handling & cleanup
2015-09-18 16:22:50 -04:00
Joao Duarte
3bdac41a6c trigger input plugin shutdown using out of band call
Currently, during shutdown, the pipeline loops through input workers
and calls Thread.raise on each input thread. Plugins rescue that
exception to exit the `run` loop. Afterwards, `teardown` is called for
any additional bookkeeping.

This proposal exposes a `stop` call on the input plugin class to alert
an input that it should shutdown. It is the plugin job to frequently
poll an internal `stop?` method to know if it's time to exit and
terminate if so.

The `teardown` method remains to do the additional bookkeeping, and it
will be called by the inputworker when `run` terminates.

add concurrent-ruby as logstash-core dependency

make Plugins::Input#stop? public

In some scenarios it's necessary for the inputworker or the pipeline
to know that the plugin is in a shutdown mode

document why inputworker sleeps on StandardError

better debug message when input plugin raises exception during shutdown
2015-09-18 16:22:30 -04:00
Pier-Hugues Pellerin
186806d64c Cleanup of require-helper.rb
This file isn't used in the code at all, It was probably used at some
point but its not the case anymore.

Fixes #3938
2015-09-18 18:20:32 +00:00
Pier-Hugues Pellerin
0ae58804ee Remove multiqueue
This file was probably used at some point but its not the case anymore

Fixes #3939
2015-09-18 18:20:13 +00:00
Pier-Hugues Pellerin
fe68307991 Remove unused files
Remove related files for compiling the treetop grammar we have refactored the
makefile using rake. If you want to generate a new parser you can use
this command.

`rake compile:all`

Fixes #3941
2015-09-18 18:19:38 +00:00
Pier-Hugues Pellerin
aca58da536 sprintf should work if there is no fieldref in the string
Fixes #3937
2015-09-18 15:39:44 +00:00
Pier-Hugues Pellerin
935ac9285b String Interpolation skip the last character
This PR fix a problem when doing the interpolation with a string that
did not end with a fieldref but with a character. The interpolation was
ignoring the last character.

Example:
```
"%{type}|" => "syslog"
```

Fixes #3931

Fixes #3937
2015-09-18 15:39:44 +00:00
Suyog Rao
7f9e81727d Update to changes in 2.0 beta1
Fixes #3928
2015-09-16 14:16:54 +00:00
Pier-Hugues Pellerin
b863ace5ab Silence deprecation warnings from concurrent-ruby
Concurrent-ruby is throwing warning when running under jdk7,
we have decided to silence theses errors unless you run logstash with
the `--debug` flag.

Fixes #3869
2015-09-15 13:04:12 -07:00
Joao Duarte
6250a218a0 remove reference to git ls-files from plugin docs 2015-09-11 11:12:30 +01:00
Pere Urbon-Bayes
a3fc9476cc Fix the update command to only work with installed plugins gems so it's not having problems with not purged plugins
Fixes #3731
2015-09-11 06:49:54 +00:00
Paul Echeverri
705ca73939 Merge pull request #3832 from palecur/multilion
Adds new section on managing multiline events.
2015-09-04 16:21:43 -07:00
Paul Echeverri
11697efb2c typo fix 2015-09-04 16:14:59 -07:00
Paul Echeverri
ada3473e33 Adds note on tracking updates to MLCodec functionality 2015-09-04 10:49:33 -07:00
guyboertje
972302c494 Merge branch 'master' of github.com:elastic/logstash 2015-09-04 08:26:07 +01:00
Suyog Rao
309611ba52 Revert version change to 2.0.0.dev because plugins constraint checks fail
Fixes #3865
2015-09-03 20:16:45 +00:00
Suyog Rao
cfc147b611 Match Gemfile to reflect version change to 3.0.0.dev
Fixes #3864
2015-09-03 19:53:40 +00:00
Suyog Rao
bdacba71e3 Bump master to next version
Fixes #3863
2015-09-03 19:45:54 +00:00
guyboertje
7bb94d0692 add test for compact and compact! in java_integrations
Fixes #3772
2015-09-03 19:43:10 +00:00
guyboertje
e4d4c0cec8 add compact and compact! methods to java::util::Collection
Fixes #3772
2015-09-03 19:43:10 +00:00
Pier-Hugues Pellerin
9242ae551b Remove watchdog
This watchdog thread watching is currently unused and bugged in some
context, this PR remove any mention of it.

Ref #3828

Fixes #3830
2015-09-03 19:03:06 +00:00
guyboertje
a6ab581979 merged from upstream 2015-09-03 12:08:54 +01:00
Paul Echeverri
94a193847a Updates LSF vs. Multiline Codec caveat 2015-09-02 17:46:26 -07:00
Paul Echeverri
5c0e28a0cf Updates multiline use case description 2015-09-02 14:35:36 -07:00
Pere Urbon-Bayes
ae4c49be3b Exclude pre releases when checking if the update is targetting a major release in the plugin manager, as bundler is not going to update anyway to this version without an explicit install command.
Fixes #3826
2015-09-02 21:17:02 +00:00
Suyog Rao
568231816e Update ot JRuby 1.7.22
Fixes #3835
2015-09-02 20:54:50 +00:00
Suyog Rao
e2a5e92faf Jenkins: Ignore DynamoDB for now. Make sure all plugins tests pass
Fixes #3839
2015-09-02 17:53:26 +00:00
Jordan Sissel
bb0de88583 Update devutils to 0.0.15 or newer
This ensures we have a 'try' helper method in rspec

Fixes #3836
2015-09-01 23:07:03 +00:00
Paul Echeverri
f25b23498c Adds new section on managing multiline events. 2015-09-01 14:22:49 -07:00
Paul Echeverri
173ba00da8 Updates to Advanced Pipeline section.
Fixes #3809
2015-08-31 15:43:54 +00:00
Paul Echeverri
b2e2a59c8a Adds link to tutorial demo dataset.
Fixes #3809
2015-08-31 15:43:54 +00:00
Andrew Cholakian
c4d24c13ac Java bad version check should return a false, not nil
Fixes #3824
2015-08-31 14:16:14 +00:00
Andrew Cholakian
f2fcc41aee Non Oracle Javas are all detected as 'good'
Fixes #3824
2015-08-31 14:16:13 +00:00
Paul Echeverri
a23194c34c Fixes broken link to Watcher integration page
Fixes #3810
2015-08-28 00:57:29 +00:00
Paul Echeverri
dced1267b8 Updates introduction asciidoc
Fixes #3803
2015-08-27 21:47:27 +00:00
Paul Echeverri
f60df8137c Adds Alvin Chen's new introduction section to replace old Logstash reference's preface
Fixes #3803
2015-08-27 21:47:27 +00:00
Magnus Bäck
1d75bf47fa Docs: Clarify that strings can be either single or double quoted.
Fixes #3710
2015-08-20 23:49:03 +00:00
Pier-Hugues Pellerin
605d3faf08 Wrong date and added Elasticsearch upsert support
Fixes #3769
2015-08-20 21:52:21 +00:00
Pier-Hugues Pellerin
beae32b962 Update change log for 1.5.4 with the lumberjack changes concerning
dropped events
2015-08-20 10:38:34 -04:00
Pere Urbon-Bayes
028d76497c add the missing magic header # encoding: utf-8 so all internal strings are UTF-8 in Ruby < 2.0
Fixes #3723
2015-08-17 13:30:07 +00:00
Pere Urbon-Bayes
2b6485f28e add the magic header encoding: utf-8 in the string interpolation to be sure all is utf-8
Fixes #3718
2015-08-17 13:21:25 +00:00