Commit graph

1202 commits

Author SHA1 Message Date
Tal Levy
a7c602b8cc fix path to --allow-env I18n description
Fixes #5007
2016-04-04 21:43:57 +00:00
Andrew Cholakian
f4a07f90b1 Prevent config leak on output delegator close
On shutdown logstash may leak config information for outputs including
plaintext passwords

Fixes #5001
2016-04-04 21:19:15 +00:00
Tal Levy
ae53d5119f add experimental flag for environment variables in config
Fixes #4963
2016-04-04 18:45:13 +00:00
Andrew Cholakian
edd03d98bd Hide sensitive AST/config data unless --debug-config argument passed
We now hide this because displaying it is dangerous. Generated code
and other AST data may contain plaintext copies of 'password' type fields.
Users can force this to appear with the --debug-config flag.

Fixes https://github.com/elastic/logstash/issues/4964

Fixes #4965
2016-04-04 15:47:02 +00:00
Joao Duarte
120ca6d7fe test identity of generated conditional functions
Fixes #4970
2016-04-01 17:22:03 +00:00
Joao Duarte
46af6ce109 ensure cond_func methods are singletons
Fixes #4970
2016-04-01 17:22:02 +00:00
Joao Duarte
bb30cc773b move Pipeline#validate_config to Runner
Fixes #4946
2016-03-31 21:01:33 +00:00
Joao Duarte
f52820a58f fix --config-test and add a couple of tests
fixes #4933

Fixes #4946
2016-03-31 21:01:33 +00:00
Joao Duarte
6369a43c9d avoid reusing generic validation method during params securization
Fixes #4952
2016-03-31 19:15:31 +00:00
Joao Duarte
b0b7a8c5e9 ensure Plugin#original_params is obfuscated
Fixes #4952
2016-03-31 19:15:31 +00:00
Pere Urbon-Bayes
4dbbbde1fb bump jruby-monitoring version to >= 0.3.1 to include last fixes
Fixes #4911
2016-03-31 07:20:02 +00:00
Suyog Rao
e971dacfce Bump current master to 5.0.0.dev
Fixes #4906
2016-03-29 16:26:31 +00:00
Joao Duarte
563236649e fix race condition in agent spec
Fixes #4912
2016-03-29 14:41:42 +00:00
Andrew Cholakian
76f0dcc320 Revert to use only a single worker by default on outputs
The move to auto-scale output workers was great in theory, but a lot of outputs
just weren't built to support it well, they often used too many resources or had
logical errors.

Fixes #4904
2016-03-28 18:04:39 +00:00
Andrew Cholakian
b0f4d4e318 Fix threadsafe workers in output delegators to not instantiate extras
Fixes #4763
2016-03-24 18:59:18 +00:00
Joao Duarte
0dac96aa11 prevent reloading of configurations containing non reloadable plugins
Fixes #4884
2016-03-24 18:41:42 +00:00
Pier-Hugues Pellerin
15aed859de Update the gem.authors and gem.email with the Elastic information
Fix #4880
2016-03-23 17:36:10 -07:00
Pere Urbon-Bayes
bfd35a6e5c remove hot_threads ignore_idle_threads test
Fixes #4853
2016-03-21 15:37:58 +00:00
Pier-Hugues Pellerin
3b8d5a1f0b Make sure we clear the store before running the test
Fixes: #4824

Fixes #4839
2016-03-20 02:27:36 +00:00
Pere Urbon-Bayes
c233059d74 change JIT threads for pool threads in the idle threads check, due to the JIT threads not showing up randominly in some tests
Fixes #4833
2016-03-18 20:54:05 +00:00
Joao Duarte
23f0c5bcce expose reload_interval in Runner
Fixes #4831
2016-03-18 18:15:31 +00:00
Pere Urbon-Bayes
a860e5bc97 initial version for the _plugins api root resource
Fixes #4794
2016-03-17 11:00:04 +00:00
Suyog Rao
b9369abc0e Revert commit 4f7299a
Need to revert bump to 5.0.0.dev because individual plugins
will not install on top of this version.

In plugins' gemspec, the constraint is
`s.add_runtime_dependency "logstash-core", ">= 2.0.0", "< 3.0.0"`

This needs to be mass updated, and then bumped to 5.0.0

Fixes #4828
2016-03-17 02:12:56 +00:00
Joao Duarte
4f7299a555 bump to 5.0.0.dev
Fixes #4814
2016-03-17 00:02:03 +00:00
Pere Urbon-Bayes
42710a4ffd add expectations for json and plain text responses for the hot threads api tests
format test properly for the node_spec api

Introduce a more proper organization of the dummy/mock runner to avoid
having wrong state propagaged across the different tests. This was
discovered by the unnecessary need to have the rubydebug codec as it was
due to wrong pipeline startup.

make the node stats test sync with last changes in data formats

improve web api service logic from reviews

remove the requirement of using output-null as only with output {} you get the same effect

Fixes #4782
2016-03-14 14:07:25 +00:00
Pere Urbon-Bayes
7f112bccff fix issue with unhandled requests prior to shutdown by puma
Fixes #4782
2016-03-14 14:07:25 +00:00
Pere Urbon-Bayes
79e2d0040f Make sure all web api test are actually going through the hole pipe and getting data out of a real logstash execution.
Test improvements:

* Cleanup non used fixture.
* Improve node_stats tests by adding omre context and format checks.
* Add a new node_specs endpoint test that checks the expected data is
  returned for the hot_threads resource.

Fixes #4782
2016-03-14 14:07:25 +00:00
Pier-Hugues Pellerin
5ce51933b6 Missing a method for the delegator test
Fixes #4802
2016-03-11 21:14:25 +00:00
Pier-Hugues Pellerin
e3231a0c31 Add test for the filter delegator
Fixes #4802
2016-03-11 21:14:25 +00:00
Pier-Hugues Pellerin
04b2b72cbd Adding more test to test the flow of the metrics inside the pipeline_spec
This an integration test where the pipeline should emit specific
metrics. Also fix an issue of the output delegator not correctly
recording the metrics.

Normalize the naming of the metrics collected at the plugin level
following #4492

Fixes #4802
2016-03-11 21:14:25 +00:00
Pere Urbon-Bayes
ee690ac3ee make sure _stats and _node/stats data format is the same
Fixes #4780
2016-03-11 19:31:14 +00:00
fbaligand
587db82c15 add complementary tests to 'environment variable evaluation'
Fixes #3944
2016-03-07 10:58:38 -08:00
Jordan Sissel
f644df6732 Use structured logging. 2016-03-07 10:58:17 -08:00
Jordan Sissel
d45e303dca Make ${FOO} evaluation fail if FOO is not an environment variable
This updates the specs to cover this expectation. It also makes
assertions about default values if a default `${FOO:default value}` is
given.

Specs pass for me (18 specs)

(Improves on #4710)
2016-03-07 10:58:17 -08:00
Jordan Sissel
7f6bb9a782 Small refactor to use String#gsub and named captures for text replacements.
The config/mixin_spec.rb specs are passing for me (20 of 20 passing)

(Improves upon #4710)
2016-03-07 10:58:17 -08:00
fbaligand
9b89b884a0 Fix issue #3944 : Add support for environment variable injection in logstash plugin configuration 2016-03-07 10:58:17 -08:00
Joao Duarte
592835cea2 improve pipeline start and stop logging
Fixes #4764
2016-03-07 11:54:18 +00:00
Andrew Cholakian
4835024598 Fix oops backtrace logging, it should be structured
Fixes #4717
2016-02-26 18:53:56 +00:00
Pier-Hugues Pellerin
82dde31afe Fix an issue with the expectation on the agent#uptime
Fixes #4687

Fixes #4653
2016-02-12 19:00:11 +00:00
Pere Urbon-Bayes
7cdd77b822 make default values constants inside the webserver
Fixes #4685

Fixes #4653
2016-02-12 19:00:11 +00:00
Pere Urbon-Bayes
b400fbabbb make sure webapp config file is added so rack can handle it properly inside the packaged builds
Fixes #4685

Fixes #4653
2016-02-12 19:00:11 +00:00
Pere Urbon-Bayes
459fad4738 cleanup non used expectation inside the jvm specs
Fixes #4683

Fixes #4653
2016-02-12 19:00:11 +00:00
Pere Urbon-Bayes
fecf02401c Cleanup debug variable used inside the pipeline and also fixed small typo in the memory command.
Fixes #4681

Fixes #4653
2016-02-12 19:00:11 +00:00
Pere Urbon-Bayes
e24fcdd8c1 make default bind to 127.0.0.1
Fixes #4676

Fixes #4653
2016-02-12 19:00:11 +00:00
Pere Urbon-Bayes
a1b01d31c1 fix typo in the thread report for hot threads
Fixes #4676

Fixes #4653
2016-02-12 19:00:11 +00:00
Pere Urbon-Bayes
5b0c136e37 add an http-host option to bind to something else than 0.0.0.0 (default), also cleanup a bit the webserver logging code from unnecessary options
Fixes #4676

Fixes #4653
2016-02-12 19:00:11 +00:00
Pere Urbon-Bayes
5396dc505f make sure puma is >= 2.16
Fixes #4676

Fixes #4653
2016-02-12 19:00:10 +00:00
Pere Urbon-Bayes
93a3baa007 add human version to not_found error and rescue errors on webserver
Fixes #4662

Fixes #4653
2016-02-12 19:00:10 +00:00
Pere Urbon-Bayes
effff76588 ammend the way we show idle threads to skip as idle internal JVM threads, Ruby JIT threads and internal thread pool ones, also the concurent tasks ones used by jruby.
added comments to describe what we skip as idle and why inside the hot threads api

Fixes #4662

Fixes #4653
2016-02-12 19:00:10 +00:00
Pere Urbon-Bayes
a3280d345a add default content for not found errors
ignore waiting threads in the hotthreads and also add back the default threads number to 3

Fixes #4662

Fixes #4653
2016-02-12 19:00:10 +00:00