Commit graph

9470 commits

Author SHA1 Message Date
Karen Metts
832310690d
[Doc]Doc updates for internal collectors (#11789)
* Doc updates for internal collectors

* Incorporate review comments

* More review comments
2020-04-16 17:06:28 -04:00
Karol Bucek
afce87a67e Fix: cloud_id not propagating from monitoring config
Fixes #11800
2020-04-16 18:52:42 +00:00
Joao Duarte
6cc4de77e3 update guava and httpclient dependencies
Fixes #11791
2020-04-15 13:49:54 +00:00
Karen Metts
cda5f5d17e
Add redirects page (#11790) 2020-04-15 09:45:26 -04:00
Andrea Selva
6a74872d50
Moved code out of LogStash::Compiler to org.logstash.config.ir.ConfigCompiler 2020-04-15 12:21:39 +02:00
Karen Metts
0b58ca641b
Fix typo in pipeline ordered description (#11763) 2020-04-14 17:40:02 -04:00
Karen Metts
081ec78168
[Doc]Restructure monitoring docs to support new and legacy internal collectors (#11714)
* [Doc] added description of xpack.monitoring.collection.write_direct.enabled setting

* Added page to mark as deprecated the legacy internal collector and fixed all the `xpack.monitoring.*` references

* Included legacy collector file into monitoring overview

* Restructure monitoring docs

* Incorporate review comments

Co-authored-by: andsel <selva.andre@gmail.com>
2020-04-14 15:47:56 -04:00
Ry Biesemeyer
0b22b00893
support Environment and Keystore substitutions in password-type plugin options (#11774)
Resolves: https://github.com/elastic/logstash/pull/10583
Co-authored-by: Tyler Gregory <td.g@icloud.com>
2020-04-13 17:28:18 -07:00
Rob Bavey
2899c9f379 Handle Boolean Edges
Fixes #11779
2020-04-13 20:09:27 +00:00
Rob Bavey
830b6ce64e Remove separator vertices and associated edges from serialized output
The separator vertices are an implementation detail of the serialized
output of the LIR, and are not meaningful to the pipeline viewer.

This commit removes the separator vertices, and reworks the edges to
account for this.

Fixes #11779
2020-04-13 20:09:27 +00:00
Andres Rodriguez
2677de65d8 [doc] Change plugin name from java_sink to sink
In the docs templating, the plugin name is used to autogenerate a code example of how
to configure specific plugin. As such, if a plugin name is different from how you
configure it, this results in an example of how to configure this plugin with an
incorrect name.

This changes the java_sink plugin name to sink to correctly autogenerate the example.

Fixes: #11675, Fixes: #11214
2020-04-13 15:31:27 -04:00
Karen Metts
13ae7bb03a
[Doc]Note that unit qualifier is required for config.reload.interval (#11771)
* Note that unit qualifier is required for config.reload.interval

* Update description in logstash.yml
2020-04-13 14:48:03 -04:00
Rob Bavey
5e6065f414 Incorporate review comments
Fixes #11777
2020-04-13 14:11:07 +00:00
Rob Bavey
54c451f48d Fix hard coded constraint on pipeline name for metrics
Fixes #11777
2020-04-13 14:11:07 +00:00
João Duarte
3a84beda3d
remove :cluster_uuids gauge (#11628) 2020-04-13 09:36:11 +01:00
Ry Biesemeyer
70f4c3294f performance: share a single secret store
Loading a Java Keystore can take anywhere from ~0.3s to upwards of 3s, so the
pattern of loading one per variable we need to replace adds a significant
amount of overhead on pipelines that use these variables, whether or not they
are provided by the keystore.

By providing a private, constant, lazy singleton, we ensure that we don't
incur the cost of repeatedly building the keystore.

Fixes #10794
2020-04-10 15:41:17 +00:00
Andrew Pan
8793fb3c49
Update local.rb for pipe file (#11109)
Load pipe file for process communication

Co-authored-by: Andrew Pan <px2557@foxmail.com>
2020-04-10 09:52:12 +02:00
Andrea Selva
1971e9e8ee
Defined the versions of JDK to use in test build separated by OS (#11768) 2020-04-09 18:58:24 +02:00
Joao Duarte
de0b22f9cb release notes script add version in plugin entries
Fixes #11769
2020-04-09 12:55:57 +00:00
João Duarte
128bee592b
update benchmark cli dependencies (#11766)
also use jackson version in benchmark-cli from versions.yml
2020-04-08 14:55:17 +01:00
Rob Bavey
58314a7f0e
Update gradle version to 6.3 (#11742)
* Update gradle version to 6.3

Gradle versions prior to 6.3 cannot run under JDK14.
This commit upgrades the version of Gradle to 6.3, and removes all deprecation warnings that can currently be removed.

Changes include:
* Increase gradle memory to 2g
* Increase gradle memory in the license check job to 2g
* Replace use of `testCompile`
* Replace `runtime` with `runtimeOnly`
* Remove`compile` depedencies from gradle files
* Replace deprecated archive methods
* Fix dependencies report build
* Make jruby dependencies 'api', fix archiveVersion
* Set `duplicatesStrategy` for all tasks of type Copy
* Use `configureEach` for global 'withType' calls
** Use the recommended Tasks API calls
(https://blog.gradle.org/preview-avoiding-task-configuration-time)
* Run `./gradlew wrapper` earlier to improve caching
* Use copy with chown for resources that need to be run during `./gradlew wrapper`
2020-04-07 12:49:36 -04:00
Karen Metts
290daa45f3 Incorporate review comments
Fixes #11716
2020-04-03 17:02:23 +00:00
Karen Metts
284989f542 Add guidelines for setting jvm heap size
Fixes #11716
2020-04-03 17:02:23 +00:00
Colin Surprenant
5a25c6f8e9 simplify batch classes, do not compute JE empty batches, refactor RE worker loop (#11737)
cleanup RubyArray "rawtypes"
remove all LinkedHashSet from batch and queue classes
avoid processing empty batches in Java worker loop
cleanup AckedReadBatch and MemoryReadBatch
refactor Ruby worker loop similar to Java Execution to not use batch merge
remove QueueBatch merge and replace LinkedHashSet with ArrayList
2020-04-02 16:26:54 -04:00
Luca Belluccini
5de9b237e3 Better wording thanks to Andrea Selva
Fixes #11685
2020-04-01 13:09:13 +00:00
Luca Belluccini
b2332cb015 Clarify behavior in case of PQ full & isolator pattern
Fixes #11685
2020-04-01 13:09:13 +00:00
Karol Bucek
24d3348776 Refactor: avoid array in case of single event
while also making the array case cleaner & effective

(JRuby uses specialized array holder for 1 / 2 values)

+ Refactor: minor - use true/false constants directly
+ Refactor: do not allocate empty array

Fixes #11732
2020-04-01 07:37:02 +00:00
andsel
b2d1b880a6 Introduced JDK environment variable to explicitly pass the JAVA_HOME to use, expanded Xmx usable by Gradle
Fixes #11708
2020-03-30 10:53:18 +00:00
Colin Surprenant
dbca0b36a1
separate filter & output execution, rebatch after filter when ordered (#11710) 2020-03-27 15:36:23 -04:00
Karol Bucek
aa931661c6 Updated: JRuby to 9.2.11.1
Fixes #11723
2020-03-26 11:35:02 +00:00
João Duarte
d522a7cb30
bring back unicode trimmer for LogStash::Util (#11712)
this is used by the SNS output:
5b796a0095/lib/logstash/outputs/sns.rb (L98)
2020-03-23 15:11:54 +00:00
andsel
70da647f54 Simplified if..else if in PluginFactory for Java plugins part, moved to template method pattern
Fixes #11457
2020-03-20 09:43:43 +00:00
Karen Metts
8f665de926 Expand section on force reloading config
Fixes #11699
2020-03-18 13:12:33 +00:00
Colin Surprenant
9126fdb7e0
support quoted plugin option key (#11688) 2020-03-16 16:58:01 -04:00
andsel
86a3ab994c minor, used the correct placeholder
Fixes #11691
2020-03-16 16:35:04 +00:00
Mark Ramotowski
6486624ee7 Fixed typo in guage metric of unknown type log.
Fixes #11689
2020-03-16 09:19:28 +00:00
j-yama
c740b23375 Add sudo into the rpm import of GPG-KEY
Fixes #11684
2020-03-16 06:54:02 +00:00
andsel
4e4a3c6dad Added clarification that configuration force reload doesn't work on WinOS
Fixes #11520
2020-03-13 08:40:47 +00:00
Karen Metts
0336130030 Change default threads for azure module
Fixes #11664
2020-03-12 22:36:07 +00:00
Joao Duarte
53d4a78ce8 ensure mavencentral is always used before plugins.gradle.org
Fixes #11682
2020-03-12 12:04:54 +00:00
andsel
dfdc6f2aac Fixed flaky test, as fixed in packport PR #11641
Fixes #11679
2020-03-12 09:00:49 +00:00
Karen Metts
3ac8aa2df6 Update troubleshooting.asciidoc
Fixes #11545
2020-03-11 14:23:47 +00:00
andsel
64330abc51 Removed errored CLI flag description
Fixes #11545
2020-03-11 14:23:47 +00:00
andsel
850222475d Minor, added suggestion to switch on the log per pipeline
Fixes #11545
2020-03-11 14:23:47 +00:00
Karen Metts
edc5915b22 Add tips for troubleshooting a pipeline
Fixes #11545
2020-03-11 14:23:47 +00:00
João Duarte
e9c9865f40
Add apache and elastic license headers to source code files (#11673)
* add license header to ruby and java files
* add license header to erb and rake files
* add license headers to gradle files
2020-03-11 11:53:38 +00:00
Kris Reberger
b6d9bbefe9 Update to include verification mode switch
As of 6.4.1 (https://www.elastic.co/guide/en/logstash/6.4/logstash-6-4-1.html#logstash-6-4-1 and https://github.com/elastic/support-dev-help/issues/4770), we allow setting the monitoring and management ssl verification to either certificate or none, with certificate being the default.

Fixes #11674
2020-03-10 22:20:23 +00:00
Karen Metts
dddbab7270 Wording tweak for more emphasis
Fixes #10717
2020-03-10 21:22:04 +00:00
Ryan Earle
07312ec665 Update logging.asciidoc
Fixes #10717
2020-03-10 21:22:03 +00:00
meshkov
bb534acbea Update offline-plugins.asciidoc
Fixes #10912
2020-03-10 21:02:34 +00:00