Commit graph

1319 commits

Author SHA1 Message Date
Karen Metts
49131d826d
Doc: Clarify minimum privileges for logstash_writer role (#12613)
Fixes: #12612
2021-01-28 12:19:48 -05:00
andsel
7ba8c75458 Introduction of conditional in jvm.options file (#12530)
- moved parsing of jvm.options file into Java code
- chnaged the parsing code to consider conditional notation to bind the applicability of certain JVM flags to specific JVM versions
- changed the launch scripts (.sh and .bat) to use the options string composition
- binded CMS flags to JVM specifications 8-14
2021-01-25 05:16:18 -08:00
kaisecheng
4bc9dad69c
Remove ruby execution engine (#12517)
* remove Logstash::Pipeline
* remove logstash/event, Logstash::SignalEvent
* remove Engine.Ruby on java side
* remove config pipeline.java_execution
Fixed: #11236
2020-12-15 10:41:27 +01:00
Ry Biesemeyer
0ff682040d
plugin: adds :validate => :field_reference (#12459)
* plugin: adds `:validate => :field_reference`

Provide plugins a way of validating that an input is a literal field-reference.

This is useful for input plugins that implement a `target` or other
non-interpolated directive, and allows these plugins to reject invalid
configuration before start-up instead of at run-time.

Plugins should not use this named validator directly, as doing so would cause
validation to fail with "Unknown validator" when the plugin is run on older
releases of Logstash. Instead, plugins should use the `validator_support`
adapter mixin that provides back-ports when necessary.

Co-authored-by: Karen Metts <35154725+karenzone@users.noreply.github.com>
2020-12-14 22:05:34 -08:00
Andres Rodriguez
6d9ff9c880
Change text to use Elastic Cloud (#12404)
Make use of the term 'Elastic Cloud' as this is the term being used to refer to the service we provide.
2020-11-30 15:55:35 -05:00
kaisecheng
7cccf7ddc8
[Doc] Remove field reference parser (#12478)
Fixed: #12355
2020-11-26 14:16:07 +01:00
andsel
7db4692044 [Doc] expanded the description of how to obtain the logger's names form Java and Ruby class names 2020-11-25 03:12:59 -08:00
kaisecheng
69451e5017
clean up field-reference-parser (#12466)
remove field-reference-parser for version 8
Fixed: #12355
2020-11-24 17:58:10 +01:00
Karen Metts
6bb2bd6044
Doc: Add bundled JDK info (#12369)
Document options and impacts of bundled JDK
2020-11-05 12:24:11 -05:00
kaisecheng
1723dc547c
Doc: wildcards in xpack.management.pipeline.id (#12396)
document wildcard support in pipeline IDs
#12370
2020-11-05 17:19:50 +01:00
Karen Metts
4b163a9e91
Doc:Restructure troubleshooting docs and add plugin tracing (#12270)
Restructures troubleshooting docs in preparation for expanding content.
Adds info for plugin tracing to help users track down plugins that might be causing problems.

Co-authored-by: João Duarte <jsvd@users.noreply.github.com>

Fixes: #12228
2020-11-02 15:48:39 -05:00
Karen Metts
d7a9dcd887
[Doc]Relocate logstash-to-cloud topic for increased visibility (#11884)
Moves Cloud info to Configuration section to make it more obvious and easier to find
Expands content for using cloud id and cloud auth outside of modules
Moves module-specific info into modules section
2020-10-30 13:49:56 -04:00
kaisecheng
55637c8aaf
document system indices api privilege (#12391)
* update privilege requirement
2020-10-28 17:15:04 +01:00
kaisecheng
c0bbc94b26
document system indices api privilege (#12388)
* update privilege requirement
Co-authored-by: Karen Metts <35154725+karenzone@users.noreply.github.com>
2020-10-28 10:30:15 +01:00
Andres Rodriguez
5c4dd3c259
[doc] Add clarifying note to Logstash repo install
Add a note to the documentation to clarify that Logstash needs to be run as a service when installing from a package repository or a deb or rpm.
2020-10-19 17:52:59 -04:00
Karen Metts
96328aec34
Doc: Clarify use of queue max bytes setting (#12340)
Queue max bytes only applies to persistent queues
Forwardports: #12334 to master

Co-authored-by: rsdrakh <33121848+rsdrakh@users.noreply.github.com>
2020-10-13 15:37:33 -04:00
Rob Bavey
06af15030a
Write DLQ entries to temp file first (#12304)
* Write DLQ entries to temp file first

This commit changes the DLQ writer to write to a temporary file
 which will be renamed on "completion", to avoid the possibility
 of the DLQ reader reading an incomplete DLQ segment. The temp file
 will be renamed and made available, either when the capacity of this
 segment is reached, or if a configurable 'flush interval' has elapsed
 since the last event reached the dead letter queue.

This commit fixes #8022, #10275, #10967
This commit replaces #11127
2020-10-07 11:46:17 -04:00
Karen Metts
e8ec60882d
Doc:Increase visibility of offline plugin support (#12283)
Elevates visibility of Offline Plugin Management section so that air gapped users 
don't have to struggle through instructions that require an internet connection.

Related: #12280
2020-09-29 17:00:30 -04:00
Karen Metts
26de2cee46
Doc:Clarify how Bulk API interacts with DLQ (#12209)
Documents both HTTP success and HTTP failure scenarios.  

Co-authored-by: Author: Ry Biesemeyer <ry.biesemeyer@elastic.co>
2020-09-23 13:18:18 -04:00
Luca Belluccini
b7a0d9f9a1
[DOC] Logging settings can affect performances (#12246)
Logging settings can affect performances
2020-09-15 16:03:54 -04:00
Karen Metts
297a017ef7
Doc:Add redirect from multiline filter to multiline codec (#12208)
Add filebeat module use case

Co-authored-by: João Duarte <jsvd@users.noreply.github.com>
2020-09-02 10:36:55 -04:00
Karen Metts
616b573d3d Doc:Add note that stdin input doesn't allow config reloading 2020-08-20 15:15:33 -07:00
Karen Metts
8a3a732061 Doc:Adjust link for integration plugin header file 2020-08-06 07:16:01 -07:00
Karen Metts
7c6fca8425 Doc:Fix name of monitoring settings 2020-08-03 17:21:19 -07:00
Karen Metts
517923c15a Doc:Add monitoring and management to API key security content 2020-07-31 15:21:43 -07:00
Karen Metts
c07deffacb Doc:Fix link to monitoring docs and tag optional features 2020-07-29 16:31:52 -07:00
João Duarte
25b7d84ff8 Document use of keystore values in pipelines.yml 2020-07-22 13:43:56 -07:00
Karen Metts
d9953c6d1d Doc:Create a new header for integration plugins
Integration plugins need a different header. For example, the plugin docs should
to point to the integration repo rather than the input, output, filter, or codec
repo. The new header also includes boilerplate text to indicate that the individual
plugin is part of an integration rather than stand-alone. This work implements needed
changes.
2020-07-20 12:23:34 -07:00
Karen Metts
f27b45d60c Doc:Add info on reserved fields in events
Co-authored-by: Ry Biesemeyer <yaauie@users.noreply.github.com>
Fixes: 11946
2020-07-13 12:25:34 -07:00
Karen Metts
001cefcf86 Doc:Replace outdated pipeline viewer screenshot 2020-07-09 07:31:32 -07:00
DeDe Morton
f40d1faf73 [DOCS] Change links to refactored Beats getting started docs 2020-07-08 10:28:18 -07:00
Joao Duarte
67eb27428c update jruby to 9.2.12.0
Also tweak the documentation since most of the add-opens are no longer needed, except:

java.io due to colinsurprenant/jruby-stdin-channel#1
java.security due to jruby-openssl
java.nio.channels, sun.nio.ch, sun.management and java.io from jruby: https://github.com/jruby/jruby/blob/9.2.12.0/bin/.jruby.module_opts

Co-authored-by: Ry Biesemeyer <yaauie@users.noreply.github.com>
2020-07-08 04:57:39 -07:00
Karen Metts
587ff6921f Doc:Add deprecation notice to legacy collection
Resolves: #11979
2020-06-26 15:52:40 -07:00
Ry Biesemeyer
c70da3fb5c
plugin config: support space-deliminated URIs on list-type params (#12051)
* plugin config: support space-deliminated URIs on list-type params

Since whitespace is illegal in URIs, we can safely use it as a delimiter when
validating `list`-type `URI` params, enabling the expansion of an arbitrary
list of URIs from a single Environment- or Keystore-variable.

Resolves: https://github.com/elastic/logstash/issues/8157
Resolves: https://github.com/elastic/logstash/issues/6366

* Doc: Create section for cross-plugin functionality and add space delimiters

Co-authored-by: Karen Metts <karen.metts@elastic.co>
2020-06-26 14:44:46 -07:00
Karen Metts
7637a29887 Doc:Add info on using api keys for access
Co-authored-by: João Duarte <jsvd@users.noreply.github.com>
2020-06-26 08:24:51 -07:00
Lisa Cawley
ac6624923d
[DOCS] Fixes Stack Overview links (#12025) 2020-06-16 17:52:48 -07:00
Karen Metts
78c7204552 Doc:Add link to JVM section of support matrix
Add link to support matrix as official word on supported versions.
2020-06-12 08:00:16 -07:00
Karen Metts
9a7cca17f7 Doc:Add section and update JVM settings
This work breaks out the JVM setting info into a new section, and
expands and updates the content. It adds new subheadings to make
scanning the content easier.
2020-06-10 13:18:14 -07:00
Karen Metts
34ee17b0bf
Doc:Add section for conceptual info (#11715)
The LS reference needs a place to put conceptual info that transcends details for individual settings. This work creates and links the section, and adds content for pipeline ordering and Java pipeline initialization time.
2020-06-09 17:16:06 -04:00
Karen Metts
f3cb73f9eb Doc:Add section to security docs for API keys 2020-06-05 11:17:06 -07:00
andsel
9ce1934d7b [Doc] better specification of the behaviour of in operator in various contexts 2020-06-05 08:18:19 -07:00
andsel
9005ea82ec [Doc] added description of xpack.monitoring.elasticsearch.proxy
After the merge of PR #11799 to expose the ES proxy configuration the doc should be aligned
2020-06-05 07:49:51 -07:00
Colin Surprenant
f4ce80d956
add support for api_key authentication in xpack management and monitoring. (#11864) 2020-06-03 10:56:47 -04:00
Karen Metts
c86dafad5d merge 2020-05-19 00:28:45 +00:00
Karen Metts
12db1e8754 Doc:Replace cloud trial notice with attribute
Replaces free text with an attribute that pulls in shared content to
keep content up-to-date and consistent across documents.
2020-05-18 20:24:17 -04:00
Karen Metts
b9082b91ba Doc:Add deprecation notice for azure module 2020-05-13 16:36:28 -04:00
Karen Metts
d11b0491c7
Doc:Expand and clarify guidance for jvm settings (#11867)
Change fixed heap size recommendation to a percentage.
Note that large configs may require more stack space

Fixes: #11605 #11842
2020-05-06 17:41:08 -04:00
Karen Metts
a839868b18 Doc:Rename internal collection to legacy collection
Fixes #11858
2020-05-05 17:42:24 +00:00
Edu González de la Herrán
0856f7ddc9
[doc] missing role for config management integration (#10341)
logstash_admin role is not enough.
As the ls-security page mentions correctly:
"The user you specify here must have the built-in logstash_admin role as well as the logstash_writer role that you created earlier"

Updates static settings for extra role needed

Co-authored-by: Karen Metts <35154725+karenzone@users.noreply.github.com>
2020-04-30 13:43:53 -04:00
Karen Metts
6126e29043
[Doc]Remove new internal collection (#11823)
* [Doc]Remove new internal collection
2020-04-22 16:52:10 -04:00