Commit graph

137 commits

Author SHA1 Message Date
Dan Hermann
d397d3b80c
[7.x] Configurable media_type for mustache template encoding on append processor (#76386) 2021-08-11 17:30:32 -05:00
James Rodewig
4d881f57e1
[DOCS] Correct spelling for geo terms (#76028) (#76032)
Changes:
* Use "geopoint" when not referring to the literal field type
* Use "geoshape" when not referring to the literal field type or query type
* Use "GeoJSON" consistently
# Conflicts:
#	docs/reference/ingest/processors/enrich.asciidoc
2021-08-03 10:08:52 -04:00
James Rodewig
302a99bf83
[DOCS] Fix extracted date (#75918) (#75976)
In the example, we have a date with year `2018` but the extracted date is `1998`.

Co-authored-by: David Pilato <david@pilato.fr>
2021-08-02 12:59:41 -04:00
Dan Hermann
3401c33c1a
[DOCS] Add MurmurHash3 as a supported hash method for fingerprint processor (#70737) (#75235) 2021-07-12 08:27:02 -05:00
elasticsearchmachine
55625bba6f
[7.x] Support for wildcards and override option for dot_expander processor (#75132) 2021-07-08 15:58:12 +02:00
elasticsearchmachine
dc9d837a12
Json processor: add_to_root_conflict_strategy option (#75131) 2021-07-08 15:40:31 +02:00
elasticsearchmachine
d855d82284
[7.x] Json processor: allow duplicate keys (#74956) 2021-07-06 16:37:13 +02:00
Martijn van Groningen
8716b396fe
Enable GeoIP downloader by default (#74600)
Backporting #74323 to 7.x branch.

This change will enable geoip downloader by default again. It also brings back relevant documentation.

Co-authored-by: Przemko Robakowski <przemko.robakowski@elastic.co>
2021-06-28 10:01:51 +02:00
Dan Hermann
2ece2cd7d5
Add template snippets support for KV ingest processor (#73758) (#74508) 2021-06-23 13:04:17 -05:00
James Rodewig
917154bf88
[DOCS] Note ESS must use custom bundles for custom GeoIP database files (#73978) (#74129)
Co-authored-by: James Rodewig <40268737+jrodewig@users.noreply.github.com>

Co-authored-by: Jennie Soria <predogma@users.noreply.github.com>
2021-06-15 09:47:25 -04:00
James Rodewig
7468045329
[DOCS] Add missing comma (#73577) (#74077)
Missing comma in example

Co-authored-by: Ming Liang <42666128+zethsqx@users.noreply.github.com>
2021-06-14 11:20:42 -04:00
Adam Locke
60cad596fc
[DOCS] [7.x] Create a new page for grok content in scripting docs (#73118) (#73495)
* [DOCS] [7.x]  Create a new page for grok content in scripting docs (#73118)

* [DOCS] Moving grok to its own scripting page

* Adding examples

* Updating cross link for grok page

* Adds same runtime field in a search request for #73262

* Clarify titles and shift navigation

* Incorporating review feedback

* Updating cross-link to Painless

* Adding doc type to response
2021-05-27 16:14:03 -04:00
Przemko Robakowski
b8387b1c76
Disable GeoIP downloader (#72716) (#72879)
Due to problems discovered in #72572 we have to disable geoip downloader for now. We use ingest.geoip.downloader.enabled.default as feature flag.
This change also reverts changes to docs.
2021-05-10 14:19:37 +02:00
James Rodewig
b187c7507a
[DOCS] Refactor script processor docs (#72691) (#72719) 2021-05-04 18:39:42 -04:00
Yang Wang
6ead5cc400
Expose API Key metadata to SetSecurityUser ingest processor (#72137) (#72439)
This PR ensures SetSecurityUserProcessor adds the API key metadata
inside the existing api_key object if the metadata is not null or empty.
2021-04-29 16:45:13 +10:00
Dan Hermann
23d9b9b3c6
[7.x] Option to disable device type parsing in user agent processor (#71625) (#71970) 2021-04-20 16:08:34 -05:00
Dan Hermann
0d87318a0c
[7.x] Extract device type from user agent info (#69322) (#71952) 2021-04-20 12:01:10 -05:00
James Rodewig
031f49cf4e [DOCS] Fix case of network direction processor title 2021-04-19 10:18:21 -04:00
Przemko Robakowski
d7f7cbb776
[7.x] Update GeoIP processor documentation (#71211) (#71757)
* Update GeoIP processor documentation (#71211)

This PR adds documentation for GeoIPv2 auto-update feature.
It also changes related settings names from geoip.downloader.* to ingest.geoip.downloader to have the same convention as current setting.

Relates to #68920

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
Co-authored-by: James Rodewig <40268737+jrodewig@users.noreply.github.com>
2021-04-15 20:55:48 +02:00
Dan Hermann
e093b46503
[7.x] Network direction processor additions (#71692) 2021-04-14 11:49:52 -05:00
James Rodewig
79027377b8
[DOCS] Use HTML-unescaped Mustache variables in ingest pipelines (#71360) (#71368) 2021-04-06 15:47:09 -04:00
James Rodewig
c757f9e4e7
[DOCS] Fix double spaces (#71082) (#71120) 2021-03-31 11:43:34 -04:00
Ignacio Vera
6343c18f72
Fix infinite loop when polygonizing a circle with centre on the pole (#70875) (#70957)
This PR prevents the algorithm to run on circles that contain a pole.
2021-03-29 08:39:37 +02:00
James Rodewig
8522b87ce9
[DOCS] Document ingest processor description (#70899) (#70914) 2021-03-26 10:09:12 -04:00
István Zoltán Szabó
591e93397a
[DOCS] Removes beta labels from DFA related docs. (#70808) (#70902) 2021-03-26 10:25:36 +01:00
James Rodewig
994811584a
[DOCS] Move enrich policy object def to API docs (#70825) (#70866) 2021-03-25 09:32:29 -04:00
Dan Hermann
6d16d64eb5
[DOCS] IP type for convert processor (#70599) (#70669) 2021-03-22 11:54:08 -05:00
Adam Locke
ab6eba4662
[DOCS] [7.x] Focus scripting docs on Painless (#69748) (#70588)
* Initial changes for scripting.

* Shorten script examples.

* Expanding types docs.

* Updating types.

* Fixing broken cross-link.

* Fixing map error.

* Incorporating review feedback.

* Fixing broken table.

* Adding more info about reference types.

* Fixing broken path.

* Adding more info an examples for def type.

* Adding more info on operators.

* Incorporating review feedback.

* Adding notconsole for example.

* Removing comments in example.

* More review feedback.

* Editorial changes.

* Incorporating more reviewer feedback.

* Rewrites based on review feedback.

* Adding new sections for storing scripts and shortening scripts.

* Adding redirect for stored scripts.

* Adding DELETE for stored script plus link.

* Adding section for updating docs with scripts.

* Incorporating final feedback from reviews.

* Tightening up a few areas.

* Minor change around other languages.

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2021-03-18 17:33:44 -04:00
Dan Hermann
00e7c1764e
[7.x] [DOCS] Fingerprint ingest processor (#70456) 2021-03-16 08:40:27 -05:00
James Rodewig
b95afd9ddf
[DOCS] Refactor ingest pipeline docs (#70253) (#70409) 2021-03-15 14:12:11 -04:00
Dan Hermann
b0576bd4f5
[7.x] [DOCS] Network direction processor (#67943) (#70413) 2021-03-15 12:17:02 -05:00
James Rodewig
e83233c7af
[DOCS] Fix URI processor title (#66068) (#70382) 2021-03-15 09:15:22 -04:00
Dan Hermann
5217131872
[DOCS] URI parts processor (#65695) (#70352) 2021-03-12 07:04:49 -06:00
Dan Hermann
785a17c687
[DOCS] Network community ID processor for ingest pipelines (#66592) (#70021) 2021-03-05 07:55:37 -06:00
Lisa Cawley
1430e52669
[DOCS] Adds model alias to inference processor and agg (#69576) (#69577) 2021-02-24 16:49:45 -08:00
Dan Hermann
ff80dc074c
[7.x] Configurable media type for mustache template encoding on set processor (#68952) 2021-02-12 10:52:32 -06:00
debadair
adf3d42792
[DOCS] Removed license level information. (#68568) (#68569) 2021-02-04 18:55:41 -08:00
Dan Hermann
4e66094dc5
[DOCS] mime_type property for Set processor (#67452) (#68475) 2021-02-03 12:14:36 -06:00
István Zoltán Szabó
2f7240d271
[DOCS] Improves inference processor linking and docs (#66119) (#66983) 2021-01-05 14:04:51 +01:00
Dan Hermann
11dd465610
[7.x] Add copy_from parameter for set ingest processor (#63540) (#66202) 2020-12-11 08:11:38 -06:00
Jason Tedor
2dda727f35
Clarify ingest-geoip database_file docs (#64340)
The docs for the geoip processor database_file option appear to indicate
that all geoip databases are in the config directory. This is leftover
legacy from when this was the case when ingest-geoip was a plugin, but
it is no longer true as the built-in databases now ship inside the
ingest-geoip module that is bundled by default. This commit clarifies
those docs.

Co-authored-by: Jakob Reiter <jakommo@users.noreply.github.com>
2020-10-29 13:29:47 -04:00
István Zoltán Szabó
b822e582c3
[DOCS] Changes experimental flag to beta in DFA related docs (#63992) (#64176) 2020-10-26 18:04:21 +01:00
Dan Hermann
4eee270e61
[DOCS] allow_duplicates option for append processor (#62336) (#63576) 2020-10-12 15:47:47 -05:00
Jake Landis
0795f4b898
[7.x] Add network from MaxMind Geo ASN database (#61676) (#62898)
This adds the network property from the MaxMind Geo ASN database. 
This enables analysis of IP data based on the subnets that MaxMind have 
previously identified for ASN networks.

closes #60942

Co-authored-by: Peter Ansell <p_ansell@yahoo.com>
2020-10-01 11:01:44 -05:00
Dan Hermann
fbf552d24c
Add country_name to the default properties of geoip ingest processor (#62915) (#63124) 2020-10-01 08:47:51 -05:00
Lisa Cawley
3838fe1fd4 [DOCS] Add experimental tag to inference processor and bucket aggregation (#63023) 2020-09-30 08:51:26 -07:00
James Rodewig
803f1ec897
[DOCS] Updated target_field description of the json ingest processor (#61968) (#63068)
Co-authored-by: Dan Hermann <danhermann@users.noreply.github.com>
Co-authored-by: Jakob Reiter <jakommo@users.noreply.github.com>
2020-09-30 09:04:59 -04:00
Dan Hermann
c9be9963a8
[DOCS] Sort option for the grok patterns endpoint (#62092) (#62982) 2020-09-29 09:40:54 -05:00
Dan Hermann
e1a4a3073a
[DOCS] Configurable output format for date processor (#61440) (#62630) 2020-09-18 09:00:52 -05:00
James Rodewig
ccbe2938c8
[DOCS] Fix Gsub processor snippet (#61720) (#61723) 2020-08-31 10:43:26 -04:00