Commit graph

7921 commits

Author SHA1 Message Date
Dan Hermann
f63a3b5cdc
Remove the deprecated local parameter for _cat/shards (#64867) 2020-11-13 07:34:15 -06:00
Lee Hinman
bf63edde8d
Mark component and composable index template APIs as stable (#65013)
These were previously marked as experimental, but as we have not had any changes made or needed, we
are marking these as stable.
2020-11-12 14:16:57 -07:00
Adam Locke
9fdcd79927
Explicitly defining types for sources parameter (#65006) 2020-11-12 16:09:04 -05:00
James Rodewig
68cf6b64b7 [DOCS] Fix redirect syntax 2020-11-12 12:13:28 -05:00
Dan Hermann
c829f8edd1
Remove deprecated _upgrade API (#64732) 2020-11-12 11:09:56 -06:00
Benjamin Trent
33de89d94c
[ML] add new snapshot upgrader API for upgrading older snapshots (#64665)
This new API provides a way for users to upgrade their own anomaly job
model snapshots.

To upgrade a snapshot the following is done:
- Open a native process given the job id and the desired snapshot id
- load the snapshot to the process
- write the snapshot again from the native task (now updated via the
  native process)

relates #64154
2020-11-12 10:45:56 -05:00
István Zoltán Szabó
db15c4d6b9
[DOCS] Adds scroll_size maximum value to datafeeds API docs (#64986) 2020-11-12 15:53:53 +01:00
Martijn van Groningen
6f9f3e5054
Improve error message in case of invalid dynamic templates (#60870)
Include the attempted 'match_mapping_type' into the message,
so that it is clearer that multiple validation attempts have occurred.

Dynamic template validation was recently added via #51233 and
there was some confusion over the deprecation message itself.
(in 7.x only deprecation warning will be omitted and from 8.0
 an error will be returned)
2020-11-12 15:03:08 +01:00
James Rodewig
1f8d1e9ee1
[DOCS] Fix indentation (#64941) (#64962)
Co-authored-by: kemalizing <36174398+kemalizing@users.noreply.github.com>
2020-11-12 08:47:20 -05:00
Andrei Dan
7d45355604
ILM: Add support for the searchable_snapshot action in the hot phase (#64883)
This adds support for the searchable_snapshot ILM action in the hot phase.

We define a series of actions that cannot be executed after the index has been
mounted as a searchable snapshot. Namely: freeze, forcemerge, shrink,
and searchable_snapshot (also available in the cold phase).

If by virtue of snapshot/restoring a managed index or updating an ILM policy while it
is executing for an index, these actions could get to be executed on an index that was
mounted as searchable snapshot in the hot phase. If this happens the actions will
skip entirely. ILM will not move into the ERROR step.
2020-11-12 10:44:04 +00:00
debadair
92efa3a0f3
[DOCS] Make system & hidden index info more prominent. (#64839)
* [DOCS] Make system & hidden index info more prominent.

* Update docs/reference/api-conventions.asciidoc
2020-11-11 10:35:02 -08:00
István Zoltán Szabó
9ed907bc75
[DOCS] Fixes example aggregation syntax in datafeed aggregations. (#64936) 2020-11-11 16:33:36 +01:00
James Rodewig
44456ed777
[DOCS] Add heading and anchor to reindex with ingest pipeline section (#64835) (#64894)
Co-authored-by: James Rodewig <40268737+jrodewig@users.noreply.github.com>

Co-authored-by: Mark Walkom <markw@elastic.co>
2020-11-10 17:24:01 -05:00
debadair
fd11233ed7
[DOCS] Add system & hidden indices definitions. (#64834)
* [DOCS] Add system & hidden indices definitions.

* Update docs/reference/glossary.asciidoc

* Update docs/reference/glossary.asciidoc

Co-authored-by: Lisa Cawley <lcawley@elastic.co>

* Update docs/reference/glossary.asciidoc

* Update docs/reference/glossary.asciidoc

Co-authored-by: Lisa Cawley <lcawley@elastic.co>
2020-11-10 13:03:14 -08:00
debadair
7bf35ffe86
[DOCS] Add data tier defs (#64838)
* [DOCS] Add data tier defs

* Add hot tier def
2020-11-10 10:14:26 -08:00
Christos Soulios
66b5e4ec89
Implement aggregations on aggregate metric fields (#56745)
In the process of developing a new implementation for the Elasticsearch Rollups functionality we came up with the concept of the aggregate metric field type.

The aggregate_metric_double field type can store the results of aggregations (currently min, max, sum, value_count and avg are supported - more to come).

This field allows us to run (min, max, sum, value_count, avg) aggregations on the container field and the field will return the correct metric depending on the aggregation that is computed.
2020-11-10 19:31:59 +02:00
James Rodewig
cb26c542ce
[DOCS] Document get pipeline API as multi-target (#64816) 2020-11-09 16:11:13 -05:00
Dan Hermann
fae9b06cd5
Adjust deprecation version after backport (#64794)
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2020-11-09 13:43:47 -06:00
Dan Hermann
82242f7c3f
Adjust deprecation version after backport (#64789) 2020-11-09 13:43:24 -06:00
Leaf-Lin
2bf3e36144 remove node.ingest setting in the documentation (#64456)
I'm not sure if this setting was left here deliberately? or by accident?
With all other node role definition has changed syntax from `node.xxx` to `node.roles: [ ]`, the ingest one is the only one left behind.
2020-11-09 12:21:43 -07:00
James Rodewig
b31a8ff244
[DOCS] Fix put repository API docs (#64811) 2020-11-09 14:20:08 -05:00
James Rodewig
7ed7a9584e
[DOCS] Fix typo (#64675) (#64799)
Co-authored-by: Ashish Jayan <58534490+chasexd@users.noreply.github.com>
2020-11-09 11:12:46 -05:00
James Rodewig
b31c235f58
[master] [DOCS] Remove unneeded period (#64687) (#64790)
Co-authored-by: Johannes Mahne <johannes.mahne@elastic.co>
2020-11-09 11:07:36 -05:00
James Rodewig
357ab0073e
[DOCS] Improve docs for Windows DOS/UNC paths in path.* settings (#64668) 2020-11-09 10:36:48 -05:00
bellengao
e712243a24
[DOCS] Format the data tier allocation doc (#64722) 2020-11-09 10:19:43 -05:00
Henning Andersen
be9725245d
Autoscaling delete policy by simple pattern (#64739)
Added the capability to delete autoscaling policies by pattern, allowing
to for instance do:
```
DELETE _autoscaling/policy/*
```
to delete all autoscaling policies. If a wildcard is involved, no
matches are required.
2020-11-09 15:44:33 +01:00
Bogdan Pintea
6a92b3ec7c
SQL: Remove constant_keyword from SQL docs (#64709)
* Remove constant_keyword from SQL docs

`constant_keyword` removed as distinct type from SQL in #60524.

Co-authored-by: James Rodewig <40268737+jrodewig@users.noreply.github.com>
2020-11-06 20:07:30 +01:00
Lisa Cawley
919c79b745
[DOCS] Add custom feature processor example (#64681) 2020-11-06 09:24:01 -08:00
James Rodewig
fb1936bed1
[DOCS] EQL: Fix tiebreaker field docs (#64671)
Corrects the EQL docs to remove `event.sequence` as the default `tiebreaker_field` value.
2020-11-06 09:05:18 -05:00
James Rodewig
7621b4c48c
[DOCS] Document off-heap swaps under mlocks (#64667) 2020-11-06 07:38:13 -05:00
James Rodewig
d845aa05cd
[DOCS] Clarify args for geoshape orientation (#64649) 2020-11-06 07:37:16 -05:00
Alex Chan
320cab9bb9 [Docs] Note that wildcard field supports null_value 2020-11-05 19:07:59 +01:00
James Rodewig
c7a11b5719 [DOCS] Fix remove_index callout 2020-11-05 09:09:16 -05:00
Hendrik Muhs
208b69ccaa
[Transform] add support for median absolute deviation (#64634)
add median_absolute_deviation to the list of supported aggs in transform
2020-11-05 14:38:15 +01:00
Rudolf Meijering
33a38d461f
[DOCS] POST /_aliases remove_index action only works on concrete indices (#64616) 2020-11-05 08:14:19 -05:00
Julie Tibshirani
79c267f4fc
Document breaking change around _id field data. (#64610) 2020-11-04 13:45:07 -08:00
Mark Tozzi
f666ccb3bc
Add supports for upper and lower values on boxplot based on the IQR value (#63617) 2020-11-04 14:39:05 -05:00
Christos Soulios
666f4acab2
Fix typo in fields doc (#64600) 2020-11-04 19:51:14 +02:00
James Rodewig
947de836e1
[DOCS] Add tab widget for default log locations (#64510) 2020-11-04 08:19:02 -05:00
James Rodewig
b2b676d7d6 [DOCS] Remove italics formatting 2020-11-03 15:49:52 -05:00
Mayya Sharipova
0ffbcd3b3c
Disable using unsigned_long in scripts (#64523)
Relates to #64361
2020-11-03 14:20:46 -05:00
James Rodewig
3cca4b54f0
[DOCS] Clarify index size in ILM overview (#64544) 2020-11-03 13:08:09 -05:00
Armin Braun
6924236118
Limit the Number of Snapshots in a BlobStoreRepository (#64461)
Adds a limit to the maximum number of snapshots that are allowed
to be added to a snapshot repository as a safety measure of last resort
against repositories that grow to an unmanagable size due to e.g. incorrect SLM
settings.

Co-authored-by: David Turner <david.turner@elastic.co>
2020-11-03 18:02:11 +01:00
Mayya Sharipova
074f7d2e8a
Async search status (#62947)
Introduce async search status API

GET /_async_search/status/<id>

The API is restricted to the monitoring_user role.

For a running async search, the response is:

```js
{
  "id" : <id>,
  "is_running" : true,
  "is_partial" : true,
  "start_time_in_millis" : 1583945890986,
  "expiration_time_in_millis" : 1584377890986,
  "_shards" : {
      "total" : 562,
      "successful" : 188,
      "skipped" : 0,
      "failed" : 0
  }
}
```

For a completed async search, an additional
`completion_status` fields is added.

```js
{
  "id" : <id>,
  "is_running" : false,
  "is_partial" : false,
  "start_time_in_millis" : 1583945890986,
  "expiration_time_in_millis" : 1584377890986,
  "_shards" : {
      "total" : 562,
      "successful" : 562,
      "skipped" : 0,
      "failed" : 0
  },
 "completion_status" : 200
}
```

Closes #57537
2020-11-03 11:35:28 -05:00
Christos Soulios
4dc833fa44
Add doc_count field mapper (#64503)
Bucket aggregations compute bucket doc_count values by incrementing the doc_count by 1 for every document collected in the bucket.

When using summary fields (such as aggregate_metric_double) one field may represent more than one document. To provide this functionality we have implemented a new field mapper (named doc_count field mapper). This field is a positive integer representing the number of documents aggregated in a single summary field.

Bucket aggregations will check if a field of type doc_count exists in a document and will take this value into consideration when computing doc counts.
2020-11-03 17:47:17 +02:00
Martijn van Groningen
c4c3c8b422
Add data stream support to CCR (#61993)
This commit adds support data stream support to CCR's auto following by making the following changes:
* When the auto follow coordinator iterates over the candidate indices to follow,
  the auto follow coordinator also checks whether the index is part of a data stream and
  if the name of data stream also matches with the auto follow pattern then the index
  will be auto followed.
* When following an index, the put follow api also checks whether that index is part
  of a data stream and if so then also replicates the data stream definition to the
  local cluster.
* In order for the follow index api to determine whether an index is part of a data
  stream, the cluster state api was modified to also fetch the data stream definition
  of the cluster state if only the state is queried for specific indices.

When a data stream is auto followed, only new backing indices are auto followed.
This is in line with how time based indices patterns are replicated today. This
means that the data stream isn't copied 1 to 1 into the local cluster. The local
cluster's data stream definition contains the same name, timestamp field and
generation, but the list of backing indices may be different (depending on when
a data stream was auto followed).

Closes #56259
2020-11-03 14:01:14 +01:00
James Rodewig
99dac25a20
[DOCS] Add redirect for heap size (#64507) 2020-11-02 16:44:01 -05:00
bellengao
b17ce85f13
Add copy_from parameter for set ingest processor (#63540) 2020-11-02 10:40:05 -06:00
Armin Braun
1990e24e8e
Document Recommended Maximum Repository Size in SLM Docs (#64485)
Just adding a short note on reasonable sizing limits.
2020-11-02 17:20:20 +01:00
James Rodewig
0ec79adfb6
[DOCS] Note heap size must be set to same min and max (#64090) (#64474)
Co-authored-by: C.J. Jameson <cjcjameson@users.noreply.github.com>
2020-11-02 09:21:58 -05:00