Commit graph

8 commits

Author SHA1 Message Date
Mary Gouseti
e71ea6e6d7
Add data stream lifecycle by default (#97823)
In this PR we enable all new data streams to be managed by the data
stream lifecycle by default. This is implemented by adding an empty
`lifecycle: {}` upon new data stream creation. 

Opting out is represented by a the `enabled` flag:

```
{
  "lifecycle": {
    "enabled": false
  }
}
```

This change has the following implications on when is an index managed
and by which feature:

| Parent data stream lifecycle| ILM| `prefer_ilm`|Managed by|
|----------------------------|----|----------------|-| | default | yes|
true| ILM| | default | yes| false| data stream lifecycle| |default |
no|true/false|data stream lifecycle| |opt-out or
missing|yes|true/false|ILM| |opt-out or missing|no|true/false|unmanaged|

Data streams that have been created before the data stream lifecycle is
enabled will not have the default lifecycle.

Next steps: - We need to document this when the feature will be GA
(https://github.com/elastic/elasticsearch/issues/97973).
2023-08-11 06:28:37 -04:00
Abdon Pijpelink
91d0e11ab9
[DOCS] Update manual downsampling documentation to use TSDS (#97976)
* [DOCS] Update manual downsampling documentation to use TSDS

* Swap manual and ILM downsampling examples in nav

* Typo

* Update prerequisites based on review feedback

* Warn against deleting the old backing index.

* Clarify counter/gauge results

* Mention that the downsampled type is 'aggregate_metric_double'
2023-08-04 09:39:14 +02:00
David Kilfoyle
8e7d4b0750
[DOCS] Note limits for queries on downsampled indices (#95749) 2023-05-03 09:58:23 -04:00
Abdon Pijpelink
20dd5d3191
[DOCS] Rerun agg at the end of manual downsampling example (#95122)
* [DOCS] Rerun agg at the end of manual downsampling example

* Replace 'index' with 'data stream'

* One more 'index'
2023-04-11 17:33:52 +02:00
David Kilfoyle
9a673ad7f1
95017 fix downsampling step (#95054)
* Remove extra step in manual downsampling docs

* create -> view
2023-04-05 10:09:03 -04:00
David Kilfoyle
3f880613f8
[Docs] Remove tech preview notice from downsampling docs (#92913) 2023-01-19 09:05:59 -05:00
Abdon Pijpelink
64ce4d1189
[DOCS] Downsampling code snippet formatting (#92981) 2023-01-17 15:31:25 +01:00
David Kilfoyle
cad87c4d5a
[DOCS] Add Downsampling docs (#88571)
This adds documentation for downsampling of time series indices.
2022-10-12 12:10:16 -04:00