Commit graph

8 commits

Author SHA1 Message Date
Mary Gouseti
ad90d1f0f6
Introduce global retention in data stream lifecycle (cluster settings) (#111972)
In this PR we introduce cluster settings to manage the global data stream retention.

We introduce two settings `data_streams.lifecycle.retention.max` & `data_streams.lifecycle.retention.default` that configure the respective retentions. The settings are loaded and monitored by the `DataStreamGlobalRetentionSettings`. The validation has also moved there.

We preserved the `DataStreamGlobalRetention` record to reduce the impact of this change. The purpose of this method is to be simply a wrapper record that groups the retention settings together.

Temporarily, the `DataStreamGlobalRetentionSettings` is using the DataStreamFactoryRetention which is marked as deprecated for migration purposes.
2024-08-20 09:54:55 +03:00
shainaraskas
c97be9cbc7
rm remaining dsl technical preview notice (#109810) 2024-06-17 10:38:19 -04:00
Andrei Dan
2f0e58520e
Document DSL setting to signalling lack of progress for index (#101635) 2023-11-01 08:44:38 +00:00
Andrei Dan
74ea04fb2d
[DOCS] document tail merging and create tutorial for migrating to DSL (#101117)
This documents tail merging, the enabled flag, and
adds a tutorial to migrate a data stream from ILM to DSL.
2023-10-25 11:12:36 +01:00
Andrei Dan
01ed7de99f
GA the data stream lifecycle (#98644)
This makes the data stream lifecycle generally available. This will allow
data streams to take advantage of a native simplified and resilient
lifecycle implementation.
2023-08-21 17:28:54 +01:00
Keith Massey
841050043e
Hiding data stream lifecycle documentation in released docs (#98334) 2023-08-10 08:18:05 -05:00
Andrei Dan
22bc45a82f
Change default value for data stream lifecycle poll interval to 5 mins (#97583) 2023-07-17 06:52:45 -04:00
Mary Gouseti
1abd51b167
Start with data stream lifecycle documentation (#95326) 2023-06-28 16:18:05 +03:00