elasticsearch/docs/reference/data-streams/lifecycle
Mary Gouseti bed6e18fa3
Exclude internal data streams from global retention (#112100)
With #111972 we enable users to set up global retention for data streams that are managed by the data stream lifecycle. This will allow users of elasticsearch to have a more control over their data retention, and consequently better resource management of their clusters.

However, there is a small number of data streams that are necessary for the good operation of elasticsearch and should not follow user defined retention to avoid surprises.

For this reason, we put forth the following definition of internal data streams.

A data stream is internal if it's either a system index (system flag is true) or if its name starts with a dot.

This PR adds the `isInternalDataStream` param in the effective retention calculation making explicit that this is also used to determine the effective retention.
2024-08-28 11:28:35 +03:00
..
apis Display effective retention in the relevant data stream APIs (#112019) 2024-08-22 17:42:49 +03:00
index.asciidoc Display effective retention in the relevant data stream APIs (#112019) 2024-08-22 17:42:49 +03:00
tutorial-manage-data-stream-retention.asciidoc Exclude internal data streams from global retention (#112100) 2024-08-28 11:28:35 +03:00
tutorial-manage-existing-data-stream.asciidoc GA data stream lifecycles in documentation (#107582) 2024-04-18 09:09:44 -06:00
tutorial-manage-new-data-stream.asciidoc Display effective retention in the relevant data stream APIs (#112019) 2024-08-22 17:42:49 +03:00
tutorial-migrate-data-stream-from-ilm-to-dsl.asciidoc Display effective retention in the relevant data stream APIs (#112019) 2024-08-22 17:42:49 +03:00