github-mirrors/elasticsearch
1
0
Fork 0
mirror of https://github.com/elastic/elasticsearch.git synced 2025-04-24 23:27:25 -04:00
Code Issues Projects Releases Packages Wiki Activity
elasticsearch/docs/reference
History
Martijn van Groningen c4c3c8b422
Add data stream support to CCR (#61993) 
This commit adds support data stream support to CCR's auto following by making the following changes:
* When the auto follow coordinator iterates over the candidate indices to follow,
  the auto follow coordinator also checks whether the index is part of a data stream and
  if the name of data stream also matches with the auto follow pattern then the index
  will be auto followed.
* When following an index, the put follow api also checks whether that index is part
  of a data stream and if so then also replicates the data stream definition to the
  local cluster.
* In order for the follow index api to determine whether an index is part of a data
  stream, the cluster state api was modified to also fetch the data stream definition
  of the cluster state if only the state is queried for specific indices.

When a data stream is auto followed, only new backing indices are auto followed.
This is in line with how time based indices patterns are replicated today. This
means that the data stream isn't copied 1 to 1 into the local cluster. The local
cluster's data stream definition contains the same name, timestamp field and
generation, but the list of backing indices may be different (depending on when
a data stream was auto followed).

Closes #56259
2020-11-03 14:01:14 +01:00
..
aggregations [DOCS] Redirect moving avg aggregation (#64435) 2020-10-30 14:12:09 -04:00
analysis [DOCS] Fix whitespace in pattern replace token filter docs (#64345) 2020-10-29 10:07:10 -04:00
autoscaling Autoscaling policy roles specification (#64222) 2020-11-02 07:30:31 +01:00
cat [DOCS] Fix case for 'Boolean' (#64299) 2020-10-29 09:04:43 -04:00
ccr Add data stream support to CCR (#61993) 2020-11-03 14:01:14 +01:00
cluster [DOCS] Fix case for 'Boolean' (#64299) 2020-10-29 09:04:43 -04:00
commands [DOCS] Fix elasticsearch-croneval chunking (#63008) 2020-09-29 09:53:20 -04:00
data-streams Hidden data streams (#63987) 2020-10-30 11:41:58 +01:00
docs [DOCS] Fix case for 'Boolean' (#64299) 2020-10-29 09:04:43 -04:00
eql [DOCS] Fix case for 'Boolean' (#64299) 2020-10-29 09:04:43 -04:00
graph [DOCS] Document xpack.graph.enabled setting (#60073) 2020-08-21 12:37:05 -04:00
high-availability [DOCS] Fix "the the" typos (#64344) 2020-10-29 10:11:58 -04:00
how-to [DOCS] Add xref to data tiers content (#63426) 2020-10-07 13:10:42 -04:00
ilm [DOCS]: ILM rollover max_age condition disregards origination date (#64404) 2020-11-02 09:30:48 +00:00
images [DOCS] Move Kibana index mgmt docs to ES (#64380) 2020-10-30 09:14:52 -04:00
index-modules DOCS: general overview of data tiers and roles (#63086) 2020-10-07 17:06:54 +01:00
indices [DOCS] Move Kibana index mgmt docs to ES (#64380) 2020-10-30 09:14:52 -04:00
ingest Add copy_from parameter for set ingest processor (#63540) 2020-11-02 10:40:05 -06:00
licensing [DOCS] Fix case for 'Boolean' (#64299) 2020-10-29 09:04:43 -04:00
mapping [DOCS] Fix case for 'Boolean' (#64299) 2020-10-29 09:04:43 -04:00
migration [DOCS] Fix "the the" typos (#64344) 2020-10-29 10:11:58 -04:00
ml [DOCS] Fix case for 'Boolean' (#64299) 2020-10-29 09:04:43 -04:00
modules [DOCS] Combining important config settings into a single page (#63849) 2020-10-19 10:02:22 -04:00
monitoring [DOCS] Add monitoring note (#61793) 2020-10-16 13:56:54 -07:00
query-dsl [DOCS] Fix case for 'Boolean' (#64299) 2020-10-29 09:04:43 -04:00
release-notes [DOCS] Swap [float] for [discrete] (#60124) 2020-07-23 11:48:22 -04:00
repositories-metering-api [DOCS] Fix case for 'Boolean' (#64299) 2020-10-29 09:04:43 -04:00
rest-api [DOCS] Fix case for 'Boolean' (#64299) 2020-10-29 09:04:43 -04:00
rollup [DOCS] Fix case for 'Boolean' (#64299) 2020-10-29 09:04:43 -04:00
scripting [DOCS] Fix ingest script compilation rate and cache size (#61468) 2020-08-24 10:26:38 -04:00
search [DOCS] Rewrite aggs overview (#64318) 2020-10-30 08:39:38 -04:00
searchable-snapshots [DOCS] Add searchable snapshots topic. (#63040) 2020-10-22 14:34:32 -07:00
settings [DOCS]: ILM rollover max_age condition disregards origination date (#64404) 2020-11-02 09:30:48 +00:00
setup [DOCS] Add redirect for heap size (#64507) 2020-11-02 16:44:01 -05:00
slm Document Recommended Maximum Repository Size in SLM Docs (#64485) 2020-11-02 17:20:20 +01:00
snapshot-restore [DOCS] Fix case for 'Boolean' (#64299) 2020-10-29 09:04:43 -04:00
sql SQL: Escaped wildcard (*) not accepted in LIKE (#63428) 2020-10-13 09:38:35 -04:00
transform [DOCS] Fixes 'the the' typo in transforms docs. (#64393) 2020-10-30 10:52:35 +01:00
upgrade [DOCS] Note remote reindex is not fwd compatible (#60425) 2020-07-30 09:08:59 -04:00
vectors [DOCS] Update my-index examples (#60132) 2020-07-27 14:46:39 -04:00
aggregations.asciidoc [DOCS] Rewrite aggs overview (#64318) 2020-10-30 08:39:38 -04:00
analysis.asciidoc [DOCS] Swap [float] for [discrete] (#60124) 2020-07-23 11:48:22 -04:00
api-conventions.asciidoc Deprecate REST access to System Indices (#60945) 2020-10-06 11:13:48 -06:00
cat.asciidoc AwaitsFix for #51619 2020-08-06 09:59:56 +01:00
cluster.asciidoc Password-protected Keystore Feature Branch PR (#51123) 2020-01-27 19:51:39 -05:00
data-management.asciidoc [DOCS] Move Kibana index mgmt docs to ES (#64380) 2020-10-30 09:14:52 -04:00
data-rollup-transform.asciidoc [DOCS] Changes level offset of transform pages (#60066) 2020-07-22 10:55:48 -07:00
datatiers.asciidoc [DOCS] Add top-level Data management section. (#64185) 2020-10-28 15:38:22 -07:00
docs.asciidoc [DOCS] Remove heading offsets for REST APIs (#44568) 2019-07-19 14:35:36 -04:00
frozen-indices.asciidoc [DOCS] Replace twitter dataset in docs (#60604) 2020-08-03 12:49:56 -04:00
getting-started.asciidoc [DOCS] Swap [float] for [discrete] (#60124) 2020-07-23 11:48:22 -04:00
glossary.asciidoc [DOCS] Add searchable snapshots topic. (#63040) 2020-10-22 14:34:32 -07:00
gs-index.asciidoc [DOCS] Adding index file for GS "mini book". 2017-07-18 13:44:08 -07:00
high-availability.asciidoc [DOCS] Add docs for designing resilient clusters (#47233) 2020-06-05 11:48:44 -04:00
how-to.asciidoc [DOCS] Document shard sizing guide (#61942) 2020-09-28 09:24:40 -04:00
index-extra-title-page.html [DOCS] Add index-extra-title-page.html for direct HTML migration (#50189) 2019-12-13 12:44:12 -05:00
index-modules.asciidoc [DOCS] Update CCR docs to focus on Kibana (#60555) 2020-08-17 15:36:54 -04:00
index.asciidoc [DOCS] Add top-level Data management section. (#64185) 2020-10-28 15:38:22 -07:00
index.x.asciidoc [DOCS] Removes redundant index.asciidoc files (#30707) 2018-05-18 11:05:40 -07:00
indices.asciidoc [DOCS] Split delete index template API docs (#62074) (#62168) 2020-09-09 10:13:13 -04:00
ingest.asciidoc [DOCS] Update my-index examples (#60132) 2020-07-27 14:46:39 -04:00
intro.asciidoc [DOCS] Fix hyphenation for "time series" (#61472) 2020-08-24 10:34:41 -04:00
links.asciidoc [DOCS] Fix security links in machine learning APIs (#60098) 2020-07-23 12:14:56 -07:00
mapping.asciidoc Remove a redundant section on field data types. (#61821) 2020-09-02 15:00:01 -07:00
query-dsl.asciidoc [DOCS] Add redirects for wildcard and constant keyword (#61815) 2020-09-01 15:32:35 -04:00
redirects.asciidoc [DOCS] Add redirect for heap size (#64507) 2020-11-02 16:44:01 -05:00
release-notes.asciidoc [DOCS] Adds placeholders for v8 highlights, breaking changes, release notes (#38641) 2019-02-08 15:48:42 -08:00
scripting.asciidoc [DOCS] Swap [float] for [discrete] (#60124) 2020-07-23 11:48:22 -04:00
search.asciidoc [DOCS] Display point in time API docs (#61527) 2020-08-25 11:03:41 -04:00
setup.asciidoc [DOCS] http -> https, remove outdated plugin docs (#60380) 2020-07-31 15:58:38 -04:00
upgrade.asciidoc [DOCS] Add tip for upgrade assistant (#55027) 2020-05-05 09:49:22 -04:00