elasticsearch/docs/reference/modules
Francisco Fernández Castaño 2b4fe8fc7b
Limit concurrent snapshot file restores in recovery per node (#79316)
Today we limit the max number of concurrent snapshot file restores
per recovery. This works well when the default
node_concurrent_recoveries is used (which is 2). When this limit is
increased, it is possible to exhaust the underlying repository
connection pool, affecting other workloads.

This commit adds a new setting
`indices.recovery.max_concurrent_snapshot_file_downloads_per_node` that
allows to limit the max number of snapshot file downloads per node
during recoveries. When a recovery starts in the target node it tries
to acquire a permit that allows it to download snapshot files when it is
granted. This is communicated to the source node in the
StartRecoveryRequest. This is a rather conservative approach since it is
possible that a recovery that gets a permit to use snapshot files
doesn't recover any snapshot file while there's a concurrent recovery
that doesn't get a permit could take advantage of recovering from a
snapshot.

Closes #79044
2021-10-18 18:17:27 +02:00
..
cluster Deprecation of transient cluster settings (#78794) 2021-10-15 13:00:52 -04:00
discovery A typo error (#78987) (#79203) 2021-10-15 08:52:03 -04:00
indices Limit concurrent snapshot file restores in recovery per node (#79316) 2021-10-18 18:17:27 +02:00
network Deprecation of transient cluster settings (#78794) 2021-10-15 13:00:52 -04:00
cluster.asciidoc [DOCS] Document dynamic cluster-lvl shard alloc settings (#61338) 2020-08-31 11:04:11 -04:00
discovery.asciidoc Expand and consolidate networking docs (#68051) 2021-02-01 13:06:20 +00:00
gateway.asciidoc Remove deprecated gateway settings (#53845) 2021-02-03 14:10:45 +00:00
http.asciidoc Limit count of HTTP channels with tracked stats (#77303) 2021-09-08 07:25:57 +01:00
network.asciidoc [DOCS] Update remote cluster docs (#77043) 2021-09-22 16:02:33 -04:00
node.asciidoc [DOCS] Update remote cluster docs (#77043) 2021-09-22 16:02:33 -04:00
plugins.asciidoc [DOCS] Relocate "Plugins" page (#54974) 2020-04-10 15:29:44 -04:00
remote-clusters-shared.asciidoc Improve docs for pre-release version compatibility (#78428) 2021-09-29 04:49:07 -04:00
remote-clusters.asciidoc Add docs for pre-release version compatibility (#78317) 2021-09-27 16:56:35 +01:00
threadpool.asciidoc Node level can match action (#78765) 2021-10-18 10:13:44 +02:00
transport.asciidoc Enable LZ4 transport compression by default (#76326) 2021-08-17 12:19:42 -06:00