Commit graph

233 commits

Author SHA1 Message Date
Yang Wang
ebe4fe9f15
[Doc] Add links to the new API key based remote cluster page (#99115)
This PR adds links to the new API key based remote cluster page in
multiple places.

Relates: #98330
2023-09-01 06:08:49 -04:00
Yang Wang
f307e6fedd
[Docs] Document IP filtering for RCS 2.0 (#98553)
This PR adds documentation for RCS 2.0 IP filtering.

Relates: #98472
2023-08-24 23:23:40 -04:00
Andrei Dan
01ed7de99f
GA the data stream lifecycle (#98644)
This makes the data stream lifecycle generally available. This will allow
data streams to take advantage of a native simplified and resilient
lifecycle implementation.
2023-08-21 17:28:54 +01:00
Yang Wang
b337f9b6f3
[Docs] Misc doc update for RCS 2.0 (#98472)
This PR adds docs for the following items: * Remote indices privileges *
Remote cluster network settings * Remote cluster security settings * New
privileges * New response field for RemoteInfo API

List of preview pages: * [Remote indices in defining
roles](https://elasticsearch_98472.docs-preview.app.elstc.co/guide/en/elasticsearch/reference/master/defining-roles.html#roles-remote-indices-priv)
* [Remote indices in PutRole
API](https://elasticsearch_98472.docs-preview.app.elstc.co/guide/en/elasticsearch/reference/master/security-api-put-role.html#security-api-put-role-request-body)
* [Remote cluster server SSL
settings](https://elasticsearch_98472.docs-preview.app.elstc.co/guide/en/elasticsearch/reference/master/security-settings.html#_remote_cluster_server_api_key_based_model_tlsssl_settings)
* [Remote cluster client SSL
settings](https://elasticsearch_98472.docs-preview.app.elstc.co/guide/en/elasticsearch/reference/master/security-settings.html#_remote_cluster_client_api_key_based_model_tlsssl_settings)
* [Remote cluster network
settings](https://elasticsearch_98472.docs-preview.app.elstc.co/guide/en/elasticsearch/reference/master/modules-network.html#remote-cluster-network-settings)
and
[here](https://elasticsearch_98472.docs-preview.app.elstc.co/guide/en/elasticsearch/reference/master/modules-network.html#common-network-settings)
* [Remote cluster credentials
setting](https://elasticsearch_98472.docs-preview.app.elstc.co/guide/en/elasticsearch/reference/master/remote-clusters-settings.html)
* [New
privileges](https://elasticsearch_98472.docs-preview.app.elstc.co/guide/en/elasticsearch/reference/master/security-privileges.html)
* [New response field for RemoteInfo
API](https://elasticsearch_98472.docs-preview.app.elstc.co/guide/en/elasticsearch/reference/master/cluster-remote-info.html#cluster-remote-info-api-response-body)
2023-08-15 20:11:21 -04:00
Jake Landis
80cc651614
Fix jwt and oidc doc (#97942)
This commit corrects the following issues with JWT and OIDC `jwkset_path` documentation:
* only https is supported for the JWT realm (OIDC support both https and http)
* JWT realm does not use a file watcher to reload the file every 5 seconds
* simplify "path" to  "file name" ..technically it is resolved path, but 99% of the time it will be just 
     a file name in the config directory and "path" is ambiguous
* remove special mention of using the absolute path in cloud. .. this is an unnecessary implementation 
     detail and the only setting (of many) that calls out the cloud config directly by absolute path
* ensure the 2 different JWT documentations are the same
* make mention of when the JWT file will be reloaded (it is not backed by the file watcher, only OIDC is)
2023-08-15 15:50:17 -05:00
Keith Massey
841050043e
Hiding data stream lifecycle documentation in released docs (#98334) 2023-08-10 08:18:05 -05:00
Mary Gouseti
9aed799b51
HealthPeriodicLogger disabled by default (#97722)
Co-authored-by: Matt Culbreth <matt.culbreth@elastic.co>
2023-07-18 10:18:23 +03:00
Andrei Dan
22bc45a82f
Change default value for data stream lifecycle poll interval to 5 mins (#97583) 2023-07-17 06:52:45 -04:00
Matt Culbreth
da81686125
Add Health API Periodic Logging (#96772)
Logs the health status of the cluster and of each health indicator as observed by the Health API
2023-07-05 11:17:18 -04:00
Mary Gouseti
1abd51b167
Start with data stream lifecycle documentation (#95326) 2023-06-28 16:18:05 +03:00
Pablo Alcantar Morales
1c8c4d80f7
Document the enhancements to ILM Health Indicator (#96980) 2023-06-27 10:54:36 +02:00
debadair
777598d602
[DOCS] Remove redirect pages (#88738)
* [DOCS] Remove manual redirects

* [DOCS] Removed refs to modules-discovery-hosts-providers

* [DOCS] Fixed broken internal refs

* Fixing bad cross links in ES book, and adding redirects.asciidoc[] back into docs/reference/index.asciidoc.

* Update docs/reference/search/point-in-time-api.asciidoc

Co-authored-by: James Rodewig <james.rodewig@elastic.co>

* Update docs/reference/setup/restart-cluster.asciidoc

Co-authored-by: James Rodewig <james.rodewig@elastic.co>

* Update docs/reference/sql/endpoints/translate.asciidoc

Co-authored-by: James Rodewig <james.rodewig@elastic.co>

* Update docs/reference/snapshot-restore/restore-snapshot.asciidoc

Co-authored-by: James Rodewig <james.rodewig@elastic.co>

* Update repository-azure.asciidoc

* Update node-tool.asciidoc

* Update repository-azure.asciidoc

---------

Co-authored-by: amyjtechwriter <61687663+amyjtechwriter@users.noreply.github.com>
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
Co-authored-by: Amy Jonsson <amy.jonsson@elastic.co>
Co-authored-by: James Rodewig <james.rodewig@elastic.co>
2023-05-24 12:32:46 +01:00
István Zoltán Szabó
6db4d906ad
[DOCS] Document xpack.ml.model_repository setting (#95789) 2023-05-03 17:19:13 +02:00
DeDe Morton
a6c7c1f1e4
[DOCS] Describe how to use Elastic Agent to monitor Elasticsearch (#94348)
* [DOCS] Describe how to use Elastic Agent to monitor Elasticsearch

* Temporarily fix doc build

* Add question about showing Elastic Agent metrics in the monitoring UI

* Apply changes from review

* Activate link to Kibana docs

* Fix broken link

* Update docs/reference/monitoring/indices.asciidoc
2023-03-24 09:00:21 -07:00
Tim Vernum
34c270c023
Do not fail node if SAML HTTP metadata is unavailable (#92810)
This commit changes the SAML realm to use placeholder metadata (UnresolvedEntity) when the real metadata cannot be loaded over HTTPS - unless metadata.http.fail_on_error is set to true.

All future use of the realm will fail until the metadata is available, but this change allows the node to bootstrap successfully.
2023-02-16 17:32:01 +11:00
Yang Wang
9ce06fddc4
JWT realm documentation update - take 2 (#92539)
This PR is another round of documentation update for the JWT realm with the goal to achieve better clarity, differentiating more between the two token types and encourage readers to choose between them carefully.

Relates: #92409
2023-01-23 12:40:55 +11:00
Abdon Pijpelink
648d80e517
[DOCS] Add ssl.verification_mode to secure settings (#93083)
Co-authored-by: Adam Locke <adam.locke@elastic.co>
2023-01-19 17:13:55 +01:00
Yang Wang
56036676cb
JWT Realm - documentation update (#92409)
* wip

* Initial update for the JWT realm doc

* Apply suggestions from code review

Co-authored-by: amyjtechwriter <61687663+amyjtechwriter@users.noreply.github.com>

Co-authored-by: amyjtechwriter <61687663+amyjtechwriter@users.noreply.github.com>
2022-12-19 12:22:24 +00:00
Anthony McGlone
d80f4a68af
[DOCS] Add missing xpack security setting (#91995)
* [DOCS] Add missing xpack security setting

* [DOCS] CR feedback for missing xpack security setting

* Update docs/reference/settings/security-settings.asciidoc

Co-authored-by: Abdon Pijpelink <abdon.pijpelink@elastic.co>

Co-authored-by: Abdon Pijpelink <abdon.pijpelink@elastic.co>
2022-12-01 14:50:06 +01:00
Mary Gouseti
cfd23d512f
Disk indicator troubleshooting guides (#90504) 2022-10-14 15:24:21 +02:00
Paramdeep Singh
34ff7a9d98
Consolidated Circuit Breaker documentation to include EQL and ML infer (#90809)
Fixes #85851 

Co-authored-by: Iraklis Psaroudakis <kingherc@gmail.com>
2022-10-14 14:33:52 +03:00
Joe Gallo
21356162eb
ILM don't rollover empty indices (#89557) 2022-09-19 18:37:41 -04:00
James Baiera
c570d3e88e
Add advice on restoring ILM indices into unmanaged state (#89140) 2022-09-11 23:29:54 -04:00
Keith Massey
e61bfcfab8
Documenting master_is_stable health API settings (#87901) 2022-07-26 12:02:38 -05:00
James Baiera
6ce5f73e97
Add health user action for unhealthy SLM policy failure counts (#88523)
This PR adds a user action to the SLM health indicator which checks each SLM policy's invocations 
since last success field and reports degraded health (YELLOW) in the event that any policy is at or 
above the failure threshold (default is 5 failures in a row).
2022-07-25 15:58:20 -04:00
Yang Wang
36336fe471
Add setting for tcp_keepalive for oidc back-channel (#87868)
This PR adds a new setting to enable tcp keepalive probes for the
connections used by the oidc back-channel communication. It defaults to
true as tcp keepalive is generally useful for ES.

Relates: #87773
2022-07-07 11:41:14 +09:30
Yang Wang
f075d505c5
Automatically close idle connections in OIDC back-channel (#87773)
In some environment, the back-channel connection can be dropped
without sending a TCP RST to ES. When that happens, reusing the same
connection results into timeout error.

This PR adds a new http.connection_pool_ttl setting to control how long
a connection in the OIDC back-channel pool can be idle before it is
closed. This allows ES to more actively close idle connections to avoid
the timeout issue.

The new setting has a 3min default which means idle connections are
closed every 3 min if server response does not specify a shorter keep-alive.

Resolves: #75515
2022-06-20 22:31:17 +10:00
David Kilfoyle
40e9f3097c
[DOCS] Add TSDS docs, take two (#87703)
* Revert "Revert "[DOCS] Add TSDS docs (#86905)" (#87702)"

This reverts commit 0c86d7b9b2.

* First fix to tests

* Add data_stream object to index template

* small rewording

* Add enable data stream object in gradle example setup

* Add bullet about data stream must be enabled in template
2022-06-16 12:44:10 -04:00
David Kilfoyle
0c86d7b9b2
Revert "[DOCS] Add TSDS docs (#86905)" (#87702)
Reverts elastic/elasticsearch#86905
2022-06-15 13:32:12 -04:00
David Kilfoyle
d57f4ac2c6
[DOCS] Add TSDS docs (#86905)
* [DOCS] Add TSDB docs

* Update docs/build.gradle

Co-authored-by: Adam Locke <adam.locke@elastic.co>

* Address Nik's comments, part 1

* Address Nik's comments, part deux

* Reword write index

* Add feature flags

* Wrap one more section in feature flag

* Small fixes

* set index.routing_path to optional

* Update storage reduction value

* Update create index template code example

Co-authored-by: James Rodewig <40268737+jrodewig@users.noreply.github.com>
Co-authored-by: Adam Locke <adam.locke@elastic.co>
2022-06-15 12:22:07 -04:00
Przemysław Witek
8656a29675
[Transform] Implement per-transform num_failure_retries setting. (#87361) 2022-06-09 15:22:06 +02:00
Yang Wang
f5ceed19fc
User Profile - remove feature flag (#87383)
The feature flag is no longer necessary in the 8.4 release cycle. The
feature itself is still in beta.
2022-06-08 10:18:18 -04:00
Adam Locke
03f75416b5
[DOCS] JWT doc enhancements (#86411)
* [DOCS] Add examples for run-as privileges

* Add JWT run_as and realm examples

* Adding examples for run_as, moving that section, and other 🔥 edits

* Add section headers 🖍️

* Incorporate Justin's suggestions from code review

Co-authored-by: Justin Cranford <89857999+justincr-elastic@users.noreply.github.com>

* Edits and clarifications based on reviewer feedback.

* Clarify run_as privilege in roles

* Fix typo

* Add redirect to fix cross-book linking

* Expand the run_as examples

* Update request

* Remove NOTCONSOLE from curl commands

* Update run_as example and expand section on unsupported realms

* Split note for unsupported realms

* Remove note that OAuth2 tokens aren't supported and clarify run_as from unsupported realms

* Apply Justin's suggestions from code review

Co-authored-by: Justin Cranford <89857999+justincr-elastic@users.noreply.github.com>

* Update support for different authentication mechanisms

* Apply suggestions from code review

Co-authored-by: Justin Cranford <89857999+justincr-elastic@users.noreply.github.com>

* Add note from review, cleanup, and typo fixes

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
Co-authored-by: Justin Cranford <89857999+justincr-elastic@users.noreply.github.com>
2022-06-03 18:12:36 -04:00
Justin Cranford
7b75311382
List rp.signature_algorithm supported values in docs (#87365) 2022-06-03 13:56:00 -04:00
Adam Locke
acc22de4fd
[DOCS] Document when security auto configuration is skipped (#86575)
* [DOCS] Document when security auto configuration is skipped

* Add xpack autoconfiguration parameter and links

* Fix typo and add related link 🔗

* Incorporate review feedback

* Remove keystore section and instead integrate into previous section
2022-05-17 08:27:48 -04:00
Justin Cranford
fc5f27cc0d
Add missing defaults for three OIDC settings (#86746) 2022-05-16 10:58:47 -04:00
Tim Vernum
6e32fed6e5
[DOCS] Fix name of OIDC JWT sig algorithm setting (#86561)
The `client_auth_jwt_signature_algorithm` was incorrectly documented.
2022-05-12 12:09:01 -04:00
Joe Gallo
6aaf0972a3
Make the ILM and SLM history_index_enabled settings dynamic (#86493) 2022-05-06 13:07:54 -04:00
Tim Vernum
4d7a516dac
Correct docs on DLS bitset cache default values (#86282)
In #50535 (ES v7.6) the default values for the
`DocumentSubsetBitsetCache` settings were changed. However, the docs
were not updated at that time, and still reflect the old values for
these settings
2022-05-01 22:40:03 -04:00
Justin Cranford
d4c1c2efbd
Add missing settings hmac_jwkset and hmac_key for JWT realm to security-settings.asciidoc (#86085) 2022-04-28 16:09:53 -04:00
Justin Cranford
94b45585a1
[DOCS] Add documentation for JWT realm (#85189) 2022-04-21 11:23:12 -04:00
Yang Wang
7dee198ac7
User Profile: Initial beta overview documentations (#83766)
Add initial feature overview documentation pages for User Profile and
Security Domain.

Co-authored-by: Adam Locke <adam.locke@elastic.co>
Co-authored-by: Tim Vernum <tim@adjective.org>
Co-authored-by: Albert Zaharovits <albert.zaharovits@gmail.com>
2022-04-15 00:38:41 +10:00
Justin Cranford
070dec4603
Add JWT cache to JWT realm. (#84842) 2022-03-21 13:55:32 -04:00
Lee Hinman
ef01949562
Add list of allowed domains for Watcher email action (#84894)
This adds the `xpack.notification.email.account.domain_allowlist` dynamic cluster setting that
allows an administrator to specify a list of domains to which emails are allowed to be sent. The
default value for this setting is `["*"]` which means all domains are allowed. It supports
rudimentary globbing (`*`) in the domain name, so `*.company.com` will work as a valid option.

Resolves https://github.com/elastic/elasticsearch/issues/84739
2022-03-16 08:03:58 -06:00
Justin Cranford
d103af2d06
Add JWT realm support for JWT validation (#83155) 2022-02-21 01:54:39 -05:00
Nicole Albee
5b6164f8fd
[Docs] Watcher clarification on CSV formulas warning. (#83088)
* Update docs for Watcher notification settings to include default xpack.notification.reporting.warning.kbn-csv-contains-formulas.text value and link to the Kibana documentation.

* Apply suggestions from code review

Co-authored-by: Adam Locke <adam.locke@elastic.co>

* Apply suggestions from code review

Co-authored-by: Adam Locke <adam.locke@elastic.co>

Co-authored-by: Adam Locke <adam.locke@elastic.co>
2022-01-27 09:23:12 -05:00
Lisa Cawley
6faff3e453
[DOCS] Updates xpack.security.enabled description (#82692) 2022-01-17 14:58:54 -08:00
Justin Cranford
e467424043
Add JwtRealmSettings (#81680)
Add JwtRealmSettings

Include unit tests and realm security settings documentation. Covers all settings except client authentication mTLS option, and HTTP proxy option.

Refactor Open ID Connect realm to reuse ClaimSetting.java and ClaimParser.java for JWT realm.
2021-12-21 16:28:33 -05:00
James Rodewig
4d19702221
[DOCS] Update xrefs for snapshot restore docs (#81023)
Changes:

* Removes a leading slash from the restore snapshot API's prerequisites.
* Updates several xrefs that point to redirected pages.
2021-11-29 11:52:02 -05:00
James Rodewig
659e0d3fd3
[DOCS] Overhaul snapshot and restore docs (#79081)
Makes several changes to consolidate snapshot and backup-related docs.

Highlights:

* Adds info about supported ESS snapshot repository types
* Adds docs for Kibana's Snapshot and Restore feature
* Combines tutorial pages related to taking and managing snapshots
* Consolidates explanations of the snapshot process
* Incorporates SLM into the snapshot tutorial
* Removes duplicate "back up a cluster" pages
2021-11-15 12:45:07 -05:00