Commit graph

10258 commits

Author SHA1 Message Date
David Turner
14c01470a3
Deprecate cluster.routing.allocation.type (#94066)
Today users may select a shards allocator via the
`cluster.routing.allocation.type` setting. In practice this is only used
to select between the (default) desired-balance allocator and the legacy
allocator. With this commit we mark this setting as deprecated to
indicate that the desired-balance allocator will be the only choice in a
future release.
2023-03-02 12:50:49 +00:00
Abdon Pijpelink
303919a901
[DOCS] Fix typo in shutdown-put.asciidoc (#94234)
Resubmitting https://github.com/elastic/elasticsearch/pull/94148 to target the `main` branch.

Co-authored-by: Kazuma Arimura <k.arimura96@gmail.com>
2023-03-01 15:31:23 +01:00
Abdon Pijpelink
2808512397
[DOCS] Improve watermark troubleshooting documentation (#94222) 2023-03-01 14:34:14 +01:00
richcollier
1da70cbe08
Update tsds.asciidoc (#94208)
fixed typo
2023-03-01 11:05:15 +01:00
iamthinh
a4ee8f4a34
Update profile.asciidoc (#92656)
* Update profile.asciidoc

Fix small typo

* Update docs/reference/search/profile.asciidoc

Co-authored-by: Felix Stürmer <weltenwort@users.noreply.github.com>

---------

Co-authored-by: Abdon Pijpelink <abdon.pijpelink@elastic.co>
Co-authored-by: Felix Stürmer <weltenwort@users.noreply.github.com>
2023-02-27 09:54:03 +01:00
Luca Belluccini
d746295296
[DOCS] JDBC Driver troubleshooting params (#93858)
* [DOCS] JDBC Driver troubleshooting params

* Update docs/reference/sql/endpoints/jdbc.asciidoc

Co-authored-by: Bogdan Pintea <bogdan.pintea@elastic.co>

* Update docs/reference/sql/endpoints/jdbc.asciidoc

Co-authored-by: Bogdan Pintea <bogdan.pintea@elastic.co>

---------

Co-authored-by: Bogdan Pintea <bogdan.pintea@elastic.co>
2023-02-24 11:02:51 +01:00
Abdon Pijpelink
c5b1d997d1
[DOCS] Add 'total' object for io_stats in nodes stats response (#93854) 2023-02-23 13:08:42 +01:00
Zacson
031854b6f4
[DOCS] Correct the calculation rules for limit the total number of cluster frozen shards (#93764) 2023-02-23 10:30:03 +01:00
Stef Nestor
69d3039726
Doc about elasticsearch#78276 (#93873)
👋🏼 Regardless of if we decide to validation enforce #78276, may we please drop a doc note that users should avoid duplicating repositories (particularly bucket / base paths).
2023-02-22 21:08:15 +01:00
Przemyslaw Gomulka
5b083e29f2
[doc] Add known issue to all affected versions due to jackson parsing bug (#93915)
relates #92480
relates #92984
2023-02-22 16:57:12 +01:00
Steve Gordon
a7e65e3b2d
Fix get data stream documentation (#94009)
The documentation specifies the possible values for the status of the response. This endpoint is inconsistent with most others that expose the health status as it returns the values as uppercase strings rather than lowercase. 

This PR fixes the cases in the documentation to align with the actual values returned in the response body.
2023-02-22 13:46:04 +00:00
David Roberts
ee3f51a7bb
[ML] Make text_embedding query vector builder experimental for first release (#93979)
The text_embedding query vector builder that can be used with
KNN search to deliver a semantic search solution will be experimental
for its first release.
2023-02-22 09:29:23 +00:00
Hritik Kumar
f5af004117
Support ignore_malformed in boolean fields (#93239)
This PR enables the `ignore_malformed`parameter to be accepted as an option in 
boolean field mappings. Support for synthetic source is not added yet, so if
`ignore_malformed` is set to true, synthetic source isn't supported.

Closes #89542
2023-02-21 18:22:10 +01:00
Christoph Büscher
edc7a6171c
Enable _terms_enum API for version fields (#93839)
The _terms_enum API currently only supports the keyword, constant_keyword 
and flattened field type. This change adds support for the `version` field type
that sorts according to the semantic versioning definition.

Closes #83403
2023-02-21 14:03:12 +01:00
Alan Woodward
639eab0549
Remove force_source option for highlighting (#93193)
This was only needed because the percolator uses a MemoryIndex which did
not support stored fields, and so when it ran a highlighting phase it needed to
force it to read from source. MemoryIndex added stored fields support in
lucene 9.5, so we can remove this internal parameter.

The parameter remains available, but deprecated, via the rest layer, and no
longer has any effect.
2023-02-21 09:51:28 +00:00
Ramdas Potale
845f7a11ed
updated correct API to get index templates etc (#93793)
* updated correct API to get index templates etc

Hi, I think documentation needs correction on below points.
1. updated correct API to get index template
2.  on line 18, it should be index pattern instead of template pattern
3.  index pattern should have es version as 8 which matches elasticsearch version, also updated index patterns in API request payload

* fix: grammatical correction to line 18

removed "the" from line 18 which is not very accuarate

Co-authored-by: Abdon Pijpelink <abdon.pijpelink@elastic.co>

* additional corrections to the docs as suggested by @abdonpijpelink

. use the `_index_template` endpoint instead of just `_template`
. change `order` to `priority`

* settings need to be wrapped inside template obect

---------

Co-authored-by: Abdon Pijpelink <abdon.pijpelink@elastic.co>
2023-02-20 16:47:34 +01:00
Julio
226db04997
[DOCS][main] Add 8.6.2 Release Notes (#93879)
Co-authored-by: Abdon Pijpelink <abdon.pijpelink@elastic.co>
2023-02-20 06:30:59 -07:00
David Kyle
f8e306e688
Rewrite Redact Processor docs intro (#93856)
Focus on what redact does rather than describing Grok
2023-02-16 14:17:54 +00:00
Tim Vernum
34c270c023
Do not fail node if SAML HTTP metadata is unavailable (#92810)
This commit changes the SAML realm to use placeholder metadata (UnresolvedEntity) when the real metadata cannot be loaded over HTTPS - unless metadata.http.fail_on_error is set to true.

All future use of the realm will fail until the metadata is available, but this change allows the node to bootstrap successfully.
2023-02-16 17:32:01 +11:00
Lisa Cawley
f49bb09503
[DOCS] Refresh screenshots for machine learning rules (#93805) 2023-02-15 15:43:30 -08:00
Przemyslaw Gomulka
b0ba832791
[doc] Mention dates_nanos in dates field type page (#93828) 2023-02-15 16:58:24 +01:00
David Turner
a7e2430b79
Include node ID in balance API (#93823)
Today we report node stats by name, but the desired nodes work in terms
of node IDs. This commit adds a mapping between node name and ID to make
the output easier to interpret.
2023-02-15 08:39:59 -05:00
István Zoltán Szabó
4d117c5add
[DOCS] Adds semantic search section to kNN search page (#93782)
Co-authored-by: Abdon Pijpelink <abdon.pijpelink@elastic.co>
2023-02-15 11:44:41 +01:00
Lisa Cawley
2c4ef7c26a
[DOCS] Refresh screenshots for transform health rules (#93761) 2023-02-14 10:11:49 -08:00
David Kilfoyle
a7666a211f
Re-add link to 8.7 release highlights (#93758)
* Re-add link to 8.7 release highlights

* Rebuild

---------

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2023-02-14 10:52:49 -05:00
Pooya Salehi
ee56ea8c82
Clarify wait_for_completion doc in the Task API (#93754) 2023-02-13 18:29:14 +01:00
Benjamin Trent
e8c5ed46c6
Fixing our docs for vector sizing calculation (#93703) 2023-02-13 07:52:53 -05:00
David Turner
9c8c9528ad
Add cluster stats re. snapshot activity (#93680)
Shows how many ongoing snapshots/clones/deletions/etc. there are, and
summarises the shard-level status too for progress tracking.
2023-02-13 07:48:14 +00:00
Abdon Pijpelink
1fca7f6ab9
[DOCS] Mention search_after in PIT docs (#93627) 2023-02-10 10:40:03 +01:00
Pooya Salehi
93a897c89d
Update snapshot threadpool size doc (#93655)
Co-authored-by: David Turner <david.turner@elastic.co>
2023-02-09 17:45:45 +01:00
Sylvain Wallez
484d3f4ada
Fixes CORS headers needed by Elastic clients (#85791)
* Fixes CORS headers needed by Elastic clients

Updates the default value for the `http.cors.allow-headers`
setting to include headers used by Elastic client libraries.

Also adds the `access-control-expose-headers` header to responses to
CORS requests so that clients can successfully perform their product
check.
2023-02-09 16:44:37 +01:00
David Kilfoyle
c5713a3948
Remove 8.7 release highlights link to fix docs build (#93604) 2023-02-08 16:38:07 -05:00
Ryan Ernst
05d1011d3d
Bump to version 8.8.0 2023-02-08 11:46:42 -08:00
István Zoltán Szabó
a6f365c51c
[DOCS] Modifies schedule now transform API docs (#93519) 2023-02-08 17:16:59 +01:00
Daniel Mitterdorfer
5ec28cc875
Document correct get thread pool size (#93541)
In #92309 we have aligned the size of the `search` and the `get` thread
pool but the docs still contain the prior `get` thread pool size. With
this commit we also align the docs.

Relates #92309
2023-02-08 07:19:55 +01:00
David Kyle
b588d2ddd7
Redact Ingest Processor (#92951)
The Redact processor uses the Grok rules engine to
redact text in the input document that matches the
Grok pattern. For example Email or IP addresses can
be redacted using the definitions from the standard
Grok pattern bank. New patterns can be defined in
the processor configuration
2023-02-07 17:10:07 +00:00
Craig Taverner
f55d70a682
Document datehistogram with long offsets (#93328)
* Document datehistogram with long offsets

When offsets are longer than calendar_intervals that are non-standard,
like months which differ in length, then the usual rule of all buckets
starting at the same day and time will no longer apply.

This update attempts to explain this with examples.

* Removed TEST-skip lines

These don't seem to be parsable, even though they match the syntax
described in the README.asciidoc

* Added // TESTRESPONSE[skip:...] lines

* Refined docs description and added more examples

* Update docs/reference/aggregations/bucket/datehistogram-aggregation.asciidoc

Co-authored-by: Abdon Pijpelink <abdon.pijpelink@elastic.co>

* Update docs/reference/aggregations/bucket/datehistogram-aggregation.asciidoc

Co-authored-by: Abdon Pijpelink <abdon.pijpelink@elastic.co>

* Update docs/reference/aggregations/bucket/datehistogram-aggregation.asciidoc

Co-authored-by: Abdon Pijpelink <abdon.pijpelink@elastic.co>

* Update docs/reference/aggregations/bucket/datehistogram-aggregation.asciidoc

Co-authored-by: Abdon Pijpelink <abdon.pijpelink@elastic.co>

---------

Co-authored-by: Abdon Pijpelink <abdon.pijpelink@elastic.co>
2023-02-06 16:20:40 +01:00
Craig Taverner
c18078e11e
Geo_grid ingest processor docs (#93507)
* Add docs for geo_grid ingest processor

Adds docs for https://github.com/elastic/elasticsearch/pull/93370

* Update docs/reference/ingest/processors/geo-grid.asciidoc

Co-authored-by: Abdon Pijpelink <abdon.pijpelink@elastic.co>

* Update docs/reference/ingest/processors/geo-grid.asciidoc

Co-authored-by: Abdon Pijpelink <abdon.pijpelink@elastic.co>

* Update docs/reference/ingest/processors/geo-grid.asciidoc

Co-authored-by: Abdon Pijpelink <abdon.pijpelink@elastic.co>

* Update docs/reference/ingest/processors/geo-grid.asciidoc

Co-authored-by: Abdon Pijpelink <abdon.pijpelink@elastic.co>

* Update docs/reference/ingest/processors/geo-grid.asciidoc

Co-authored-by: Abdon Pijpelink <abdon.pijpelink@elastic.co>

* Update docs/reference/ingest/processors/geo-grid.asciidoc

Co-authored-by: Abdon Pijpelink <abdon.pijpelink@elastic.co>

* Update docs/reference/ingest/processors/geo-grid.asciidoc

Co-authored-by: Abdon Pijpelink <abdon.pijpelink@elastic.co>

* Update docs/reference/ingest/processors/geo-grid.asciidoc

Co-authored-by: Abdon Pijpelink <abdon.pijpelink@elastic.co>

* Consistent GeoJSON case

---------

Co-authored-by: Abdon Pijpelink <abdon.pijpelink@elastic.co>
2023-02-06 16:17:00 +01:00
Ievgen Degtiarenko
ab5ae88919
Expose forecasted and actual disk usage per tier and node (#93497) 2023-02-06 13:34:18 +01:00
István Zoltán Szabó
c08c16e311
[DOCS] Removes semantic search reference docs (#93500) 2023-02-06 11:00:25 +01:00
Abdon Pijpelink
ea90f92881
[DOCS] Remove excessive white space from the landing page (#93472) 2023-02-06 09:42:42 +01:00
István Zoltán Szabó
9229011000
[DOCS] Adds size parameter details to aggregating data for faster performance page (#93475) 2023-02-02 19:29:11 +01:00
Przemysław Witek
f60401a61c
[Transform] Transform _schedule_now API (#92948) 2023-02-02 19:03:16 +01:00
David Turner
4c68382065
Capture thread dump on ShardLockObtainFailedException (#93458)
We sometimes see a `ShardLockObtainFailedException` when a shard failed
to shut down as fast as we expected, often because a node left and
rejoined the cluster. Sometimes this is because it was held open by
ongoing scrolls or PITs, but other times it may be because the shutdown
process itself is too slow. With this commit we add the ability to
capture and log a thread dump at the time of the failure to give us more
information about where the shutdown process might be running slowly.

Relates #93226
2023-02-02 11:17:40 -05:00
Ievgen Degtiarenko
513dc2f24f
Expose per node counts (#93439) 2023-02-02 16:13:01 +01:00
Hendrik Muhs
cf5ea0bb1f
[ML] rename frequent_items to frequent_item_sets and make it GA (#93421)
rename frequent_items to frequent_item_sets and remove the experimental batch
2023-02-02 09:25:00 +01:00
Benjamin Trent
323a13ac3f
Add term query support to rank_features mapped field (#93247)
This adds term query capabilities for rank_features fields. term queries against rank_features are not scored in the typical way as regular fields. This is because the stored feature values take advantage of the term frequency storage mechanism, and thus regular BM25 does not work.

Instead, a term query against a rank_features field is very similar to linear rank_feature query. If more complicated combinations of features and values are required, the rank_feature query should be used.
2023-02-01 13:32:13 -05:00
Benjamin Trent
7f9f3bcd30
Add new query_vector_builder option to knn search clause (#93331)
This adds a new option to the knn search clause called query_vector_builder. This is a pluggable configuration that allows the query_vector created or retrieved.
2023-02-01 13:31:46 -05:00
Artem Prigoda
58c1bcc0f8
[DOCS] [main] Add release notes for 8.6.1 (#93236) (#93404)
Forward ports the release notes from #93236
2023-02-01 11:42:36 +01:00
Abdon Pijpelink
d93382bcb6
[DOCS] Remove 'from' parameter from update_by_query/delete_by_query docs (#93379) 2023-02-01 09:09:57 +09:00