Commit graph

11450 commits

Author SHA1 Message Date
elasticsearchmachine
cc753389c1 Bump to version 8.15.0 2024-04-17 17:04:59 +00:00
Liam Thompson
33a71e3289
[DOCS] Refactor book-scoped variables in docs/reference/index.asciidoc (#107413)
* Remove `es-test-dir` book-scoped variable

* Remove `plugins-examples-dir` book-scoped variable

* Remove `:dependencies-dir:` and `:xes-repo-dir:` book-scoped variables

- In `index.asciidoc`, two variables (`:dependencies-dir:` and `:xes-repo-dir:`) were removed.
- In `sql/index.asciidoc`, the `:sql-tests:` path was updated to fuller path
- In `esql/index.asciidoc`, the `:esql-tests:` path was updated idem

* Replace `es-repo-dir` with `es-ref-dir`

* Move `:include-xpack: true` to few files that use it, remove from index.asciidoc
2024-04-17 14:37:07 +02:00
David Turner
2f9e753463
Add setting for max connections to S3 (#107533)
The S3 SDK permits changing the maximum number of concurrent connections
that it will open, but today there's no way to adjust this setting
within Elasticsearch. This commit adds a setting for this parameter.
2024-04-17 06:49:02 -04:00
Liam Thompson
84f1b26953
Update esql-version.asciidoc (#107547)
Fix heading misalignment and typo.
2024-04-17 09:54:56 +02:00
Keith Massey
f5c7938ab8
Adding cache_stats to geoip stats API (#107334) 2024-04-16 16:57:14 -05:00
shainaraskas
ac5f5640e5
[DOCS] Update tutorial to discourage editing managed ILM policies (#107074) 2024-04-16 14:55:55 -04:00
David Kyle
f8fe610966
[ML] Add GET _inference for all inference endpoints (#107517) 2024-04-16 17:15:59 +01:00
Mark J. Hoy
624a5b1fe5
Add Docs for Azure OpenAI Embeddings Inference (#107498)
* Update docs for Azure OpenAI Embeddings inference

* cleanups

* update link for dot_product similarity

* final cleanups
2024-04-16 10:52:27 -04:00
Benjamin Trent
984e793e44
Add note about random sampler consistency (#107479) 2024-04-16 08:28:24 -04:00
Bogdan Pintea
a2c2e8fe47
ESQL: extend BUCKET with spans. Turn it into a grouping function (#107272)
This extends `BUCKET` function to accept a two-parameters-only
invocation: the first parameter remains as is, while the second is a
span. It can be a numeric (floating point) span, if the first argument
is numeric, or a date period or time duration, if the first argument is
a date.

Also, the function can now be invoked with the alias BIN.

Additionally, the function has been turned into a grouping-only function
and thus can only be used within a `STATS` command.
2024-04-16 12:57:18 +02:00
István Zoltán Szabó
2e847e8817
[DOCS] Documents the rerank task type of the Inference API (#107404)
* [DOCS] Documents the rerank task type of the Inference API.
2024-04-16 09:39:36 +02:00
Fang Xing
353abef214
[ES|QL] Base64 decoding and encoding functions (#107390)
* add base64 functions
2024-04-15 18:39:26 -04:00
Parker Timmins
3288f46fd9
Allow writes to ILM shrink action target index (#107121)
The source index of a shrink action is made read-only to perform the shrink. During shrink, settings are copied from source index to target index, causing the target index to also be read-only. This change adds a shrink policy argument making the target index writable after shrinking. The default is to keep the read-only setting to preserve current behavior.

closes #106599
2024-04-15 11:56:38 -05:00
Alexander Spies
71b276da90
ESQL: Add version to docs (#107225)
Docs for https://github.com/elastic/elasticsearch/pull/106824.

Does not cover the [REST API
specs](https://github.com/elastic/elasticsearch/blob/main/rest-api-spec/src/main/resources/rest-api-spec/api/esql.query.json)
as these don't cover the request body.
2024-04-15 10:50:00 -04:00
Salvatore Campagna
4dfcb0897e
Fetch meta fields in FetchFieldsPhase using ValueFetcher (#106325)
Here we extract the logic to populate metadata fields such as _ignored, _routing, _size and the deprecated _type into FetchFieldsPhase so that we can use the ValueFetcher interface to retrieve field values. This allows us to fetch values no matter if the Mapper uses stored or doc values.
2024-04-15 11:02:18 +02:00
István Zoltán Szabó
b9322da325
[DOCS] Fixes section levels in POST inference API docs. (#107451) 2024-04-15 10:31:09 +02:00
Artem Prigoda
6a300509cd
Add metric for calculating index flush time excluding waiting on locks (#107196)
Add a new `total_time_excluding_waiting_on_lock metric` to the index flush stats that measures the flushing time excluding waiting on the flush lock. This metrics provides a more granular view on flush performance and without the overhead of flush throttling.

Resolves ES-7201
2024-04-12 15:04:08 +02:00
Joe Gallo
6ff3a2628a
Add support for the 'Enterprise' database to the geoip processor (#107377) 2024-04-11 16:45:10 -04:00
Joe Gallo
5266f79b16
Add support for the 'Anonymous IP' database to the geoip processor (#107287) 2024-04-11 14:05:52 -04:00
shainaraskas
648c9cb05c
[DOCS] Add azure storage secure settings while the node is running (#107163) 2024-04-11 13:00:31 -04:00
Nik Everett
aac17616a3
ESQL: Improve tests and docs for some functions (#107331)
This improves the tests and docs for a few functions, specifically `E`,
`FLOOR`, `PI`, `POW`, and `ROUND`. The examples and tested signatures
will get copied into the docs and kibana signatures.


Co-authored-by: Liam Thompson <32779855+leemthompo@users.noreply.github.com>
2024-04-11 12:41:56 -04:00
Fang Xing
0075c1fb1e
[ES|QL] String literal implicit casting (#106932)
* string literal casting for scalar functions and arithmetic operations.
2024-04-10 21:20:12 -04:00
Brian Seeders
063035b12e
[8.13.2] Update release notes with missing JDK downgrade PR 2024-04-10 14:12:07 -04:00
Stef Nestor
9a2bfb9e85
(Doc+) Point ingest to Alias not Bootstrapped Index (#107327)
👋 @dakrone mentioned baby-update for docs. 

Sometimes users believe they should point client-side (e.g. Logstash's Elasticsearch output `index`) to the bootstrapped index. This highlights they point ingest towards the alias as we're expecting.
2024-04-10 13:37:49 -04:00
David Turner
ccbb5badce
Fix support for infinite ?master_timeout (#107050)
Specifying `?master_timeout=-1` on an API which performs a cluster state
update means that the cluster state update task will never time out
while waiting in the pending tasks queue. However this parameter is also
re-used in a few places where a timeout of `-1` means something else,
typically to timeout immediately. This commit fixes those places so that
`?master_timeout=-1` consistently means to wait forever.
2024-04-10 18:32:38 +01:00
István Zoltán Szabó
1587dada58
[DOCS] Fixes a typo in the HugggingFace tutorial. (#107321) 2024-04-10 18:50:44 +02:00
Jonathan Buttner
c9e84558b7
[ML] Adding a timeout parameter to the inference API (#107242)
* Plumbing timeout through the request

* Passing timeout through external services

* Update docs/changelog/107242.yaml

* Fixing tests and adjusting docs

* Correcting timeout field name

* Reporting error message for elser

* Removing unused code
2024-04-10 12:29:40 -04:00
István Zoltán Szabó
afb492272a
[DOCS] Adds HuggingFace example to inference API tutorial (#107298) 2024-04-10 17:57:18 +02:00
Craig Taverner
d915b964ba
Rename ST_CENTROID to ST_CENTROID_AGG (#107226)
* Rename ST_CENTROID to ST_CENTROID_AGG

In order to allow development of a scalar ST_CENTROID function.

* Fix table alignment
2024-04-10 17:56:45 +02:00
Carlos Delgado
f8e516eb9c
Update sparse_vector docs on index version availability (#107315) 2024-04-10 17:41:42 +02:00
Keith Massey
48a88c575c
Renaming GeoIpDownloaderStatsAction (#107290)
Renaming GeoIpDownloaderStatsAction to GeoIpStatsAction
2024-04-10 09:21:24 -05:00
Liam Thompson
943885d0cd
[DOCS][ESQL] Render locate function docs (#107305) 2024-04-10 15:12:20 +02:00
Jonathan Buttner
8638deeb9e
Openai model_id is required (#107286) 2024-04-10 08:37:49 -04:00
Bogdan Pintea
8bcbc97128
Rename generated docs for (renamed) BUCKET func (#107299)
This checks in the generated-by-test doc files for newly renamed BUCKET
function.
2024-04-10 06:50:12 -04:00
David Turner
ceeee1bf56
Recommend NFS over S3-like repositories (#107297)
Allegedly-S3-compatible APIs are very popular these days, but many
third-party systems offering such an API also support a shared
filesystem interface. Shared filesystem protocols such as NFS are much
better specified than the S3 API, and experience shows that they lead to
fewer compatibility headaches. This commit adds a recommendation to the
`repository-s3` docs to consider such an interface instead.
2024-04-10 11:39:38 +01:00
Bogdan Pintea
d6f9d1e69e
ESQL: Rename AUTO_BUCKET to just BUCKET (#107197)
This renames the function AUTO_BUCKET to just BUCKET.
It also removes the experimental tagging of the function in the docs, making it generally available.
2024-04-10 12:21:08 +02:00
David Turner
ec2a4ca8b3
Expand release note for #105044 (#107257)
Users of supposedly-S3-compatible storage may need to be aware of this
change, so this commit expands the release notes to link to the relevant
S3 documentation.
2024-04-10 06:52:14 +01:00
Nik Everett
96227a1970
ESQL: Generate kibana inline docs (#106782)
This takes a stab at generating the markdown files that Kibana uses for
its inline help. It doesn't include all of the examples because the
`@Example` annotation is not filled in - we're tracking that in
https://github.com/elastic/elasticsearch/issues/104247#issuecomment-2018944371

There are some links in the output and they are in markdown syntax. We
should figure out how to make them work for kibana.
2024-04-09 14:19:48 -04:00
Parker Timmins
75228dfd45
Add granular error list to alias action response (#106514)
When an alias action list is posted with must_exist==false, and succeeds only partially, a list of results for each action are now returned. The results contain information about the requested action, indices, and aliases. If must_exist==true, or all actions fail, the call will return a 400 status along with the associated exception.
2024-04-09 12:11:49 -05:00
Nik Everett
aba7566409
ESQL: Better tests to AUTO_BUCKET (#107228)
This improves the tests for AUTO_BUCKET marginally, specifically so that
it tests all valid combinations of arguments and generates a correct
types table. This'll combine nicely with #106782 to generate the
signatures that kibana needs for it's editor.
2024-04-09 12:22:15 -04:00
Sean Story
4a5329d29b
typo: "not found" -> "not_found" (#107276) 2024-04-09 10:21:06 -05:00
István Zoltán Szabó
c50fcb95ed
[DOCS] Expands the list of possible values of the result parameter of the bulk API. (#107265) 2024-04-09 16:55:33 +02:00
Liam Thompson
3dccc66c2c
[DOCS][ESQL] Rename _Learning ESQL_ to _ESQL reference_ (#107259) 2024-04-09 14:16:24 +02:00
Liam Thompson
c1ef120fe2
[Docs][ESQL] Make functions reference more digestible (#107258)
* [Docs][ESQL] Make functions reference more digestible

* Remove redundant links
2024-04-09 14:15:54 +02:00
Luigi Dell'Aquila
2588c72a52
ES|QL: Add unit tests and docs for DATE_TRUNC() (#107145) 2024-04-09 10:41:34 +02:00
elasticsearchmachine
911aaf8ef9
Forward port release notes for v8.13.2 (#107243) 2024-04-09 08:08:36 +02:00
Lee Hinman
91bdfb84a0
Clarify data stream recommendations and best practices (#107233)
* Clarify data stream recommendations and best practices

Our documentation around data streams versus aliases could be interpreted in a way where someone doing *any* updates thinks they need to use an alias with indices instead of a data stream. This commit enhances the documentation around these areas to determine the correct abstraction in a more concrete way. It also tries to clarify that data streams still allow updates to the backing indices, and that a difference is last-write-wins versus first-write-wins.
2024-04-08 13:41:53 -06:00
elasticsearchmachine
00aee781a2
Forward port release notes for v8.13.1 (#107002) 2024-04-08 17:45:22 +02:00
Craig Taverner
a7b38394d9
ESQL: Support ST_DISJOINT (#107007)
* WIP Started developing ST_DISJOINT

Initially based on ST_INTERSECTS

* Fix functions list and add spatial point integration tests

* Update docs/changelog/107007.yaml

* More tests for shapes and cartesian-multigeoms

* Some more tests to highlight issues with DISJOINT on cartesian point indices

* Disable Lucene push-down for DISJOINT on cartesian point indices

* Added docs for ST_DISJOINT

* Support DISJOINT in the lucene-pushdown code for cartesian point indexes

* Re-enable push-to-source for DISJOINT on cartesian_point indices

* Fix docs example

* Try fix internal docs links which are not being rendered

* Fixed disjoint on empty geometry

* Added tests on empty linestring, and changed lucene push-down to exception

In lucene code only LineString can be empty, but in Elasticsearch even that is not allowed, resulting in parsing errors. So we cannot get to this code in the lucene push-down and now throw an error instead. The tests now assert on the warnings.

Note that for any predicate DISJOINT and INTERSECTS alike, the predicate fails, because the parsing error results in null, the function returns null, the predicate interprets this as false, and no documents match. This null-in-null-out rule means that DISJOINT and INTERSECTS give the same answer on invalid geometries.
2024-04-08 12:26:26 +02:00
Volodymyr Krasnikov
0faac52ac4
Metric for rejected indexing primary operations (per document) (#107080)
* Fix number of rejected primary operations

* Update docs/changelog/107080.yaml

* Update test

* Add metric 'es.indexing.primary_operations.document.rejections.ratio' + test

* rm useless changelog

* update docs

* use -1 as a default version on unsupported version
2024-04-07 21:09:58 -07:00