Commit graph

11436 commits

Author SHA1 Message Date
Salvatore Campagna
4dfcb0897e
Fetch meta fields in FetchFieldsPhase using ValueFetcher (#106325)
Here we extract the logic to populate metadata fields such as _ignored, _routing, _size and the deprecated _type into FetchFieldsPhase so that we can use the ValueFetcher interface to retrieve field values. This allows us to fetch values no matter if the Mapper uses stored or doc values.
2024-04-15 11:02:18 +02:00
István Zoltán Szabó
b9322da325
[DOCS] Fixes section levels in POST inference API docs. (#107451) 2024-04-15 10:31:09 +02:00
Artem Prigoda
6a300509cd
Add metric for calculating index flush time excluding waiting on locks (#107196)
Add a new `total_time_excluding_waiting_on_lock metric` to the index flush stats that measures the flushing time excluding waiting on the flush lock. This metrics provides a more granular view on flush performance and without the overhead of flush throttling.

Resolves ES-7201
2024-04-12 15:04:08 +02:00
Joe Gallo
6ff3a2628a
Add support for the 'Enterprise' database to the geoip processor (#107377) 2024-04-11 16:45:10 -04:00
Joe Gallo
5266f79b16
Add support for the 'Anonymous IP' database to the geoip processor (#107287) 2024-04-11 14:05:52 -04:00
shainaraskas
648c9cb05c
[DOCS] Add azure storage secure settings while the node is running (#107163) 2024-04-11 13:00:31 -04:00
Nik Everett
aac17616a3
ESQL: Improve tests and docs for some functions (#107331)
This improves the tests and docs for a few functions, specifically `E`,
`FLOOR`, `PI`, `POW`, and `ROUND`. The examples and tested signatures
will get copied into the docs and kibana signatures.


Co-authored-by: Liam Thompson <32779855+leemthompo@users.noreply.github.com>
2024-04-11 12:41:56 -04:00
Fang Xing
0075c1fb1e
[ES|QL] String literal implicit casting (#106932)
* string literal casting for scalar functions and arithmetic operations.
2024-04-10 21:20:12 -04:00
Brian Seeders
063035b12e
[8.13.2] Update release notes with missing JDK downgrade PR 2024-04-10 14:12:07 -04:00
Stef Nestor
9a2bfb9e85
(Doc+) Point ingest to Alias not Bootstrapped Index (#107327)
👋 @dakrone mentioned baby-update for docs. 

Sometimes users believe they should point client-side (e.g. Logstash's Elasticsearch output `index`) to the bootstrapped index. This highlights they point ingest towards the alias as we're expecting.
2024-04-10 13:37:49 -04:00
David Turner
ccbb5badce
Fix support for infinite ?master_timeout (#107050)
Specifying `?master_timeout=-1` on an API which performs a cluster state
update means that the cluster state update task will never time out
while waiting in the pending tasks queue. However this parameter is also
re-used in a few places where a timeout of `-1` means something else,
typically to timeout immediately. This commit fixes those places so that
`?master_timeout=-1` consistently means to wait forever.
2024-04-10 18:32:38 +01:00
István Zoltán Szabó
1587dada58
[DOCS] Fixes a typo in the HugggingFace tutorial. (#107321) 2024-04-10 18:50:44 +02:00
Jonathan Buttner
c9e84558b7
[ML] Adding a timeout parameter to the inference API (#107242)
* Plumbing timeout through the request

* Passing timeout through external services

* Update docs/changelog/107242.yaml

* Fixing tests and adjusting docs

* Correcting timeout field name

* Reporting error message for elser

* Removing unused code
2024-04-10 12:29:40 -04:00
István Zoltán Szabó
afb492272a
[DOCS] Adds HuggingFace example to inference API tutorial (#107298) 2024-04-10 17:57:18 +02:00
Craig Taverner
d915b964ba
Rename ST_CENTROID to ST_CENTROID_AGG (#107226)
* Rename ST_CENTROID to ST_CENTROID_AGG

In order to allow development of a scalar ST_CENTROID function.

* Fix table alignment
2024-04-10 17:56:45 +02:00
Carlos Delgado
f8e516eb9c
Update sparse_vector docs on index version availability (#107315) 2024-04-10 17:41:42 +02:00
Keith Massey
48a88c575c
Renaming GeoIpDownloaderStatsAction (#107290)
Renaming GeoIpDownloaderStatsAction to GeoIpStatsAction
2024-04-10 09:21:24 -05:00
Liam Thompson
943885d0cd
[DOCS][ESQL] Render locate function docs (#107305) 2024-04-10 15:12:20 +02:00
Jonathan Buttner
8638deeb9e
Openai model_id is required (#107286) 2024-04-10 08:37:49 -04:00
Bogdan Pintea
8bcbc97128
Rename generated docs for (renamed) BUCKET func (#107299)
This checks in the generated-by-test doc files for newly renamed BUCKET
function.
2024-04-10 06:50:12 -04:00
David Turner
ceeee1bf56
Recommend NFS over S3-like repositories (#107297)
Allegedly-S3-compatible APIs are very popular these days, but many
third-party systems offering such an API also support a shared
filesystem interface. Shared filesystem protocols such as NFS are much
better specified than the S3 API, and experience shows that they lead to
fewer compatibility headaches. This commit adds a recommendation to the
`repository-s3` docs to consider such an interface instead.
2024-04-10 11:39:38 +01:00
Bogdan Pintea
d6f9d1e69e
ESQL: Rename AUTO_BUCKET to just BUCKET (#107197)
This renames the function AUTO_BUCKET to just BUCKET.
It also removes the experimental tagging of the function in the docs, making it generally available.
2024-04-10 12:21:08 +02:00
David Turner
ec2a4ca8b3
Expand release note for #105044 (#107257)
Users of supposedly-S3-compatible storage may need to be aware of this
change, so this commit expands the release notes to link to the relevant
S3 documentation.
2024-04-10 06:52:14 +01:00
Nik Everett
96227a1970
ESQL: Generate kibana inline docs (#106782)
This takes a stab at generating the markdown files that Kibana uses for
its inline help. It doesn't include all of the examples because the
`@Example` annotation is not filled in - we're tracking that in
https://github.com/elastic/elasticsearch/issues/104247#issuecomment-2018944371

There are some links in the output and they are in markdown syntax. We
should figure out how to make them work for kibana.
2024-04-09 14:19:48 -04:00
Parker Timmins
75228dfd45
Add granular error list to alias action response (#106514)
When an alias action list is posted with must_exist==false, and succeeds only partially, a list of results for each action are now returned. The results contain information about the requested action, indices, and aliases. If must_exist==true, or all actions fail, the call will return a 400 status along with the associated exception.
2024-04-09 12:11:49 -05:00
Nik Everett
aba7566409
ESQL: Better tests to AUTO_BUCKET (#107228)
This improves the tests for AUTO_BUCKET marginally, specifically so that
it tests all valid combinations of arguments and generates a correct
types table. This'll combine nicely with #106782 to generate the
signatures that kibana needs for it's editor.
2024-04-09 12:22:15 -04:00
Sean Story
4a5329d29b
typo: "not found" -> "not_found" (#107276) 2024-04-09 10:21:06 -05:00
István Zoltán Szabó
c50fcb95ed
[DOCS] Expands the list of possible values of the result parameter of the bulk API. (#107265) 2024-04-09 16:55:33 +02:00
Liam Thompson
3dccc66c2c
[DOCS][ESQL] Rename _Learning ESQL_ to _ESQL reference_ (#107259) 2024-04-09 14:16:24 +02:00
Liam Thompson
c1ef120fe2
[Docs][ESQL] Make functions reference more digestible (#107258)
* [Docs][ESQL] Make functions reference more digestible

* Remove redundant links
2024-04-09 14:15:54 +02:00
Luigi Dell'Aquila
2588c72a52
ES|QL: Add unit tests and docs for DATE_TRUNC() (#107145) 2024-04-09 10:41:34 +02:00
elasticsearchmachine
911aaf8ef9
Forward port release notes for v8.13.2 (#107243) 2024-04-09 08:08:36 +02:00
Lee Hinman
91bdfb84a0
Clarify data stream recommendations and best practices (#107233)
* Clarify data stream recommendations and best practices

Our documentation around data streams versus aliases could be interpreted in a way where someone doing *any* updates thinks they need to use an alias with indices instead of a data stream. This commit enhances the documentation around these areas to determine the correct abstraction in a more concrete way. It also tries to clarify that data streams still allow updates to the backing indices, and that a difference is last-write-wins versus first-write-wins.
2024-04-08 13:41:53 -06:00
elasticsearchmachine
00aee781a2
Forward port release notes for v8.13.1 (#107002) 2024-04-08 17:45:22 +02:00
Craig Taverner
a7b38394d9
ESQL: Support ST_DISJOINT (#107007)
* WIP Started developing ST_DISJOINT

Initially based on ST_INTERSECTS

* Fix functions list and add spatial point integration tests

* Update docs/changelog/107007.yaml

* More tests for shapes and cartesian-multigeoms

* Some more tests to highlight issues with DISJOINT on cartesian point indices

* Disable Lucene push-down for DISJOINT on cartesian point indices

* Added docs for ST_DISJOINT

* Support DISJOINT in the lucene-pushdown code for cartesian point indexes

* Re-enable push-to-source for DISJOINT on cartesian_point indices

* Fix docs example

* Try fix internal docs links which are not being rendered

* Fixed disjoint on empty geometry

* Added tests on empty linestring, and changed lucene push-down to exception

In lucene code only LineString can be empty, but in Elasticsearch even that is not allowed, resulting in parsing errors. So we cannot get to this code in the lucene push-down and now throw an error instead. The tests now assert on the warnings.

Note that for any predicate DISJOINT and INTERSECTS alike, the predicate fails, because the parsing error results in null, the function returns null, the predicate interprets this as false, and no documents match. This null-in-null-out rule means that DISJOINT and INTERSECTS give the same answer on invalid geometries.
2024-04-08 12:26:26 +02:00
Volodymyr Krasnikov
0faac52ac4
Metric for rejected indexing primary operations (per document) (#107080)
* Fix number of rejected primary operations

* Update docs/changelog/107080.yaml

* Update test

* Add metric 'es.indexing.primary_operations.document.rejections.ratio' + test

* rm useless changelog

* update docs

* use -1 as a default version on unsupported version
2024-04-07 21:09:58 -07:00
Niels Bauman
0f3ac367ac
Rename values of FailureStoreOptions (#107062)
With these new values, there's a better match between selecting failure stores in read and write operations.
2024-04-06 08:46:38 +02:00
Moritz Mack
667a060971
Fix link in 8.13 release notes. (#107161)
Use id for link instead. Relates to
https://github.com/elastic/elasticsearch/pull/107159
2024-04-05 11:09:03 -04:00
Moritz Mack
2cfcefba9c
Update 8.13 known issues with JDK 22 bug / recommendation to downgrade (#107156)
Update 8.13 known issues with JDK 22 bug / recommendation to downgrade.

I'll follow up adding this to 8.13.1 as well once backported.
2024-04-05 09:46:22 -04:00
Tommaso Teofili
54eeb622d5
Add ES|QL Locate function (#106899)
* Add ES|QL Locate function
2024-04-05 15:29:54 +02:00
David Kyle
173900f89e
[ML] Update last usages of model_id to inference_id (#107133) 2024-04-05 12:10:03 +01:00
shainaraskas
8a1df9be2d
[DOCS] fix time zone logic example (#106962)
* [DOCS] fix time zone logic example

* specify standard time

* goodbye e.g.
2024-04-04 10:44:14 -04:00
István Zoltán Szabó
29a3256a7d
[DOCS] Makes Inference APIs main page more informative. (#107100) 2024-04-04 15:42:03 +02:00
Ioana Tagirta
7b254218fb
Add ES|QL signum function (#106866)
* Add ES|QL signum function

* Update docs/changelog/106866.yaml

* Skip csv tests for versions older than 8.14

* Reference layout docs file and fix instructions for adding functions

* Break csv specs by param type

* More tests
2024-04-04 09:48:35 +02:00
David Turner
9a2f8a80eb
Add remote cluster network troubleshooting docs (#107072)
Spells out in a little more detail our expectations for remote cluster
connections, including an example log message when the network is
unreliable and some suggestions for how to troubleshoot further.
2024-04-04 02:37:13 -04:00
Albert Zaharovits
36bcb6b398
Query API Keys support for both aggs and aggregations keywords (#107054)
The Query API Key Information endpoint supports aggs since #104895.
But some lang clients actually use the `aggregations` keyword in requests,
as the preferred synonym to `aggs`.
This PR adds support for the `aggregations` request keyword as a synonym
for the existing `aggs` term.

Closes #106839
2024-04-03 18:33:14 +03:00
Bogdan Pintea
f9ae6db319
ESQL: Add docs for the OPTIONS directive (#107013)
This adds the docs for the newly added `OPTIONS` directive to `FROM`.
2024-04-03 16:23:36 +02:00
shainaraskas
206a0b7a4c
[DOCS] Remove obsolete accounting circuit breakers (#107015) 2024-04-03 09:54:53 -04:00
shainaraskas
ea9e6a9537
Clarify closed index setting warning (#106888) 2024-04-03 09:48:31 -04:00
Nik Everett
b97e2d61fb
ESQL: Fixup docs for LOG and LOG10 (#106963)
This merges all of the hand written docs for `LOG` and `LOG10` into the
annotations which updates the `META FUNCTIONS` - now it'll always be the
same as the docs. This also deletes the hand maintained docs and let's
the documentation generation process rebuild it.
2024-04-03 09:46:32 -04:00