Commit graph

12605 commits

Author SHA1 Message Date
Slobodan Adamović
6c56c32f7a
Grant necessary Kibana application privileges to reporting_user role (#118058)
Previously, Kibana was authorizing (and granting application privileges)
to create reports, simply based on the `reporting_user` role name. This
PR makes these application privileges explicitly granted to the
`reporting_user` role.
2024-12-14 04:40:23 +11:00
Mark Tozzi
1e26791515
Esql bucket function for date nanos (#118474)
This adds support for running the bucket function over a date nanos field. Code wise, this just delegates to DateTrunc, which already supports date nanos, so most of the PR is just tests and the auto-generated docs.

Resolves #118031
2024-12-13 09:25:52 -05:00
Liam Thompson
528593b55f
[DOCS] Link to Elastic Rerank model landing page (#118574)
- Add link to Python notebook
- Fix heading level
2024-12-13 14:00:29 +00:00
Gal Lalouche
2be4cd983f
ESQL: Support ST_EXTENT_AGG (#117451)
This PR adds support for ST_EXTENT_AGG aggregation, i.e., computing a bounding box over a set of points/shapes (Cartesian or geo). Note the difference between this aggregation and the already implemented scalar function ST_EXTENT.

This isn't a very efficient implementation, and future PRs will attempt to read these extents directly from the doc values.
We currently always use longitude wrapping, i.e., we may wrap around the dateline for a smaller bounding box. Future PRs will let the user control this behavior.
Fixes #104659.
2024-12-13 12:41:24 +02:00
Alexander Spies
140d88c59a
ESQL: Dependency check for binary plans (#118326)
Make the dependency checker for query plans take into account binary plans and make sure that fields required from the left hand side are actually obtained from there (and analogously for the right).
2024-12-13 11:38:53 +01:00
John Wagster
ce0e4e4fa8
small doc fix for updates related to _source defaults found by community member (#118605) 2024-12-12 13:17:32 -06:00
Marci W
3cbdfba610
Fix invalid index mode (#118579) 2024-12-12 10:59:47 -05:00
Mayya Sharipova
b460f081c2
[DOCS] _index_prefix for highligh matched_fields (#118569)
Enhance documenation to explain that "_index_prefix" subfield must
be added to `matched_fields` param for highlighting a main field.
When doing prefix queries on fields that are indexed with prefixes,
"_index_prefix" subfield is used. If we try to highlight the main
field, we may not get any results. "_index_prefix" subfield must
be added to `matched_fields` which instructs ES to use matches
from "_index_prefix" to highlight the main field.
2024-12-12 10:24:55 -05:00
kosabogi
b2998378a3
[DOCS] Adds default inference endpoints information (#118463)
* Adds default inference andpoints information

* Update docs/reference/inference/inference-apis.asciidoc

Co-authored-by: Liam Thompson <32779855+leemthompo@users.noreply.github.com>

---------

Co-authored-by: Liam Thompson <32779855+leemthompo@users.noreply.github.com>
2024-12-12 12:15:28 +01:00
kosabogi
8c10f0cc38
Changes elser service to elasticsearch service in the Semantic search with the inference API page (#118536) 2024-12-12 12:15:17 +01:00
kosabogi
3cf7f97141
Adds CCS matrix for 8.17 (#118527)
Co-authored-by: Liam Thompson <32779855+leemthompo@users.noreply.github.com>
2024-12-12 11:17:16 +01:00
Liam Thompson
8fb6edab63
[DOCS] Consolidate connectors release notes on one page (#118464) 2024-12-12 10:52:41 +01:00
Sean Story
4db3f7b751
Add known issue for salesforce DLS (#118489) 2024-12-11 13:34:00 -06:00
Marci W
ae9bb90fd1
Update and edit logsdb docs for logsdb / synthetic source GA (#118303)
* Update licensing; fix screenshots; edit generally

* Small edit for clarity and style

* Update docs/reference/index-modules.asciidoc

Co-authored-by: Liam Thompson <32779855+leemthompo@users.noreply.github.com>

* Apply changes from review

Co-authored-by: Liam Thompson <32779855+leemthompo@users.noreply.github.com>

* Address review comments

* Match similar change from review

* More changes from review

* Apply suggestions from review

Co-authored-by: shainaraskas <58563081+shainaraskas@users.noreply.github.com>

* Apply suggestions from review

Co-authored-by: shainaraskas <58563081+shainaraskas@users.noreply.github.com>

* Update docs/reference/data-streams/logs.asciidoc

Co-authored-by: shainaraskas <58563081+shainaraskas@users.noreply.github.com>

* Apply suggestions from review

Co-authored-by: shainaraskas <58563081+shainaraskas@users.noreply.github.com>

* Apply suggestions from review

* Change to general subscription note

* Apply suggestions from review

Co-authored-by: Oleksandr Kolomiiets <olkolomiiets@gmail.com>

* Apply suggestions from review

Co-authored-by: Oleksandr Kolomiiets <olkolomiiets@gmail.com>

* Apply suggestions from review; additional edits

* Apply suggestions from review; clarity tweaks

* Restore previous paragraph structure and context

---------

Co-authored-by: Liam Thompson <32779855+leemthompo@users.noreply.github.com>
Co-authored-by: shainaraskas <58563081+shainaraskas@users.noreply.github.com>
Co-authored-by: Oleksandr Kolomiiets <olkolomiiets@gmail.com>
2024-12-11 13:24:24 -05:00
Liam Thompson
56e1ca52ea
[DOCS][101] Aggregations quickstart tutorial (#116251) 2024-12-11 16:06:24 +01:00
David Kyle
a7fdc10bd4
[DOCS][ML] Use elasticsearch service instead of deprecated elser service in tutorials (#118007) 2024-12-11 10:51:24 +00:00
Quentin Pradet
c473da5e64
Fix rest-api-spec and docs for bulk API (#118415) 2024-12-11 12:38:42 +04:00
Benjamin Trent
645657cc56
Remove old _knn_search tech preview API in v9 (#118104)
Removes the old `_knn_search` API that was never out of tech preview and
deprecated throughout the v8 cycle. 

To utilize the API, `compatible-with=8` can be utilized.
2024-12-11 02:01:25 +11:00
István Zoltán Szabó
17765e7398
[DOCS] Adds transform breaking changes to the migration guide (#118285)
* [DOCS] Adds transform breaking changes to the migration guide.

* [DOCS] Fixes typo.

* [DOCS] Fixes ordered list.
2024-12-10 15:39:03 +01:00
István Zoltán Szabó
d026904dda
[DOCS] Reviews docker examples. (#118339) 2024-12-10 15:16:27 +01:00
István Zoltán Szabó
27b07b3406
[DOCS] Documents dimensions param for openai service of Inference API (#118317)
Co-authored-by: David Kyle <david.kyle@elastic.co>
2024-12-10 14:12:10 +01:00
Carlos Delgado
eb59b989ef
ESQL: Expand type compatibility for match function and operator (#117555) 2024-12-09 19:56:10 +01:00
Dan Rubinstein
f40dc99f91
Adding transforms migration guide for 9.0 (#117353)
* Adding transforms migration guide for 9.0

* Adding shared transform attribute and simplifying wording

---------

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2024-12-09 10:14:32 -05:00
Pete Gillin
bc25a73543
Update UpdateForV9 in AttachmentProcessor (#118186)
We are not going to make this change in V9. We may do it in V10. This
change just bumps the annotation to remind us to revisit.

Since we are living with this for a while, it seems worth improving
the documentation. This now encourages explicitly setting the option
one way or the other, since you get a warning if you omit it. It also
changes the existing examples to use true rather than false, as that's
our recommendation. And it adds a new section with an example where
it's true, and moves the content previously in a note into that
section.
2024-12-09 14:28:24 +00:00
Liam Thompson
931f675891
Update connectors overview diagram (#118261) 2024-12-09 15:25:10 +01:00
kanoshiou
67ee03411b
ESQL: Enable async get to support formatting (#111104)
I've updated the listener for GET /_query/async/{id} to EsqlResponseListener, so it now accepts parameters (delimiter, drop_null_columns and format) like the POST /_query API. Additionally, I have added tests to verify the correctness of the code.

You can now set the format in the request parameters to specify the return style.

Closes #110926
2024-12-09 13:08:48 +01:00
kosabogi
6bb0799893
Updates h7 and h8 formatting (#118132) 2024-12-09 11:37:41 +01:00
kosabogi
b2b8e3f762
[DOCS] [8.17] Adds new default inference endpoint information (#117985)
* Adds new default inference information

* Update docs/reference/mapping/types/semantic-text.asciidoc

Co-authored-by: István Zoltán Szabó <istvan.szabo@elastic.co>

* Update docs/reference/search/search-your-data/semantic-search-semantic-text.asciidoc

Co-authored-by: István Zoltán Szabó <istvan.szabo@elastic.co>

* Update docs/reference/mapping/types/semantic-text.asciidoc

Co-authored-by: David Kyle <david.kyle@elastic.co>

---------

Co-authored-by: István Zoltán Szabó <istvan.szabo@elastic.co>
Co-authored-by: David Kyle <david.kyle@elastic.co>
2024-12-09 09:05:11 +01:00
Jim Ferenczi
c580024ea9
Add Highlighter for Semantic Text Fields (#118064)
This PR introduces a new highlighter, `semantic`, tailored for semantic text fields.
It extracts the most relevant fragments by scoring nested chunks using the original semantic query.

In this initial version, the highlighter returns only the original chunks computed during ingestion. However, this is an implementation detail, and future enhancements could combine multiple chunks to generate the fragments.
2024-12-06 18:42:50 +00:00
Mark Tozzi
7cd17d2185
Esql compare nanos and millis (#118027)
Resolves #116281

Introduces support for comparing millisecond dates with nanosecond dates, without the need for casting. Millisecond dates outside of the nanosecond date range are handled correctly.
2024-12-06 09:17:32 -05:00
István Zoltán Szabó
f27cb5efd3
[DOCS] Adds examples to inference processor docs (#116018) 2024-12-06 09:15:15 +01:00
Tommaso Teofili
91605860ee
Term query for ES|QL (#117359)
This commit adds a `term` function for ES|QL to run `TermQueries`.

For example:
FROM test | WHERE term(content, "dog")
2024-12-06 07:42:48 +00:00
kosabogi
9d35053760
Adds warning to Create inference API page (#118073) 2024-12-05 16:32:59 +01:00
Benjamin Trent
9a81eb2dbe
Indicate that rescore isn't allowed with retrievers, yet (#118019) 2024-12-04 14:10:32 -05:00
Jim Ferenczi
0901a2734e
Add option to store sparse_vector outside _source (#117917)
This PR introduces an option for `sparse_vector` to store its values separately from `_source` by using term vectors.
This capability is primarly needed by the semantic text field.
2024-12-04 17:29:46 +00:00
kosabogi
6855a4ecd3
[DOCS] Adds adaptive allocations information to Inference APIs (#117546)
* Adds adaptive allocations information to Inference APIs

* Update docs/reference/inference/inference-apis.asciidoc

Co-authored-by: Liam Thompson <32779855+leemthompo@users.noreply.github.com>

* Update docs/reference/inference/put-inference.asciidoc

Co-authored-by: Liam Thompson <32779855+leemthompo@users.noreply.github.com>

* Update docs/reference/inference/inference-apis.asciidoc

Co-authored-by: Liam Thompson <32779855+leemthompo@users.noreply.github.com>

---------

Co-authored-by: Liam Thompson <32779855+leemthompo@users.noreply.github.com>
2024-12-04 14:22:59 +01:00
kosabogi
ba1d5be199
Updates minimum_number_of_allocations description (#117746) 2024-12-04 14:22:26 +01:00
Craig Taverner
c7e985c3b6
Support ST_ENVELOPE and related ST_XMIN, etc. (#116964)
Support ST_ENVELOPE and related ST_XMIN, etc.

Based on the PostGIS equivalents:

https://postgis.net/docs/ST_Envelope.html
https://postgis.net/docs/ST_XMin.html
https://postgis.net/docs/ST_XMax.html
https://postgis.net/docs/ST_YMin.html
https://postgis.net/docs/ST_YMax.html
2024-12-04 12:20:47 +01:00
Niels Bauman
032b42fcf7
Make TransportLocalClusterStateAction wait for cluster to unblock (#117230)
This will make `TransportLocalClusterStateAction` wait for a new state
that is not blocked. This means we need a timeout (again). For
consistency's sake, we're reusing the REST param `master_timeout` for
this timeout as well.

The only class that was using `TransportLocalClusterStateAction` was
`TransportGetAliasesAction`, so its request needed to accept a timeout
again as well.
2024-12-04 12:17:13 +01:00
Jakob Reiter
4496aa0cbf
Update troubleshooting-unstable-cluster.asciidoc (#117887)
Added missing word
2024-12-04 10:56:58 +00:00
Jan Kuipers
31508f00a1
Document ES|QL categorize limitations (#117892)
* Document ES|QL categorize limitations

* Update x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/expression/function/grouping/Categorize.java

Co-authored-by: Alexander Spies <alexander.spies@elastic.co>

---------

Co-authored-by: Alexander Spies <alexander.spies@elastic.co>
2024-12-04 09:53:21 +01:00
mmahacek
5c1b3c7197
Update email.asciidoc (#117867)
Fix error in documentation.
2024-12-03 09:10:02 -05:00
Marci W
97a626b5ea
Remove ccs banner (#117844) 2024-12-02 14:46:41 -05:00
Mark Tozzi
913e0fbca8
ESQL Date Nanos Addition and Subtraction (#116839)
Resolves #109995

This adds support and tests for addition and subtraction of date nanos with periods and durations. It does not include support for date_diff, which is a separate ticket (#109999). The bulk of the PR is testing, the actual date math is all handled by library functions.

---------

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2024-12-02 14:08:07 -05:00
Jan Kuipers
ddc8b959ee
ES|QL categorize docs (#117827)
* Move ES|QL categorize out of snapshot functions

* Categorize docs

* Add experimental + fix docs

* Add experimental + fix docs
2024-12-02 16:41:02 +01:00
David Turner
9dcd9751f4
Add IMDSv2 support to repository-s3 (#117748)
The version of the AWS Java SDK we use already magically switches to
IMDSv2 if available, but today we cannot claim to support IMDSv2 in
Elasticsearch since we have no tests demonstrating that the magic really
works for us. In particular, this sort of thing often risks falling foul
of some restrictions imposed by the security manager (if not now then
maybe in some future release).

This commit adds proper support for IMDSv2 by enhancing the test suite
to add the missing coverage to avoid any risk of breaking this magical
SDK behaviour in future.

Closes #105135 Closes ES-9984
2024-12-02 20:01:48 +11:00
David Turner
c5166ccf6f
Revert "(+Doc) Link split-brain wiki (#108914)"
This reverts commit 12aab08330.
2024-12-02 08:11:34 +00:00
Panagiotis Bailis
ad83d9b35d
Updating retriever-examples documentation to run validation tests on the provided snippets (#116643) 2024-11-29 12:50:01 +00:00
Liam Thompson
ab604ada78
[DOCS] Update tutorial example (#117538) 2024-11-28 16:34:57 +01:00
Martijn van Groningen
6a4b68d263
Add source mode stats to MappingStats (#117463) 2024-11-28 10:53:39 +01:00