Commit graph

11610 commits

Author SHA1 Message Date
Andrei Verdes
fbe2b1ab24
update package-security.asciidoc to include link to reset password (#109314) 2024-06-05 11:38:52 +02:00
Parker Timmins
bb3ff8e924
ESQL: add REPEAT string function (#109220)
Add support for the string manipulation function REPEAT(string, number). This function concatenates the string argument with itself the specified number of times. If number is 0 an empty string is returned. If number is less than 0, null is returned and a warning is logged. If number is less than 0 and is a constant, the query will fail without executing.
2024-06-04 16:32:43 -05:00
Luigi Dell'Aquila
5f6e8f687b
ES|QL: add MV_APPEND function (#107001)
Adding `MV_APPEND(value1, value2)` function, that appends two values
creating a single multi-value. If one or both the inputs are
multi-values, the result is the concatenation of all the values, eg.

```
MV_APPEND([a, b], [c, d]) -> [a, b, c, d]
```

~I think for this specific case it makes sense to consider `null` values
as empty arrays, so that~ ~MV_APPEND(value, null) -> value~ ~It is
pretty uncommon for ESQL (all the other functions, apart from
`COALESCE`, short-circuit to `null` when one of the values is null), so
let's discuss this behavior.~

[EDIT] considering the feedback from Andrei, I changed this logic and
made it consistent with the other functions: now if one of the
parameters is null, the function returns null
2024-06-05 03:42:29 +10:00
Luigi Dell'Aquila
21952c7e36
ES|QL: add geo tests for mv_dedupe (#109342)
Adding more unit tests for MV_DEDUPE function, covering geo_point,
geo_shape, cartesian_point and cartesian_shape. This also adds docs for
Kibana.

Fixes https://github.com/elastic/elasticsearch/issues/108982
2024-06-05 03:33:14 +10:00
Joe Gallo
d9941f6285
Ingest geoip new databases release highlight (#109355) 2024-06-04 12:48:19 -04:00
Jedr Blaszyk
04124165ec
[Docs][Connector API] Add documentation for update featueres endpoint (#109346) 2024-06-04 16:38:18 +02:00
Nhat Nguyen
3a4dfb0066
Add remove index setting command (#109276)
The new subcommand elasticsearch-node remove-index-settings can be used 
to remove index settings from the cluster state in case where it
contains incompatible index settings that prevent the cluster from
forming. This tool can cause data loss and its use should be your last
resort.

Relates #96075
2024-06-03 18:23:13 -07:00
Liam Thompson
2268e383e8
[DOCS][ESQL][8.14] Add API key based security model info for ESQL CCS (#109155)
Co-authored-by: Jake Landis <jake.landis@elastic.co>
2024-06-03 18:44:33 +02:00
István Zoltán Szabó
d1da412a3e
[DOCS] Expands DELETE inference API docs (#109282)
* [DOCS] Expands DELETE inference API docs.

* [DOCS] Adds discrete flag.
2024-06-03 17:32:31 +02:00
shainaraskas
d12a318304
change from string to array in example (#109263) 2024-06-03 11:29:00 -04:00
István Zoltán Szabó
95ce898436
[DOCS] Adds docs to semantic text (#108311)
Co-authored-by: Carlos Delgado <6339205+carlosdelest@users.noreply.github.com>
Co-authored-by: Mike Pellegrini <mike.pellegrini@elastic.co>
Co-authored-by: Kathleen DeRusso <kathleen.derusso@elastic.co>
2024-05-31 16:56:07 +02:00
Martijn van Groningen
29ccca3ddf
Adjust index.mapping.dimension_fields.limit index setting default in docs. (#109091) 2024-05-31 10:52:31 +02:00
Jake Landis
28588e0847
update release notes (#109127) 2024-05-30 11:37:54 -05:00
Salvatore Campagna
f11ef44084
Introduce logs index mode as Tech Preview (#108896)
This PR introduces a new index mode, `logs`, which enables usage of LogsDB in Elasticsearch.
As a result of adopting the `logs` index mode, default index sorting is applied using the hostname
and @timestamp fields. Users are allowed, anyway, to override index sort settings.
By default, it will also use synthetic source and the same codecs used by TSDB.

Note: the logs index mode is a Tech Preview feature.
2024-05-30 14:26:48 +02:00
George Wallace
ceb941f48c
Removing server from the version compatibility table (#109168)
* Removing server from the version compatibility table

* fixed typo

---------

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2024-05-29 11:57:46 -06:00
István Zoltán Szabó
1413c67d99
[DOCS] Amends inference reference docs and tutorials (#109159)
* [DOCS] Fixes inference tutorial widgets.

* [DOCS] Adds link to notebooks, rearranges sections in PUT inference API docs.
2024-05-29 17:43:10 +02:00
elasticsearchmachine
0f8c375bc8
Forward port release notes for v8.13.4 (#108527) 2024-05-29 11:22:04 -04:00
Iván Cea Fontenla
f16f71e2a2
ESQL: Add ip_prefix function (#109070)
Added ESQL function to get the prefix of an IP. It works now with both
IPv4 and IPv6. For users planning to use it with mixed IPs, we may need
to add a function like "is_ipv4()" first.

**About the skipped test:** There's currently a "bug" in the
evaluators//functions that return null. Evaluators can't handle them.
We'll work on support for that in another PR. It affects other
functions, like `substring()`. In this function, however, it only
affects in "wrong" cases (Like an invalid prefix), so it has no impact.

Fixes https://github.com/elastic/elasticsearch/issues/99064
2024-05-29 10:23:45 -04:00
István Zoltán Szabó
1e58f3a485
[DOCS] Fixes sparse vector query docs. (#109153) 2024-05-29 14:56:59 +02:00
Liam Thompson
b6241711ef
[DOCS] Update CCS matrix for 8.14 (#109142) 2024-05-29 14:00:19 +02:00
Jedr Blaszyk
1044a0104f
[Connecor API] Add references to tutorial in docs (#109099) 2024-05-29 11:48:58 +02:00
Jake Landis
7504fed0b3
remote_cluster role documentation and expose to built in privs API (#108840)
This commit introduces the documentation for remote_clusters which is used to help
 express the monitor_enrich privilege needed to use the ENRICH keyword across clusters 
when using the API key based CCS security model.

This commit also adds "remote_clusters" to the built in privs API to for easier consumption
 in Kibana.
2024-05-28 13:51:21 -05:00
David Turner
efd450ee19
Clarify that red/yellow health must be addressed (#109090)
We don't expect a cluster to run with `yellow` health for an extended
period of time, but it's not clear from these docs that it's important
to bring the cluster back to `green` health ASAP. This commit clarifies
these docs.
2024-05-28 11:43:54 -04:00
Tim Grein
6d864154ca
[Inference API] Add Google AI Studio completion docs (#109089) 2024-05-28 15:21:33 +02:00
David Turner
42e5293c04
Capture GC logs alongside heap dumps (#109087)
GC logs can be important to understand a heap dump, especially if
there's lots of unreachable objects and the GC is struggling to keep up.
2024-05-28 04:54:04 -04:00
Oleksandr Kolomiiets
42f4294a86
Enable fallback synthetic source for token_count (#109044) 2024-05-27 10:22:59 -07:00
István Zoltán Szabó
2b0d2c9c23
[DOCS] updates transforms at scale doc with date rounding. (#109073) 2024-05-27 16:34:01 +02:00
Luigi Dell'Aquila
a5b1848c14
ES|QL: more tests for coalesce() function (#109032)
Adding more unit tests for `coalesce()` function, in particular adding
tests for `ip`, `date` and spatial data types.

This also generates the right signatures for Kibana.

Related to https://github.com/elastic/elasticsearch/issues/108982
2024-05-27 04:36:06 -04:00
Oleksandr Kolomiiets
eea996c172
Add synthetic source support for geo_shape via fallback implementation (#108881)
This PR enables geo_shape mapper to use fallback synthetic source infrastructure and as such adds synthetic source support for this field type.
2024-05-24 10:19:22 -07:00
Carlos Delgado
474a5a1174
Add docs note for limits on synonyms (#108967) 2024-05-24 19:02:00 +02:00
Oleksandr Kolomiiets
8cfdbcc9a4
Documentation for ignore_malformed support with synthetic source for aggregate_metric_double (#108983) 2024-05-24 09:49:38 -07:00
Niels Bauman
45b8c3d20c
Use unique index patterns in template tests (#108946)
These patterns overlapped with certain templates from
the APM plugin.
2024-05-23 20:22:58 +02:00
Stef Nestor
4ab4d8727f
(+Doc) Recover from "no_valid_shard_copy" (#108929)
* (+Doc) Recover from "no_valid_shard_copy"

👋 @shainaraskas @DaveCTurner @anniegale9538  as follow-up to https://github.com/elastic/elasticsearch/pull/108263, this fixes the now targeted doc to make the recovery options look like alternatives rather than sequential steps.

* Apply suggestions from code review

Co-authored-by: Ievgen Degtiarenko <ievgen.degtiarenko@elastic.co>

---------

Co-authored-by: Ievgen Degtiarenko <ievgen.degtiarenko@elastic.co>
2024-05-23 11:13:07 -06:00
Alexander Spies
c5ac06a70c
Remove esql version from docs (#108933)
Follow-up to https://github.com/elastic/elasticsearch/pull/108919. The
latter needs to be merged first to have the docs tests pass, as it makes
the version parameter optional in requests.
2024-05-23 10:36:15 -04:00
Mary Gouseti
af45653e00
Expose basic x-pack telemetry for failure store (#108899) 2024-05-23 16:45:11 +03:00
Kathleen DeRusso
7f35f1bed0
Add sparse_vector query (#108254)
---------

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
Co-authored-by: Benjamin Trent <ben.w.trent@gmail.com>
2024-05-22 17:06:57 -04:00
Annie Hansen
582c6c0400
(DOC +) Add resolutions to Allocation Explain examples (#108263)
* (DOC +) Add resolutions to Allocation Explain examples

* Update docs/reference/cluster/allocation-explain.asciidoc

Co-authored-by: shainaraskas <58563081+shainaraskas@users.noreply.github.com>

* Update docs/reference/cluster/allocation-explain.asciidoc

Co-authored-by: shainaraskas <58563081+shainaraskas@users.noreply.github.com>

* Update docs/reference/cluster/allocation-explain.asciidoc

Co-authored-by: David Turner <david.turner@elastic.co>

---------

Co-authored-by: shainaraskas <58563081+shainaraskas@users.noreply.github.com>
Co-authored-by: David Turner <david.turner@elastic.co>
2024-05-22 14:39:27 -06:00
Stef Nestor
4d3ca2d029
(+Doc) link split-brain wiki from quorom decision making (#108915)
Mini change to link the [wiki page about "split-brain"](https://en.wikipedia.org/wiki/Split-brain_(computing)) as an industry-not-Elastic term under [Quorum-based decision making](https://www.elastic.co/guide/en/elasticsearch/reference/current/modules-discovery-quorums.html)
2024-05-22 13:22:03 -06:00
Stef Nestor
12aab08330
(+Doc) Link split-brain wiki (#108914)
Mini change to link the wiki page about "split-brain" as an industry-not-Elastic term under [Voting configurations](https://www.elastic.co/guide/en/elasticsearch/reference/current/modules-discovery-voting.html).
2024-05-22 13:21:54 -06:00
Kathleen DeRusso
74d7010a8f
Rename rule query and add support for multiple rulesets (#108831) 2024-05-22 15:20:34 -04:00
Jake Landis
ff92296217
[docs] Prevent DLS/FLS if replication is assigned (#108839)
This commit adds documentation for the DLS/FLS restriction for RCS 2.0 API keys 
where both access and replication are defined and access has DSL/FLS.
This commit also fixes a few misleading variable names.
related: #108600
2024-05-22 12:05:34 -05:00
Panagiotis Bailis
06957f6e31
Adding score from RankDoc to SearchHit (#108870) 2024-05-22 15:43:49 +03:00
David Kyle
d38d1af242
[ML] GA the update trained model action (#108868)
Accidentally missed when the other trained model APIs went GA
2024-05-22 13:30:25 +01:00
Kathleen DeRusso
3911061869
Update Search Applications docs with more introductory information about search templates (#108697)
* Update Search Applications docs with more introductory information about search templates

* Add docs tests

* Skip test

* Fix test

* Unskip test

* Add comment RE: reasoning behind test setup
2024-05-22 08:04:14 -04:00
Iván Cea Fontenla
212fc05808
Reapply "ESQL: Expose "_ignored" metadata field" (#108864) (#108871)
Expose "_ignored" metadata field in ESQL queries.

This is the same code merged here:
https://github.com/elastic/elasticsearch/pull/108770 Which got reverted
here: https://github.com/elastic/elasticsearch/pull/108864

It was reverted because of a test failure:
https://gradle-enterprise.elastic.co/s/dpi2eib2x2fj2
2024-05-22 07:06:04 -04:00
Alexander Spies
16a5d248b7
ESQL: Clone ql for esql (#108773)
Part of https://github.com/elastic/elasticsearch/issues/106679

* Copy the `ql` project into a different project _just for esql_, call it `esql-core`.
* Make `esql` depend only on the latter.
* Fix `EsqlNodeSubclassTests`; I'm confused why this didn't bite us earlier.
* Update the warning regexes in some csv tests as the exceptions have other package names now.

**Note to reviewers:** Exclude the first commit when viewing the diff,
as that contains only the actual copying of `ql`. The remaining commits
are the actually meaningful ones. _The `build.gradle` files probably
require the most attention._
2024-05-22 04:35:17 -04:00
Oleksandr Kolomiiets
91d502cec6
Add generic fallback implementation for synthetic source (#108222)
This PR uses infrastructure from #107567 to implement a fallback implementation of synthetic source for field mappers that don't support it natively. In that case we will store source of such field as is in a separate stored field.
2024-05-21 11:30:30 -07:00
Iván Cea Fontenla
04f1fcee51
Revert "ESQL: Expose "_ignored" metadata field" (#108864)
Reverting after tests failure:
https://gradle-enterprise.elastic.co/s/dpi2eib2x2fj2

Reverts elastic/elasticsearch#108770
2024-05-21 11:22:27 -04:00
Iván Cea Fontenla
47370a15e6
ESQL: Expose "_ignored" metadata field (#108770)
Expose "_ignored" metadata field in ESQL queries
2024-05-21 07:32:32 -04:00
David Turner
49a253fa1a
Expose ?master_timeout in autoscaling APIs (#108759)
Relates #107984
2024-05-21 04:24:08 -04:00