Commit graph

12427 commits

Author SHA1 Message Date
kanoshiou
deff3df9f0
ES|QL: Support ::date in inline cast (#123460)
* Inline cast to date

* Update docs/changelog/123460.yaml

* New capability for `::date` casting

* More tests

* Update tests

---------

Co-authored-by: Fang Xing <155562079+fang-xing-esql@users.noreply.github.com>
2025-03-11 17:08:10 -04:00
Mark Tozzi
3e949479d8
ESQL - Include thread names in profile output (#124262)
Resolves #123053

This adds the thread name to the driver sleep profile output.
---------

Co-authored-by: elasticsearchmachine <infra-root+elasticsearchmachine@elastic.co>
2025-03-11 15:53:22 +01:00
Carlos Delgado
2b40e73fe9
ES|QL - Add scoring for full text functions disjunctions (#121793) 2025-03-11 15:29:15 +01:00
Jan Calanog
435d1db5b9
Remove subs attribute (#124551) 2025-03-11 12:14:58 +01:00
Charlotte Hoblik
e51b50139b
Fix external URI images (#124350) 2025-03-10 11:31:47 +01:00
David Kilfoyle
e158cd868b
[Docs] Fix cross-repo links to Beats docs (#124360)
Co-authored-by: Colleen McGinnis <colleen.mcginnis@elastic.co>
2025-03-07 14:38:46 -05:00
Svilen Mihaylov
ee4bcac1db
Added optional parameters to QSTR ES|QL function (#121787)
Adds options to QSTR function.

#118619 added named function parameters. This PR uses this mechanism for allowing query string function parameters, so query string parameters can be used in ES|QL.

Closes #120933
2025-03-07 13:00:22 -05:00
Kostas Krikellas
296cae8a30
[DOCS] Document source-related restrictions (#124011)
* Document source-related restrictions

* Update mapping-source-field.md

* Update docs/reference/elasticsearch/mapping-reference/mapping-source-field.md

Co-authored-by: Marci W <333176+marciw@users.noreply.github.com>

* Update mapping-source-field.md

---------

Co-authored-by: Marci W <333176+marciw@users.noreply.github.com>
2025-03-06 11:38:09 -05:00
Colleen McGinnis
23be51a04f
[DOCS] fix external links (#124248) 2025-03-06 17:27:03 +01:00
Marci W
bea3af2467
[DOCS] Clarify support for doc_values (#124047)
* Update doc-values.md

* Make the note more visible

* fix link
2025-03-06 09:01:19 -05:00
Lee Hinman
47706b505f
Add index mode to get data stream API (#122486)
This commit adds the `index_mode` for both the data stream and each
backing index to the output of `GET /_data_stream`. An example looks
like:

```
{
  "data_streams" : [
    {
      "name" : "foo-things",
      "indices" : [
        {
          "index_name" : ".ds-foo-things-2025.02.13-000001",
          ...
          "index_mode" : "standard"
        }
      ],
      ...
      "index_mode" : "standard"
    },
    {
      "name" : "logs-foo-bar",
      "indices" : [
        {
          "index_name" : ".ds-logs-foo-bar-2025.02.13-000001",
          ...
          "index_mode" : "logsdb"
        },
        {
          "index_name" : ".ds-logs-foo-bar-2025.02.13-000002",
          ...
          "index_mode" : "logsdb"
        }
      ],
      ...
      "index_mode" : "logsdb",
    }
  ]
}
```
2025-03-06 07:39:58 +11:00
shainaraskas
a06c8ea5b8
Update node-settings.md (#123997)
* Update node-settings.md

Port change https://github.com/elastic/elasticsearch/pull/123939 forward to new docs system

* Update docs/reference/elasticsearch/configuration-reference/node-settings.md
2025-03-05 11:21:16 -05:00
Liam Thompson
2456cd375a
Add note to servicenow connector ref (#124101) 2025-03-05 15:26:22 +01:00
Craig Taverner
efe7379e67
Split ESQL functions/operators docs files (#123904)
* Port from asciidocalypse

* Fix links for operator lists

* Remove unused image files after moving/editing them

* Fix lists links

* Fix like/rlike links

* Fix remaining bad references to /elasticsearch/docs

* Fix logstash and beats references

* Fix logstash and beats references

* Fix image links
2025-03-04 14:59:31 +01:00
John Wagster
be577e382d
Update Flatten Graph Docs to Include a Real Flattened Graph 9.x (#123901)
updated flatten graph docs to include a real flattened graph
2025-03-03 14:33:53 -06:00
Colleen McGinnis
db5acd8976
add missing pages (#123774) 2025-03-03 15:02:51 +00:00
Liam Thompson
6b27e420fe
Cleanup search connectors, add some reference -> docs content signposts in various sections (#123733) 2025-02-28 17:10:09 +00:00
Liam Thompson
91c2654570
Fix broken cross-repo links, versions in search connectors docker instructions (#123700) 2025-02-28 16:02:54 +01:00
Colleen McGinnis
b7e3a1e14b
[docs] Migrate docs from AsciiDoc to Markdown (#123507)
* delete asciidoc files

* add migrated files

* fix errors

* Disable docs tests

* Clarify release notes page titles

* Revert "Clarify release notes page titles"

This reverts commit 8be688648d.

* Comment out edternal URI images

* Clean up query languages landing pages, link to conceptual docs

* Add .md to url

* Fixes inference processor nesting.

---------

Co-authored-by: Liam Thompson <32779855+leemthompo@users.noreply.github.com>
Co-authored-by: Liam Thompson <leemthompo@gmail.com>
Co-authored-by: Martijn Laarman <Mpdreamz@gmail.com>
Co-authored-by: István Zoltán Szabó <szabosteve@gmail.com>
2025-02-27 17:56:14 +01:00
Kathleen DeRusso
ae6474db63
Deprecate Behavioral Analytics CRUD apis (#122960)
* Deprecate Behavioral Analytics CRUD APIs

* Add allowed warning for REST Compatibility tests

* Update docs/changelog/122960.yaml

* Update changelog

* Update docs to add deprecation flags and fix failing tests

* Update changelog

* Update changelog again

* Update docs formatting

Co-authored-by: Liam Thompson <32779855+leemthompo@users.noreply.github.com>

* Skip asciidoc test

---------

Co-authored-by: Efe Gürkan YALAMAN <efeyalaman@gmail.com>
Co-authored-by: Liam Thompson <32779855+leemthompo@users.noreply.github.com>
Co-authored-by: Efe Gürkan YALAMAN <efeguerkan.yalaman@elastic.co>
2025-02-25 16:02:50 +01:00
Craig Taverner
ec82c24a87
Add support to VALUES aggregation for spatial types (#122886)
The original work at https://github.com/elastic/elasticsearch/pull/106065 did not support geospatial types with this comment:

> I made this work for everything but geo_point and cartesian_point because I'm not 100% sure how to integrate with those. We can grab those in a follow up.

The geospatial types should be possible to collect using the VALUES aggregation with similar behavior to the `ST_COLLECT` OGC function, based on the Elasticsearch convention that treats multi-value geospatial fields as behaving similarly to any geometry collection. So this implementation is a trivial addition to the existing values types support.
2025-02-25 11:38:51 +01:00
Luke Whiting
e3792d19b5
Allow data stream reindex tasks to be re-run after completion (#122510)
* Allow data stream reindex tasks to be re-run after completion

* Docs update

* Update docs/reference/migration/apis/data-stream-reindex.asciidoc

Co-authored-by: Keith Massey <keith.massey@elastic.co>

---------

Co-authored-by: Keith Massey <keith.massey@elastic.co>
2025-02-20 15:03:51 +00:00
David Turner
cdaa5dd7ad
Clarify breaking change note for #112903 (#122998)
Closes #122994
2025-02-20 12:11:56 +00:00
Lee Hinman
2ae80c799d
Allow setting the type in the reroute processor (#122409)
* Allow setting the `type` in the reroute processor

This allows configuring the `type` from within the ingest `reroute` processor. Similar to `dataset`
and `namespace`, the type defaults to the value extracted from the index name. This means that
documents sent to `logs-mysql.access.default` will have a default value of `logs` for the type.

Resolves #121553

* Update docs/changelog/122409.yaml
2025-02-18 12:38:00 -07:00
Nik Everett
df2f3b3b3f
ESQL: Update kibana signatures (#121951)
This updates the kibana signature json files in two ways:
* Renames `eval` to `scalar` - that's the name we use inside of ESQL and
  we may as well make the name the same.
* Calls the `CATEGORIZE` and `BUCKET` function `grouping` because they
  can only be used in the "grouping" positions of the `STATS` command.

Closes #113411
2025-02-07 09:51:09 -05:00
Fang Xing
f58fdf81e9
[ES|QL] Change function_named_parameters in Kibana doc to expected format (#121585)
* change function_named_parameters in kibana doc to expected format
2025-02-04 12:20:34 -05:00
elasticsearchmachine
69bdf465b0 Bump to version 9.1.0 2025-01-30 16:55:46 +00:00
Jim Ferenczi
fb3c666663
Remove outdated reference to internal semantic text format (#121276)
The semantic text format was updated in #119183. This commit removes the last remaining reference to the old format from the documentation to ensure consistency.
2025-01-30 15:01:55 +01:00
Chris Hegarty
4baffe4de1
Upgrade to Lucene 10.1.0 (#119308)
This commit upgrades to Lucene 10.1.0.
2025-01-30 13:41:02 +00:00
Liam Thompson
c8dfb4ea9e
[DOCS] Fix missing id syntax (#121264)
* [DOCS] Fix missing id syntax

* Update docs/reference/troubleshooting/common-issues/disk-usage-exceeded.asciidoc

* fix id
2025-01-30 12:52:37 +01:00
Jim Ferenczi
dbeb55cb3d
Enable Mapped Field Types to Override Default Highlighter (#121176)
This commit introduces the `MappedFieldType#getDefaultHighlighter`, allowing a specific highlighter to be enforced for a field.
The semantic field mapper utilizes this new functionality to set the `semantic` highlighter as the default.
All other fields will continue to use the `unified` highlighter by default.
2025-01-29 21:55:53 +00:00
Slobodan Adamović
c5ab17c3aa
Deprecate certificate-based remote cluster security model (#120806)
Today, Elasticsearch supports two models to establish secure connections
and trust between two Elasticsearch clusters:

- API key based security model
- Certificate based security model

This PR deprecates the _Certificate based security model_ in favour of *API key based security model*.
The _API key based security model_ is preferred way to configure remote clusters,
as it allows to follow security best practices when setting up remote cluster connections
and defining fine-grained access control.

Users are encouraged to migrate remote clusters from certificate to API key authentication.
2025-01-29 19:43:04 +01:00
Kuni Sen
a0f1856a40
(Doc+) Expand watermark resolution (#119174)
* (Doc+) Expand watermark resolution

Relaunch https://github.com/elastic/elasticsearch/pull/116892 since the original one seems to be outdated and hard to update branch.

* Apply suggestions from code review

Co-authored-by: shainaraskas <58563081+shainaraskas@users.noreply.github.com>

---------

Co-authored-by: shainaraskas <58563081+shainaraskas@users.noreply.github.com>
2025-01-29 19:31:50 +01:00
Luiz Santos
c0f3024c3f
Make it clear that previous enrich indices are deleted every 15 minutes (#109085)
Before this change, one could interpret that enrich policies are executed every 15 minutes, which is not true.
2025-01-29 19:28:43 +01:00
Liam Thompson
9edd64e608
[DOCS] Fix failing docs test (at least try) (#118934)
Fix failing docs test:

* Unmute test
* Replace hardcoded values with regex in snippet test
2025-01-29 19:21:58 +01:00
Nikolaj Volgushev
51b4fffb5e
Default to SSHA-256 as API key stored credential hasher (#120997)
API keys are high-entropy secure random strings. This means that the
additional work factor of functions like PBKDF or bcrypt are not
necessary, and a faster hash function like salted SHA-256 provides
adequate security against offline attacks (hash collision, brute force,
etc.).

This PR adds `SSHA-256` to the list of supported stored hash algorithms
for API key secrets, and makes it the default algorithm. Additionally,
this PR changes the format of API key secrets, moving from an encoded
UUID to a random string which increase the entropy of API keys from 122
bits to 128 bits, without changing overall secret length. 

Relates: ES-9504
2025-01-30 05:14:15 +11:00
Michael Peterson
d3f20e5b4b
Updated resolve/cluster end user docs with information about the timeout flag and no index expression endpoint (#121199) 2025-01-29 18:22:40 +01:00
Stanislav Malyshev
3669e061d4
Fix typo in docs example (#121206) 2025-01-29 09:44:42 -07:00
Peter Straßer
6b76457a23
Fix syntax errors in the rescore retriever example (#121024) 2025-01-29 16:10:59 +01:00
Michael Peterson
e9b877e58b
Clarify the behavior of remote/info and resolve/cluster for connected status of remotes (#118993) 2025-01-29 10:08:25 -05:00
Kathleen DeRusso
4b4c59de7f
Fix error in docs code snippet (#121187) 2025-01-29 16:05:05 +01:00
Benjamin Trent
038aab864e
Mark bbq indices as GA and add rolling upgrade integration tests (#121105)
With the introduction of our new backing algorithm and making rescoring
easier with the `rescore_vector` API, let's mark bbq as GA. 

Additionally, this commit adds rolling upgrade tests to ensure
stability.
2025-01-30 01:58:08 +11:00
Pat Whelan
9009606a47
[Transform] add support for extended_stats (#120340)
Building off of `stats` and multi-value aggregations, including the
limitation:
- all values of extended_stats will be mapped to `double` if mapping
  deduction is used

Relates #51925
2025-01-29 15:33:16 +01:00
Martijn van Groningen
952bf229fb
Conditionally enable logsdb by default (#121049)
Enable logsdb by default if logsdb.prior_logs_usage has not been set to true.

Meaning that if no data streams were created matching with the logs-- pattern in 8.x, then logsdb will be enabled by default for data streams matching with logs-*-* pattern.

Also removes LogsPatternUsageService as with version 9.0 and beyond, this component is no longer necessary.

Followup from #120708
Closes #106489
2025-01-29 15:03:28 +01:00
Liam Thompson
f5f0e3bd7f
[DOCS] Update getting-started.asciidoc (#116151) (#121173)
Update `new_field` to `language` which is the actual new field added in dynamic mapping

Co-authored-by: Ekwinder <ekwindersaini@gmail.com>
2025-01-30 00:52:11 +11:00
Valeriy Khakhutskyy
15b93fefdb
Extend documentation note. (#121146) 2025-01-29 13:03:42 +01:00
Jihyun(Brian) Jeong
e1207398c7
(Doc+) Clarify dimension field requirements for time_series aggregation (#119442)
* (Doc+) Clarify dimension field requirements for time_series aggregation

👋 howdy, team!

This PR adds a note explaining that time series indices require:
- index.mode set to "time_series"
- at least one dimension field with time_series_dimension: true
- a routing_path array listing those dimension fields

Without these settings, the time_series aggregation may return empty buckets or behave unexpectedly. By emphasizing the dimension field requirement, we help users configure their time series indices correctly and see meaningful aggregation results.

* Apply suggestions from code review

Co-authored-by: shainaraskas <58563081+shainaraskas@users.noreply.github.com>

---------

Co-authored-by: Liam Thompson <32779855+leemthompo@users.noreply.github.com>
Co-authored-by: shainaraskas <58563081+shainaraskas@users.noreply.github.com>
2025-01-29 13:03:11 +01:00
Stef Nestor
31597b3897
(Doc+) System Index definition (#120327) 2025-01-29 11:14:36 +01:00
Kofi B
5bcd170a0b
[DOCS] Added additional context to page (#120569) 2025-01-29 09:48:25 +01:00
Kofi B
2258911112
[DOCS] Search multiple indices added info (#120572)
* [DOCS] Search multiple indices added info

* Update docs/reference/search/search-your-data/search-multiple-indices.asciidoc

Co-authored-by: George Wallace <georgewallace@users.noreply.github.com>

* Update docs/reference/search/search-your-data/search-multiple-indices.asciidoc

Co-authored-by: George Wallace <georgewallace@users.noreply.github.com>

* Update docs/reference/search/search-your-data/search-multiple-indices.asciidoc

Co-authored-by: George Wallace <georgewallace@users.noreply.github.com>

* Update docs/reference/search/search-your-data/search-multiple-indices.asciidoc

Co-authored-by: George Wallace <georgewallace@users.noreply.github.com>

* Update docs/reference/search/search-your-data/search-multiple-indices.asciidoc

Co-authored-by: George Wallace <georgewallace@users.noreply.github.com>

---------

Co-authored-by: George Wallace <georgewallace@users.noreply.github.com>
2025-01-29 09:46:39 +01:00