Commit graph

12442 commits

Author SHA1 Message Date
Mike Pellegrini
f67b5d6e95
Mark semantic text as GA in docs (#124669) 2025-03-20 08:13:00 -04:00
Lisa Cawley
ec0f8be34d
[DOCS] Clean up Asciidoc links in markdown files (#125046) 2025-03-19 08:03:55 -07:00
Craig Taverner
65dfaf1c91
Rewrite Kibana docs asciidoc links to be MD links (#125155)
Did a few things:
* Rewrite Kibana docs asciidoc links to be MD links
* Make kibana docs links absolute to planned publication path
* Clarify which operators are generated and which are static
* Removed the trailing .md from kibana docs links
2025-03-19 13:56:05 +01:00
Kofi B
e34bfd166a
[DOCS] Opster Migration: Nested bool query addition (#124455)
added section related to nested bool queries to provide a more clear example and clean up surrounding language and grammatical issues
2025-03-18 20:42:31 -05:00
Larisa Motova
08ae54e423
[ES|QL] ToAggregateMetricDouble function (#124595)
This commit adds a conversion function from numerics (and aggregate
metric doubles) to aggregate metric doubles.

It is most useful when you have multiple indices, where one index uses
aggregate metric double (e.g. a downsampled index) and another uses a
normal numeric type like long or double (e.g. an index prior to
downsampling).
2025-03-18 11:39:27 -10:00
Charlotte Hoblik
64a56439a6
[DOCS] Restructure user settings reference pages (#125000)
* add elasticsearch settings page

* add logo to ech applicable settings

* removing ECH settings page

* removing duplicate information from ECH

* move settings to correcponding page

* update configuration page

* fix link

* Add applies_to frontmatter to auditing settings

* remove duplicate how-to pages

* fix broken links

* replce cloud icon text

* adjust settings pages

* add applies_to tag

---------

Co-authored-by: lcawl <lcawley@elastic.co>
2025-03-18 18:18:49 +01:00
Craig Taverner
50a7eb09d4
Fix ES|QL build.gradle for configuration-cache (#125097)
Earlier work on the ES|QL port of docs to V3 introduced an issue in the build.gradle file making it fail with --configuration-cache. This fixes that, as well as one other broken link and removes some unused files.

In addition we bring back partial support for deleting unused files. It is tricky to have full support for this due to the mix of static and generated content, particularly in the operators snippets.
2025-03-18 17:15:53 +01:00
David Turner
a2d98e44a1
Upgrade discovery-ec2 to AWS SDK v2 (#122062) 2025-03-18 19:38:16 +11:00
Craig Taverner
94cad286bc
Restructure query-languages docs files for clarity (#124797)
In a few previous PR's we restructured the ES|QL docs to make it possible to generate them dynamically.

This PR just moves a few files around to make the query languages docs easier to work with, and a little more organized like the ES|QL docs.

A bit part of this was setting up redirects to the new locations, so other repo's could correctly link to the elasticsearch docs.
2025-03-17 17:58:58 +01:00
Charlotte Hoblik
c9724557a2
add signposts to docs-content (#124866) 2025-03-17 11:41:52 +01:00
David Turner
37a559c57d
Mention zero-window state in networking docs (#124967)
Clarify that it is expected sometimes to see inter-node connections
sending zero-window advertisements as part of the usual TCP backpressure
mechanism.
2025-03-16 19:43:29 +00:00
George Wallace
472536c189
lookup join docs (#124531)
* lookup join docs


---------

Co-authored-by: Alexander Spies <alexander.spies@elastic.co>
2025-03-13 12:47:58 -06:00
Benjamin Trent
b2c1c4e0f0
New vector_rescore parameter as a quantized index type option (#124581)
This adds a new parameter to the quantized index mapping that allows
default oversampling and rescoring to occur. 

This doesn't adjust any of the defaults. It allows it to be configured.
When the user provides `rescore_vector: {oversample: <number>}` in the
query it will overwrite it.

For example, here is how to use it with bbq:

```
PUT rescored_bbq
{
  "mappings": {
    "properties": {
      "vector": {
        "type": "dense_vector",
        "index_options": {
          "type": "bbq_hnsw",
          "rescore_vector": {"oversample": 3.0}
        }
      }
    }
  }
}
```

Then, when querying, it will auto oversample the `k` by `3x` and rerank
with the raw vectors.

```
POST _search
{
  "knn": {
    "query_vector": [...],
    "field": "vector"
  }
}
```
2025-03-14 00:40:08 +11:00
Craig Taverner
d5ddb909a4
ESQL autogenerate docs v3 (#124312)
Building on the work started in https://github.com/elastic/elasticsearch/pull/123904, we now want to auto-generate most of the small subfiles from the ES|QL functions unit tests.

This work also investigates any remaining discrepancies between the original asciidoc version and the new markdown, and tries to minimize differences so the docs do not look too different.

The kibana json and markdown files are moved to a new location, and the operator docs are a little more generated than before (although still largely manual).
2025-03-13 14:16:46 +01:00
Charlotte Hoblik
9e754ec8f6
[DOCS] Plugin management reference cleanup (#124578)
* add content to plugin management

* add content to Plugin Management

* Update docs/reference/elasticsearch-plugins/plugin-management.md

Co-authored-by: florent-leborgne <florent.leborgne@elastic.co>

* fix applies-to tag

* add ech to docset.yml

---------

Co-authored-by: florent-leborgne <florent.leborgne@elastic.co>
2025-03-12 17:01:10 +01:00
kanoshiou
deff3df9f0
ES|QL: Support ::date in inline cast (#123460)
* Inline cast to date

* Update docs/changelog/123460.yaml

* New capability for `::date` casting

* More tests

* Update tests

---------

Co-authored-by: Fang Xing <155562079+fang-xing-esql@users.noreply.github.com>
2025-03-11 17:08:10 -04:00
Mark Tozzi
3e949479d8
ESQL - Include thread names in profile output (#124262)
Resolves #123053

This adds the thread name to the driver sleep profile output.
---------

Co-authored-by: elasticsearchmachine <infra-root+elasticsearchmachine@elastic.co>
2025-03-11 15:53:22 +01:00
Carlos Delgado
2b40e73fe9
ES|QL - Add scoring for full text functions disjunctions (#121793) 2025-03-11 15:29:15 +01:00
Jan Calanog
435d1db5b9
Remove subs attribute (#124551) 2025-03-11 12:14:58 +01:00
Charlotte Hoblik
e51b50139b
Fix external URI images (#124350) 2025-03-10 11:31:47 +01:00
David Kilfoyle
e158cd868b
[Docs] Fix cross-repo links to Beats docs (#124360)
Co-authored-by: Colleen McGinnis <colleen.mcginnis@elastic.co>
2025-03-07 14:38:46 -05:00
Svilen Mihaylov
ee4bcac1db
Added optional parameters to QSTR ES|QL function (#121787)
Adds options to QSTR function.

#118619 added named function parameters. This PR uses this mechanism for allowing query string function parameters, so query string parameters can be used in ES|QL.

Closes #120933
2025-03-07 13:00:22 -05:00
Kostas Krikellas
296cae8a30
[DOCS] Document source-related restrictions (#124011)
* Document source-related restrictions

* Update mapping-source-field.md

* Update docs/reference/elasticsearch/mapping-reference/mapping-source-field.md

Co-authored-by: Marci W <333176+marciw@users.noreply.github.com>

* Update mapping-source-field.md

---------

Co-authored-by: Marci W <333176+marciw@users.noreply.github.com>
2025-03-06 11:38:09 -05:00
Colleen McGinnis
23be51a04f
[DOCS] fix external links (#124248) 2025-03-06 17:27:03 +01:00
Marci W
bea3af2467
[DOCS] Clarify support for doc_values (#124047)
* Update doc-values.md

* Make the note more visible

* fix link
2025-03-06 09:01:19 -05:00
Lee Hinman
47706b505f
Add index mode to get data stream API (#122486)
This commit adds the `index_mode` for both the data stream and each
backing index to the output of `GET /_data_stream`. An example looks
like:

```
{
  "data_streams" : [
    {
      "name" : "foo-things",
      "indices" : [
        {
          "index_name" : ".ds-foo-things-2025.02.13-000001",
          ...
          "index_mode" : "standard"
        }
      ],
      ...
      "index_mode" : "standard"
    },
    {
      "name" : "logs-foo-bar",
      "indices" : [
        {
          "index_name" : ".ds-logs-foo-bar-2025.02.13-000001",
          ...
          "index_mode" : "logsdb"
        },
        {
          "index_name" : ".ds-logs-foo-bar-2025.02.13-000002",
          ...
          "index_mode" : "logsdb"
        }
      ],
      ...
      "index_mode" : "logsdb",
    }
  ]
}
```
2025-03-06 07:39:58 +11:00
shainaraskas
a06c8ea5b8
Update node-settings.md (#123997)
* Update node-settings.md

Port change https://github.com/elastic/elasticsearch/pull/123939 forward to new docs system

* Update docs/reference/elasticsearch/configuration-reference/node-settings.md
2025-03-05 11:21:16 -05:00
Liam Thompson
2456cd375a
Add note to servicenow connector ref (#124101) 2025-03-05 15:26:22 +01:00
Craig Taverner
efe7379e67
Split ESQL functions/operators docs files (#123904)
* Port from asciidocalypse

* Fix links for operator lists

* Remove unused image files after moving/editing them

* Fix lists links

* Fix like/rlike links

* Fix remaining bad references to /elasticsearch/docs

* Fix logstash and beats references

* Fix logstash and beats references

* Fix image links
2025-03-04 14:59:31 +01:00
John Wagster
be577e382d
Update Flatten Graph Docs to Include a Real Flattened Graph 9.x (#123901)
updated flatten graph docs to include a real flattened graph
2025-03-03 14:33:53 -06:00
Colleen McGinnis
db5acd8976
add missing pages (#123774) 2025-03-03 15:02:51 +00:00
Liam Thompson
6b27e420fe
Cleanup search connectors, add some reference -> docs content signposts in various sections (#123733) 2025-02-28 17:10:09 +00:00
Liam Thompson
91c2654570
Fix broken cross-repo links, versions in search connectors docker instructions (#123700) 2025-02-28 16:02:54 +01:00
Colleen McGinnis
b7e3a1e14b
[docs] Migrate docs from AsciiDoc to Markdown (#123507)
* delete asciidoc files

* add migrated files

* fix errors

* Disable docs tests

* Clarify release notes page titles

* Revert "Clarify release notes page titles"

This reverts commit 8be688648d.

* Comment out edternal URI images

* Clean up query languages landing pages, link to conceptual docs

* Add .md to url

* Fixes inference processor nesting.

---------

Co-authored-by: Liam Thompson <32779855+leemthompo@users.noreply.github.com>
Co-authored-by: Liam Thompson <leemthompo@gmail.com>
Co-authored-by: Martijn Laarman <Mpdreamz@gmail.com>
Co-authored-by: István Zoltán Szabó <szabosteve@gmail.com>
2025-02-27 17:56:14 +01:00
Kathleen DeRusso
ae6474db63
Deprecate Behavioral Analytics CRUD apis (#122960)
* Deprecate Behavioral Analytics CRUD APIs

* Add allowed warning for REST Compatibility tests

* Update docs/changelog/122960.yaml

* Update changelog

* Update docs to add deprecation flags and fix failing tests

* Update changelog

* Update changelog again

* Update docs formatting

Co-authored-by: Liam Thompson <32779855+leemthompo@users.noreply.github.com>

* Skip asciidoc test

---------

Co-authored-by: Efe Gürkan YALAMAN <efeyalaman@gmail.com>
Co-authored-by: Liam Thompson <32779855+leemthompo@users.noreply.github.com>
Co-authored-by: Efe Gürkan YALAMAN <efeguerkan.yalaman@elastic.co>
2025-02-25 16:02:50 +01:00
Craig Taverner
ec82c24a87
Add support to VALUES aggregation for spatial types (#122886)
The original work at https://github.com/elastic/elasticsearch/pull/106065 did not support geospatial types with this comment:

> I made this work for everything but geo_point and cartesian_point because I'm not 100% sure how to integrate with those. We can grab those in a follow up.

The geospatial types should be possible to collect using the VALUES aggregation with similar behavior to the `ST_COLLECT` OGC function, based on the Elasticsearch convention that treats multi-value geospatial fields as behaving similarly to any geometry collection. So this implementation is a trivial addition to the existing values types support.
2025-02-25 11:38:51 +01:00
Luke Whiting
e3792d19b5
Allow data stream reindex tasks to be re-run after completion (#122510)
* Allow data stream reindex tasks to be re-run after completion

* Docs update

* Update docs/reference/migration/apis/data-stream-reindex.asciidoc

Co-authored-by: Keith Massey <keith.massey@elastic.co>

---------

Co-authored-by: Keith Massey <keith.massey@elastic.co>
2025-02-20 15:03:51 +00:00
David Turner
cdaa5dd7ad
Clarify breaking change note for #112903 (#122998)
Closes #122994
2025-02-20 12:11:56 +00:00
Lee Hinman
2ae80c799d
Allow setting the type in the reroute processor (#122409)
* Allow setting the `type` in the reroute processor

This allows configuring the `type` from within the ingest `reroute` processor. Similar to `dataset`
and `namespace`, the type defaults to the value extracted from the index name. This means that
documents sent to `logs-mysql.access.default` will have a default value of `logs` for the type.

Resolves #121553

* Update docs/changelog/122409.yaml
2025-02-18 12:38:00 -07:00
Nik Everett
df2f3b3b3f
ESQL: Update kibana signatures (#121951)
This updates the kibana signature json files in two ways:
* Renames `eval` to `scalar` - that's the name we use inside of ESQL and
  we may as well make the name the same.
* Calls the `CATEGORIZE` and `BUCKET` function `grouping` because they
  can only be used in the "grouping" positions of the `STATS` command.

Closes #113411
2025-02-07 09:51:09 -05:00
Fang Xing
f58fdf81e9
[ES|QL] Change function_named_parameters in Kibana doc to expected format (#121585)
* change function_named_parameters in kibana doc to expected format
2025-02-04 12:20:34 -05:00
elasticsearchmachine
69bdf465b0 Bump to version 9.1.0 2025-01-30 16:55:46 +00:00
Jim Ferenczi
fb3c666663
Remove outdated reference to internal semantic text format (#121276)
The semantic text format was updated in #119183. This commit removes the last remaining reference to the old format from the documentation to ensure consistency.
2025-01-30 15:01:55 +01:00
Chris Hegarty
4baffe4de1
Upgrade to Lucene 10.1.0 (#119308)
This commit upgrades to Lucene 10.1.0.
2025-01-30 13:41:02 +00:00
Liam Thompson
c8dfb4ea9e
[DOCS] Fix missing id syntax (#121264)
* [DOCS] Fix missing id syntax

* Update docs/reference/troubleshooting/common-issues/disk-usage-exceeded.asciidoc

* fix id
2025-01-30 12:52:37 +01:00
Jim Ferenczi
dbeb55cb3d
Enable Mapped Field Types to Override Default Highlighter (#121176)
This commit introduces the `MappedFieldType#getDefaultHighlighter`, allowing a specific highlighter to be enforced for a field.
The semantic field mapper utilizes this new functionality to set the `semantic` highlighter as the default.
All other fields will continue to use the `unified` highlighter by default.
2025-01-29 21:55:53 +00:00
Slobodan Adamović
c5ab17c3aa
Deprecate certificate-based remote cluster security model (#120806)
Today, Elasticsearch supports two models to establish secure connections
and trust between two Elasticsearch clusters:

- API key based security model
- Certificate based security model

This PR deprecates the _Certificate based security model_ in favour of *API key based security model*.
The _API key based security model_ is preferred way to configure remote clusters,
as it allows to follow security best practices when setting up remote cluster connections
and defining fine-grained access control.

Users are encouraged to migrate remote clusters from certificate to API key authentication.
2025-01-29 19:43:04 +01:00
Kuni Sen
a0f1856a40
(Doc+) Expand watermark resolution (#119174)
* (Doc+) Expand watermark resolution

Relaunch https://github.com/elastic/elasticsearch/pull/116892 since the original one seems to be outdated and hard to update branch.

* Apply suggestions from code review

Co-authored-by: shainaraskas <58563081+shainaraskas@users.noreply.github.com>

---------

Co-authored-by: shainaraskas <58563081+shainaraskas@users.noreply.github.com>
2025-01-29 19:31:50 +01:00
Luiz Santos
c0f3024c3f
Make it clear that previous enrich indices are deleted every 15 minutes (#109085)
Before this change, one could interpret that enrich policies are executed every 15 minutes, which is not true.
2025-01-29 19:28:43 +01:00
Liam Thompson
9edd64e608
[DOCS] Fix failing docs test (at least try) (#118934)
Fix failing docs test:

* Unmute test
* Replace hardcoded values with regex in snippet test
2025-01-29 19:21:58 +01:00