Commit graph

78599 commits

Author SHA1 Message Date
Athena Brown
1a77947f34
Improve security-crypto threadpool overflow handling (#111369) (#111564)
Prior to this PR, when the security-crypto threadpool queue overflows and rejects API key hashing submissions, a toxic value (specifically, a future which will never be completed) is added to the API key auth cache. This toxic cache value causes future authentication attempts with that API key to fail by timeout, because they will attempt to wait for the toxic future, until that value is invalidated and removed from the cache. Additionally, this will hold on to memory for each request that waits on the toxic future, even after the request has timed out.

This PR adds a unit test to replicate this case, and adjusts the code which submits the key hashing task to the security-crypto threadpool to properly handle this point of failure by invalidating the cached future and notifying waiting handlers that the computation has failed.
2024-08-03 07:47:14 +10:00
István Zoltán Szabó
dde00b60f0
Revert "[DOCS] Adds adaptive_allocations to inference and trained model API d…" (#111551)
This reverts commit 7d10307429.
2024-08-02 16:06:16 +02:00
Nhat Nguyen
1c02690ec9
Fix DocValuesCodecDuelTests (#111503) (#111515)
We should not access any docValues attribute of the current document if 
advance() is exhausted or if advanceExact() returns false.

Closes #111470
2024-08-02 00:40:41 +10:00
Simon Cooper
3693c8092f
Add release version to setCompatibleVersions task (#111489) (#111514)
The release version is used to determine if it actually needs to update the CCS version or not
2024-08-02 00:34:18 +10:00
elasticsearchmachine
3e8c713c68 Bump versions after 7.17.23 release 2024-08-01 14:25:01 +00:00
Liam Thompson
e84a0c8e45
[DOCS] Clarify copy_to behavior with strict dynamic mappings (#111408) (#111513)
* [DOCS] Clarify copy_to behavior with strict dynamic mappings

* Add id

* De-verbosify

* Delete pesky comma

* More info about root and nest

* Fixes per review, clarify non-recursive explanation

* Skip tests for illustrative example

* Fix example syntax

* Fix typo
2024-08-01 23:01:26 +10:00
István Zoltán Szabó
7d10307429
[DOCS] Adds adaptive_allocations to inference and trained model API docs (#111476) (#111508) 2024-08-01 21:01:32 +10:00
Mark J. Hoy
ade5b13dc6
Add LTR License Check on PUT for Enterprise Licensing (#111248) (#111460)
* add isLicenseAllowedForAction trained model config

* fixup tests - trial is allowed

* fix license tests

* update tests for validate model static method

* add validateModel test; update license check
2024-07-31 05:53:21 +10:00
István Zoltán Szabó
5d0eb2a725
[DOCS] Expands top_n parameter description in the PUT inference API docs (#111446) (#111454)
Co-authored-by: Adam Demjen <demjened@gmail.com>
2024-07-31 02:01:01 +10:00
István Zoltán Szabó
edfbd5d3de
[DOCS] Adds elser service to the inference tutorial (#111406) (#111450)
* [DOCS] Adds elser service to the inference tutorial.

* [DOCS] Amends search intro text.

* [DOCS] Addresses feedback.
2024-07-30 23:13:20 +10:00
Adam Demjen
fd0251983c
Fix score count validation in reranker response (#111424)
* Fix score count validation in reranker response (backport)

* Update docs/changelog/111424.yaml

* Delete docs/changelog/111212.yaml

* Use constructor that exists

* Update 111424.yaml
2024-07-30 09:05:06 -04:00
Benjamin Trent
155eee6822
[8.15] Ensure vector similarity correctly limits inner_hits returned for nested kNN (#111363) (#111426)
* Ensure vector similarity correctly limits inner_hits returned for nested kNN (#111363)

For nested kNN we support not only similarity thresholds, but also
multi-passage search while retrieving more than one nearest passage.

However, the inner_hits retrieved for the kNN search would ignore the
restricted similarity. Meaning, the inner hits would return all
passages, not just the ones within the limited similarity and this is
confusing.

closes: https://github.com/elastic/elasticsearch/issues/111093
(cherry picked from commit 69c96974de)

* fixing for backport

* adj for backport

* fix compilation for tests
2024-07-29 18:25:45 -04:00
James Baiera
3f30e388fc
Fix enrich policy runner exception handling on empty segments response (#111290) (#111371)
* Fix enrich segment action listener exception logic

* Update docs/changelog/111290.yaml

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2024-07-30 07:27:37 +10:00
Mayya Sharipova
d43021eb00
Remove 4096 bool query max limit from docs (#111421) (#111422)
indices.query.bool.max_clause_count is set automatically and does
not default to 4096 as before. This remove mentions of 4096
from query documentations.

Relates to PR#91811
2024-07-30 05:43:17 +10:00
elasticsearchmachine
e0040761ad Mute org.elasticsearch.xpack.transform.integration.TransformIT testStopWaitForCheckpoint #106113 2024-07-30 04:16:38 +10:00
Max Hniebergall
fc352bd210
[Inference API] Replace model_id with inference_id in inference API except when stored (#111366) (#111417)
* Replace model_id with inference_id in inference API except when storing ModelConfigs

* Update docs/changelog/111366.yaml

* replace missed literals in tests
2024-07-29 13:35:48 -04:00
Liam Thompson
6ee87471f8
[DOCS] Additional reranking docs updates (#111350) (#111404)
* Simplify overview, specify available rerank options

* Update links

* Clarify eland-uploaded models is for hugging face
2024-07-29 23:00:37 +10:00
Liam Thompson
72cfb0b3b8
fix text_similarity_reranker doc (#111256) (#111401)
Co-authored-by: weizijun <weizijun.wzj@alibaba-inc.com>
2024-07-29 20:41:03 +10:00
Joe Gallo
010be8764f
Fix geoip processor isp_organization_name property and docs (#111372) (#111374) 2024-07-27 09:24:57 +10:00
Carlos Delgado
836b4a5bb2
Clarify some semantic_text docs (#111329) (#111353) 2024-07-26 17:30:22 +02:00
István Zoltán Szabó
00bfd0286f
[DOCS] Clarifies semantic query behavior on sparse and dense vector fields (#111339) (#111355)
* [DOCS] Clarifies semantic query behavior on sparse and dense vector fields.

* [DOCS] Adds a NOTE to the semantic query docs.
2024-07-27 01:17:57 +10:00
Liam Thompson
691319eb8c
[DOCS] Update retriever reranker options (#111337) (#111349)
* [DOCS] Update retriever reranker options

* Fix typo
2024-07-27 00:12:34 +10:00
István Zoltán Szabó
c2b5ba7b6f
[DOCS] Clarify that inference ID cannot match model ID (#111310) (#111334)
* Clarify that inference ID cannot match model ID

* Update service-elasticsearch.asciidoc

Co-authored-by: Pius <pius@elastic.co>
2024-07-26 13:02:28 +02:00
István Zoltán Szabó
21d418f1e0
[DOCS] Documents automatic text chunking behavior for semantic text. (#111331) (#111333) 2024-07-26 20:26:03 +10:00
István Zoltán Szabó
ebbf17b1f4
[DOCS] Amends PUT inference API docs with model download info (#111278) (#111332)
* [DOCS] Amends PUT inference API docs with model download info.

* [DOCS] Addresses feedback.
2024-07-26 12:19:05 +02:00
Alexander Spies
c430bc843c
ESQL: Mark union types as experimental (#111297) (#111325) 2024-07-26 18:42:51 +10:00
elasticsearchmachine
658a19eacc Mute org.elasticsearch.packaging.test.DockerTests test600Interrupt #111324 2024-07-26 18:10:55 +10:00
Pooya Salehi
7d8fe4a6cc
Update get snapshot status API doc (#111240) (#111295)
Make it clear that this API should be used only if the detailed shard
info is needed and only on ongoing snapshots. Remove incorrectly
mentioned `STATE` value.
2024-07-26 03:26:31 +10:00
Stef Nestor
c808d33744
(Doc+) Link Gateway Settings to Full Restart (#110902) (#111292)
* (Doc+) Link Gateway Settings to Full Restart

---------

Co-authored-by: shainaraskas <58563081+shainaraskas@users.noreply.github.com>
2024-07-26 01:37:16 +10:00
Stef Nestor
a5e13e0920
(Doc+) How to resolve shards >50GB (#111254) (#111289)
* (Doc+) How to resolve shards >50GB

---------

Co-authored-by: Ievgen Degtiarenko <ievgen.degtiarenko@gmail.com>
2024-07-26 00:52:59 +10:00
Liam Thompson
531f0291ce
Update README.asciidoc (#111244) (#111269)
adding text to match the positioning that Shay asked for on https://www.elastic.co/elasticsearch

(cherry picked from commit 66218164a0)

Co-authored-by: Serena Chou <serenachou@users.noreply.github.com>
2024-07-25 13:18:37 +02:00
Valeriy Khakhutskyy
8186f7a835
[ML] Extend lat_long documentation (#111239) (#111266)
This PR adds the explanation of what "typical" means for the lat_long function.
2024-07-25 18:55:47 +10:00
Mark Vieira
9321452bd6
Revert "Mute org.elasticsearch.packaging.test.DockerTests test600Interrupt #111132"
This reverts commit b521b48bf0.
2024-07-24 07:29:09 -07:00
Rene Groeschke
d4115943d8
Extend timeout of Krb5kDcContainer test container startup (#111198) (#111200)
- testcontainer startup timeout defaults to 60s and we see ocassionally this fixture
taking longer to startup in certain environments

fixes #111140
2024-07-24 15:06:22 +02:00
Panagiotis Bailis
2018c46241
backporting (#111230) 2024-07-24 20:46:08 +10:00
Alexander Spies
17c2161a1a
ESQL: Fix variable shadowing when pushing down past Project (#108360) (#111229)
Fix bugs caused by pushing down Eval, Grok, Dissect and Enrich past Rename, where after the pushdown, the columns added shadowed the columns to be renamed.

For Dissect and Grok, this enables naming their generated attributes to deviate from the names obtained from the dissect/grok patterns.

(cherry picked from commit e8a01bbd9c)

# Conflicts:
#	x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/optimizer/OptimizerRules.java
#	x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/plan/logical/Dissect.java
#	x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/plan/logical/Enrich.java
#	x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/plan/logical/Eval.java
#	x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/plan/logical/RegexExtract.java
2024-07-24 20:39:13 +10:00
Mark Vieira
8e6507b950
Make ConfigurationTests.test20HostnameSubstitution more resilient (#111216) (#111218)
This is an attempt to fix occasional test failures where asserting on a
request response fails because the cluster has not finished
initialization and cannot yet serve requests.

Closes #109660
2024-07-24 10:13:01 +10:00
elasticsearchmachine
b521b48bf0 Mute org.elasticsearch.packaging.test.DockerTests test600Interrupt #111132 2024-07-24 09:48:31 +10:00
Mark Vieira
00cfa68336
Make docker packaging test more resilient (#111205) (#111210)
Wrap check for container shutdown log message in an `assertBusy()` to
deal with race conditions.

Closes #111132
# Conflicts:
#	muted-tests.yml
2024-07-24 05:33:27 +10:00
Luigi Dell'Aquila
c9af95cc9e
Fix Dissect with leading non-ascii characters (#111184) (#111196)
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2024-07-24 01:54:04 +10:00
Luigi Dell'Aquila
0e6673f7ab
ES|QL: reduce max expression depth to 400 (#111186) (#111189) 2024-07-23 23:21:17 +10:00
Fang Xing
ecfe7384bb
docs for named and positional parameters (#111178) (#111190) 2024-07-23 22:51:27 +10:00
Craig Taverner
0f1fd0d5fd
Simple addition of ES|QL to geo overview page (#111158) (#111185) 2024-07-23 20:25:07 +10:00
David Kyle
1cc0311256
[ML DOCS]Timeout only applies to ELSER and built in E5 models (#111159) (#111182) 2024-07-23 18:51:05 +10:00
Joe Gallo
4b5a5100d1
[8.15] Backport #111117 and #111162 (#111170)
* Allow runtime java to match adoptium jdks (#111117)
* Use bundled jdk version for immutable collections patch (#111162)

Co-authored-by: Ryan Ernst <ryan@iernst.net>
2024-07-22 16:22:48 -04:00
Mark Vieira
a0d2d63068
Revert "Mute org.elasticsearch.multi_node.RollupIT org.elasticsearch.multi_node.RollupIT #111142"
This reverts commit fffdcbe4
2024-07-22 13:12:02 -07:00
Keith Massey
75c1703d7f
Avoid calling real maxmind endpoint from EnterpriseGeoIpDownloader (#111121) (#111171) 2024-07-23 05:44:58 +10:00
Mark Vieira
7cdc1b0df0
Unmute DockerTests.test600Interrupt (#111165) (#111168)
Investigating https://github.com/elastic/elasticsearch/issues/111132 and
it seems this test has been muted on `main` for some time. Let's unmute,
to see if this is specific to the 7.17 branch or not.
2024-07-23 04:58:50 +10:00
David Turner
572e039bbc
Rework docs on logging levels (#111143) (#111150)
Clarify that the default config is the recommended one, and that users
should not normally enable `DEBUG` or `TRACE` logging without looking at
the source code. Also reorders the information a bit for easier reading.
2024-07-22 20:45:49 +10:00
Albert Zaharovits
e551c743cc
Add comma before charset parameter in WWW-Authenticate response header (#110906) (#111144)
Add comma before charset parameter in WWW-Authenticate response header,
according to RFC 7617.

Co-authored-by: Philippus Baalman <philippus@gmail.com>
2024-07-22 18:07:34 +10:00