Commit graph

78599 commits

Author SHA1 Message Date
Vishal Raj
253e8544a6
[plugin/apm-data] Use component-templates to configure fallback to ILM (#112432) 2024-09-02 20:03:54 +01:00
Ignacio Vera
d39cc88bc2
Fix test configuration for merge policy in LatLonShapeDocValuesQueryTests and CartesianShapeDocValuesQueryTests (#112425) (#112428)
# Conflicts:
#	muted-tests.yml

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2024-09-03 00:40:10 +10:00
Liam Thompson
bdf68645af
[DOCS] Update documents and indices overview (#112394) (#112429) 2024-09-02 19:47:19 +10:00
elasticsearchmachine
ed1ecce6ef
Update docs for v8.15.1 release (#112410) 2024-09-02 10:38:49 +02:00
David Kyle
f15c030b61
[ML]Fix the bug where the run() function of ExecutableInferenceRequest throws an exception when get inferenceEntityId. (#112135) (#112393)
Co-authored-by: Huaixinww <141887897+Huaixinww@users.noreply.github.com>
2024-08-30 22:57:51 +10:00
István Zoltán Szabó
9f845d5f40
[DOCS] Resolving conflicts. (#112391) 2024-08-30 14:08:38 +02:00
Simon Cooper
c867f6caf6
[8.15] Fix toReleaseVersion() when called on the current version id (#112242) (#112280)
Also includes fixes in #112284
2024-08-30 09:21:08 +01:00
Oleksandr Kolomiiets
dcba83954a
[8.15] Hide new test behind a feature (#112301) (#112317)
* Hide new test behind a feature (#112301)

(cherry picked from commit 0fe220a075)

# Conflicts:
#	muted-tests.yml
#	server/src/main/java/org/elasticsearch/index/mapper/MapperFeatures.java

* Update MapperFeatures.java
2024-08-29 07:37:22 -07:00
Liam Thompson
cb4946687a
[DOCS] Rewrite "What is Elasticsearch?" (Part 1) (#112213) (#112335)
(cherry picked from commit aa57a1553e)
2024-08-29 15:18:28 +02:00
István Zoltán Szabó
ef960a08c2
[DOCS] Highlights auto-chunking in intro of semantic text. (#111836) (#112342) 2024-08-29 21:08:47 +10:00
David Turner
87a62010e3
Include network disconnect info in troubleshooting docs (#112323) (#112328)
A misplaced `//end::` tag meant that the docs added in #112271 are only
included in the page on fault detection and not the equivalent
troubleshooting docs. This commit fixes the problem.
2024-08-29 15:28:21 +10:00
Armin Braun
d9f6887b44
Fix DLS over Runtime Fields (#112260) (#112318)
There is a DLS query referencing a runtime field loaded from _source, when we create the collector manager we retrieve the numDocs which triggers going through all segments and executing the script for each document. StoredFieldSourceProvider relies on leaf ordinals to build an array, but those ordinals are not populated when computing the numDocs via BaseCompositeReader, as that goes through the subreaders contexts, and not the context leaves (there is a subtle difference that bites us there).

Fixes #111637
2024-08-29 07:19:51 +02:00
shainaraskas
f2babe78dd
Round up shard allocation / recovery / relocation concepts (#109943) (#112292)
(cherry picked from commit 50bccf5609)
2024-08-28 14:22:33 -04:00
Nhat Nguyen
0c45cc7a82
Avoid wrapping rejection exception in exchange (#112178) (#112288)
We should avoid wrapping EsRejectedExecutionException in an 
ElasticsearchException as it would change the status code from 429 to
500. Ideally, we should avoid wrapping exceptions altogether, but that
would require bigger changes.

Closes #112106
2024-08-29 02:01:30 +10:00
David Turner
b407e22193
Add docs for troubleshooting network disconnects (#112271) (#112272)
Basically the same as for nodes that leave the cluster with reason
`disconnected`, except that these disconnects don't involve the master
so don't cause any nodes to leave the cluster.
2024-08-28 19:23:43 +10:00
Jake Landis
af52f94154
Fix "unexpected field [remote_cluster]" for CCS (RCS 1.0) when using API key that references remote_cluster (#112226) (#112259)
This commit will remove the "remote_cluster" from the role descriptor of API keys that is sent to elder clusters for RCS 1.0. 
This will allow API keys created in 8.15.0 that reference "remote_cluster" to work when sent to an elder cluster. 
The API key could either explicitly reference "remote_cluster" or implicitly reference it via the limited by permissions of the superuser built in role.

Note this in reference to the standard API key, not cross cluster API key. The cross cluster API already removes this for elder clusters.

fixes: #112222
related: #107493
2024-08-28 09:43:49 +10:00
Oleksandr Kolomiiets
00722864ef
Prevent synthetic field loaders accessing stored fields from using stale data (#112173) (#112257)
(cherry picked from commit 38adbb0724)

# Conflicts:
#	rest-api-spec/src/yamlRestTest/resources/rest-api-spec/test/indices.create/20_synthetic_source.yml
2024-08-28 09:16:28 +10:00
Lee Hinman
6fc00ad71e
Fix template alias parsing livelock (#112217) (#112245)
* Fix template alias parsing livelock

This commit fixes an issue with templates parsing alias definitions that can cause the ES thread to
hang indefinitely. Due to the malformed alias definition, the parsing gets into a loop which never
exits. In this commit a null check in both the component template and alias parsing code is added,
which prevents the looping.
2024-08-28 02:12:47 +10:00
Johannes Fredén
7b3d73c179
Fix connection timeout for OpenIdConnectAuthenticator get Userinfo (#112230) (#112238)
* Fix connection timeout for OpenIdConnectAuthenticator get Userinfo

* Update docs/changelog/112230.yaml
2024-08-28 00:51:03 +10:00
Keith Massey
4e5c6801f4
Improve performance of grok pattern cycle detection (#111947) (#112219) 2024-08-27 05:38:53 +10:00
Kostas Krikellas
eed375496a
[8.15] Force using the last centroid during merging (#111644) (#112209)
* [8.15] Force using the last centroid during merging

* update test
2024-08-27 00:47:35 +10:00
Panagiotis Bailis
5255222d75
Updating retriever documentation to better explain how filters are applied (#112201) (#112207) 2024-08-27 00:07:43 +10:00
Ignacio Vera
b9eeebd582
Fix NPE when executing doc value queries over shape geometries with empty segments (#112139) (#112198)
Return empty scorer instead of null.
2024-08-26 20:47:42 +10:00
Nhat Nguyen
dc56dfeaee
Allow query pragmas in release builds (#111953) (#112168)
I have investigated an issue with QA clusters that run release builds. I 
wish I could enable query pragmas to confirm the problem instead of
setting up new clusters and replicating data before testing the theory.
This change allows users to enable query pragmas in release builds.
However, due to the risks associated with using pragmas, the
accept_pragma_risks parameter must be explicitly set to true to proceed.
2024-08-24 07:21:59 +10:00
Liam Thompson
8848c7fa4a
[DOCS] Wrap document/field restriction tip in IMPORTANT block (#112146) (#112159) 2024-08-24 02:48:29 +10:00
Kathleen DeRusso
dcd2462428
Semantic reranking should fail whenever inference ID does not exist (#112038) (#112153)
* Semantic reranking should fail whenever inference ID does not exist

* Short circuit text similarity reranking on empty result set

* Update tests

* Remove test - it doesn't do anything useful

* Update docs/changelog/112038.yaml
2024-08-24 01:52:02 +10:00
Oleksandr Kolomiiets
d626197d1a
Merge multiple ignored source entires for the same field (#111994) (#112116)
(cherry picked from commit a35da247fd)

# Conflicts:
#	modules/data-streams/src/javaRestTest/java/org/elasticsearch/datastreams/logsdb/qa/StandardVersusLogsIndexModeRandomDataChallengeRestIT.java
#	test/framework/src/main/java/org/elasticsearch/logsdb/datageneration/datasource/DefaultMappingParametersHandler.java
2024-08-23 07:53:21 -07:00
Vishal Raj
49dbedbcdc
[plugin/apm-data] Set fallback to legacy ILM policies (#112028) (#112097) 2024-08-23 11:24:56 +01:00
Nhat Nguyen
21bdf4dd0d
Fix DocValuesCodecDuelTests testDuel (#112084) (#112113)
We need to check the returned doc id from advance() before accessing the
values of the current document.

Closes #112082
2024-08-22 10:29:45 -07:00
Stef Nestor
91035f8e02
(Doc+) Allocation Explain Examples: THROTTLED, MAX_RETRY (#111558) (#112104)
Adds [Allocation Explain examples](https://www.elastic.co/guide/en/elasticsearch/reference/master/cluster-allocation-explain.html#cluster-allocation-explain-api-examples) for `THROTTLED` and `MAX_RETRY`. Also formats sub TOC so that we can after link code message to those docs.
2024-08-23 00:41:06 +10:00
Craig Taverner
f3f0d2e865
Always check crsType when folding spatial functions (#112090) (#112099)
* Always check crsType when folding spatial functions

* Update docs/changelog/112090.yaml

* Only require capability for fixed test

The other tests passed on older versions anyway.
2024-08-22 23:42:12 +10:00
David Turner
918fa01259
Add more cross-links about sniff/proxy modes (#112079) (#112101)
The info about remote cluster connection modes is a little disjointed.
This commit adds some cross-links between the sections to help users
find more relevant information.
2024-08-22 23:37:07 +10:00
Rene Groeschke
8ae4d7e833
Update Gradle wrapper to 8.10 (#111736) (#112095)
(cherry picked from commit fb6c5a55dd)
2024-08-22 22:09:49 +10:00
elasticsearchmachine
c246c163c2 Mute org.elasticsearch.index.mapper.IgnoredSourceFieldMapperTests testStoredNestedSubObjectWithNameOverlappingParentName #112083 2024-08-22 14:34:53 +10:00
Oleksandr Kolomiiets
96c4870a43
[DOCS] The logs index.mode has been renamed logsdb (#111871) (#112076)
(cherry picked from commit 595628f9ce)

Co-authored-by: Luca Belluccini <luca.belluccini@elastic.co>
2024-08-21 15:41:26 -07:00
David Turner
0cc8585349
Expand docs on remote cluster proxying (#112025) (#112077)
It's not obvious from the docs that transport connections (including
connections to remote clusters) use a custom binary protocol and require
a _layer 4_ proxy. This commit clarifies this point.
2024-08-22 07:51:44 +10:00
Oleksandr Kolomiiets
63a3bd9396
Fix calculation of parent offset for ignored source in some cases (#112046) (#112064) 2024-08-21 10:26:17 -07:00
Liam Thompson
3fbbf7c88a
[DOCS] Update rank_constant value in retriever example (#112056) (#112060) 2024-08-21 23:35:42 +10:00
Stef Nestor
d527073e63
(Doc+) Link API doc to parent object - part1 (#111951) (#112041)
* (Doc+) Link API to parent Doc part1

---------

Co-authored-by: shainaraskas <shaina.raskas@elastic.co>
Co-authored-by: shainaraskas <58563081+shainaraskas@users.noreply.github.com>
2024-08-21 07:20:16 +10:00
Nik Everett
de18703ddc
ESQL: Document date instead of datetime (#111985) (#112034)
This changes the generated types tables in the docs to say `date`
instead of `datetime`. That's the name of the field in Elasticsearch so
it's a lot less confusing to call it that.

Closes #111650
2024-08-21 04:28:49 +10:00
Rene Groeschke
677e159df8
Make --write-verification-metadata faster (#111103) (#112029)
by ignoring elasticsearch distributions when resolving artifacts

(cherry picked from commit 022b84b41d)
2024-08-20 20:21:13 +02:00
Stef Nestor
e9c61a61f3
(Doc+) Removing "current_node" from Allocation Explain API under Fix Watermark Errors (#111946) (#112023)
👋 howdy, team!

This just simplifies the Allocation Explain API request to not need to include the `current_node` which may not be known when troubleshooting the [Fix Watermark Errors](https://www.elastic.co/guide/en/elasticsearch/reference/current/fix-watermark-errors.html) guide. 

TIA!
Stef
2024-08-21 00:47:52 +10:00
Oleksandr Kolomiiets
26bab001dc
Fix synthetic source for empty nested objects (#111943) (#111982)
(cherry picked from commit 19dc8841d4)
2024-08-20 07:47:32 -07:00
Kostas Krikellas
2f55a7fc8b
No error when store_array_source is used without synthetic source (#111966) (#112018)
* No error for store_array_source in standard mode

* Update docs/changelog/111966.yaml

* nested object test

* restore noop tests

* spotless fix

(cherry picked from commit 9ab8665235)
2024-08-20 22:08:49 +10:00
Kostas Krikellas
3cb4fc800b
Check for valid parentDoc before retrieving its previous (#112005) (#112007)
#111943 unveiled a bug in `collectChilder` where we attempt to collect
the previous doc of the parent, even when the parent doc has no previous
doc.

Fixes #111990, #111991, #111992, #111993
2024-08-20 19:32:47 +10:00
Efe Gürkan YALAMAN
02a308be09
[Bugfix] Add accessDeclaredMembers permission for ObjectMapper to work. (#111285) (#111642)
* bugfix: Add accessDeclaredMembers permission for ObjectMapper to work.

* Update docs/changelog/111285.yaml

* update-changelog

* Update yml tests

* review changes
2024-08-20 10:57:21 +02:00
David Turner
0fbfd632f8
Add known issue docs for #111854 (#111978) (#112001) 2024-08-20 16:49:34 +10:00
Martijn van Groningen
d171d13229
Remove zstd change from release highlights. (#111996)
The feature flag isn't removed yet and zstd isn't available in released versions of Elasticsearch.
2024-08-20 10:57:44 +07:00
Nhat Nguyen
1f87f1729a
Avoid losing error message in failure collector (#111983) (#111986)
The node-disconnected exception might not include the root cause. In 
this case, the failure collector incorrectly unwraps the exception and
wraps it in a new Elasticsearch exception, losing the message. We should
instead use the original exception to preserve the reason.

Closes #111894
2024-08-20 06:00:25 +10:00
Nik Everett
d14d86c273
ESQL: Document the profile option (#110727) (#111975)
This adds some basic documentation for the `profile` option in ESQL but
doesn't really explain the results beyond "this is for human debugging."
We're not ready for any kind of specification for this thing, but it is
useful to look at.
2024-08-20 00:47:06 +10:00