Commit graph

75474 commits

Author SHA1 Message Date
Nhat Nguyen
9287f29bba
Fix downsample persistent task params serialization bwc (#106878) (#106896)
Missing a check on the transport version results in unreadable cluster state
if it includes a serialized instance of DownsampleShardTaskParams.
serie indices.
Reading an optional array requires reading a boolean first which is required to
know if an array of values exists in serialized form. From 8.13 on we try to
read such a boolean which is not there because older versions don't write any
boolean nor any string array. Here we include the check on versions for backward
compatibility skipping reading any boolean or array whatsoever whenever not possible.

Customers using downsampling might have cluster states including such serielized
objects and would be unable to upgrade to version 8.13. They will be able to
upgrade to any version including this fix.

This fix has a side effect #106880

Co-authored-by: Salvatore Campagna <93581129+salvatore-campagna@users.noreply.github.com>
2024-03-28 23:51:48 -04:00
Kostas Krikellas
a5a80c4e2d
Update 8.13 release notes with known issue on downsampling (#106881) (#106887)
* Update 8.13 release notes with known issue

* revert unintended

* reword

* reword

* reword
2024-03-28 14:46:02 -04:00
Niels Bauman
ea81878b30
Unmute {p0=data_stream/10_basic/Delete data stream with failure stores} (#106865) (#106868) 2024-03-28 08:28:14 -04:00
Julia Bardi
b96c1d5036
[Fleet] Added all privilege to kibana_system to logs-fleet_server.* index pattern (#106815) (#106863)
* Update KibanaOwnedReservedRoleDescriptors.java

* replaced all with read, delete_index
2024-03-28 07:25:34 -04:00
Mark Vieira
870f662aa9
Update verifyVersion task after #106143
(cherry picked from commit 392a7599c1)
2024-03-27 14:50:24 -07:00
David Brimley
04d158b7c0
Update 8.13.0.asciidoc (#106803)
* Update 8.13.0.asciidoc

Introduce notable changes in place of breaking changes.

* Update copy, heading format

* Update

---------

Co-authored-by: Liam Thompson <32779855+leemthompo@users.noreply.github.com>
2024-03-27 17:08:05 -04:00
David Brimley
1f8d09c899
Update migrate_8_13.asciidoc (#106804)
* Update migrate_8_13.asciidoc

Add Notable Changes rather than Breaking Changes

* Update copy, heading format

---------

Co-authored-by: Liam Thompson <32779855+leemthompo@users.noreply.github.com>
2024-03-27 17:07:56 -04:00
Pat Whelan
d361eec8a8
[Transform] Fail checkpoint on missing clusters (#106793) (#106842)
When there are no remote or local clusters for a given source index, we
call the listener's `onFailure` method with a `CheckpointException`.
A running transform will fail and retry, eventually moving into an
unhealthy and failed state.  Any call to the stats API will note the
checkpoint failure and return.

This fixes a timeout issue calling the Transform stats API and prevents
the Transform from being stuck in indexing.

Fix #106790
Fix #104533
2024-03-27 16:15:31 -04:00
Mark Vieira
566aea1081
Reduce BWC testing to include only latest patch releases (#106143)
This commit alters our backward compatibility testing logic to restrict
testing to the latest patch release for any given minor version. Since
our policy is not to do any kind of breaking changes in patches, most of
this testing is superfluous. This change reduces the number of versions
we need to test by over 70%.
2024-03-27 10:42:19 -07:00
David Kyle
bd28d25906
[ML] Document wait_for_completion parameter to PUT trained models (#106769) (#106833) 2024-03-27 13:18:15 -04:00
Przemysław Witek
7bc04a6b3c
[Transform] Raise loglevel of events related to transform lifecycle from DEBUG to INFO (#106602) (#106816) 2024-03-27 16:37:33 +01:00
Ignacio Vera
c3a72e9d8a
Add test to exercise reduction of terms aggregation order by key and fix pruning bug (#106799) (#106814)
We are not computing the otherDocCounts properly as we are exiting the iteration too early so we are not counting the 
pruned buckets. This commit make sure we are counting all buckets.
2024-03-27 10:19:47 -04:00
Kostas Krikellas
10d088de78
[8.13] Handle pass-through subfields with deep nesting (#106798) 2024-03-27 05:09:02 -04:00
Jan Kuipers
ad39c3f34f
Add background filters of significant terms aggregations to can match query. (#106564) (#106797)
* Add background filters of significant terms aggregations to can match query.

* Fix NPE

* Unit tests

* Update docs/changelog/106564.yaml

* Update 106564.yaml

* Make aggregation queries in can match phase more generic.

* Copy source to preserve other relevant fields.

* Replace copy constructor by shallowCopy
2024-03-27 04:44:10 -04:00
elasticsearchmachine
79bfb882a3 Prune changelogs after 8.13.0 release 2024-03-26 20:21:58 +00:00
elasticsearchmachine
d903eb5067 Bump versions after 8.13.0 release 2024-03-26 20:21:16 +00:00
elasticsearchmachine
ca54c388f2 Prune changelogs after 7.17.19 release 2024-03-26 20:01:20 +00:00
elasticsearchmachine
16ac6d2e6b Bump versions after 7.17.19 release 2024-03-26 20:00:24 +00:00
Michael Peterson
23628b0009
Adjust randomization in ResolveClusterActionResponseTests (#105932) (#106756)
to avoid failures in `testEqualsAndHashcode` tests.

Fixes https://github.com/elastic/elasticsearch/issues/105898
2024-03-26 13:22:29 -04:00
Luca Cavanna
57b0de7318
Fix concurrency bug in AbstractStringScriptFieldAutomatonQuery (#106678)
Back when we introduced queries against runtime fields, Elasticsearch did not support
inter-segment concurrency yet. At the time, it was fine to assume that segments will be
searched sequentially. AbstractStringScriptFieldAutomatonQuery used to have a BytesRefBuilder
instance shared across the segments, which gets re-initialized when each segment starts its work.
This is no longer possible with inter-segment concurrency.

Closes #105911
2024-03-26 17:39:31 +01:00
elasticsearchmachine
a29ebb3ced Finalize release notes for v8.13.0 2024-03-26 12:39:13 -04:00
Brian Seeders
68f689d3de
Revert "After script run changes, to move breaking changes to notable changes…" (#106768)
This reverts commit c1c0de089f.
2024-03-26 11:01:42 -04:00
David Brimley
c1c0de089f
After script run changes, to move breaking changes to notable changes. Similar to how we worked with 8.12 release. (#106744) 2024-03-26 10:39:48 -04:00
István Zoltán Szabó
4aa63e4d48
[8.13][DOCS] Adds ML-related release note items from ML-CPP repo (#106741) 2024-03-26 10:53:42 +01:00
István Zoltán Szabó
44567c27c2
[DOCS] REsolves conflicts. (#106736) 2024-03-26 09:07:07 +01:00
Rene Groeschke
341446d3e1
Update Gradle wrapper to 8.7 (#105854) (#106713)
removed tiny issue on build script that seems like an oversight and doesn't do anything at all
2024-03-26 08:33:54 +01:00
elasticsearchmachine
4e6e1e56e1
Update docs for v8.13.0 release (#106684) 2024-03-25 13:22:07 -07:00
Jake Landis
f7c86bb5a4
Update discovery.asciidoc (#106541) (#106694)
Fix typo

(cherry picked from commit 96a46b9c5b)

Co-authored-by: Boen <13752080613@163.com>
2024-03-22 15:19:49 -04:00
Liam Thompson
93d4c3f579
[DOCS] Update cross cluster search compatability matrix (#106677) (#106680) 2024-03-22 10:49:20 -04:00
Benjamin Trent
7de0c3d7c7
Test mute for issue #106647 (#106671) 2024-03-22 09:19:47 -04:00
Liam Thompson
dad93146f1
[DOCS] Update params for Update Connector Filtering API (#106662) (#106665) 2024-03-22 08:14:49 -04:00
David Kyle
416589d13e
[ML] Fix Array out of bounds exception in the XLM Roberta tokenizer (#106655) (#106661)
Increases the buffer size for the normalised form of the input unicode 
character. Certain characters can have surprisingly long normalised forms
2024-03-22 07:58:57 -04:00
David Turner
72aa514922
Fix testScheduledFixedDelayRejection (#106630) (#106642)
Not really necessary to allow the scheduled task to race against the
blocks, and this race is a source of test flakiness. Fixed by imposing
the blocks first.

Closes #106618
2024-03-22 04:58:13 -04:00
Lorenzo Dematté
672d14d058
AwaitsFix #101008 (#106646) 2024-03-22 04:46:08 -04:00
Lisa Cawley
edf97bbc4d
[DOCS] Unhealthy transform rule check (#106521) (#106607) 2024-03-22 08:17:43 +01:00
David Turner
09df993931 AwaitsFix for #106618 2024-03-21 16:39:49 +00:00
István Zoltán Szabó
17ed5bc2a4
[DOCS] Amends important note on delayed data detection. (#106610) (#106614) 2024-03-21 12:04:33 -04:00
István Zoltán Szabó
d7b3accfa0
[DOCS] Adjusts PUT inference API docs examples (#106604) (#106606)
Co-authored-by: David Kyle <david.kyle@elastic.co>
2024-03-21 10:17:58 -04:00
István Zoltán Szabó
8b50e93124
[DOCS] Adds note to inference tutorial about similarity (#106567) (#106605) 2024-03-21 09:55:11 -04:00
István Zoltán Szabó
893e85b3e2
[DOCS] Adds disclaimer to semantic search tutorials (#106590) (#106594) 2024-03-21 06:54:10 -04:00
Przemysław Witek
c212abddeb
[Transform] Fix _reset API when called with force=true on a failed transform (#106574) (#106589) 2024-03-21 06:42:13 -04:00
Mark Vieira
d1c98f39fd
Validate that test cluster BWC nodes use the default distribution (#106559) (#106565)
We have instances where BWC tests configure old ES version nodes with
the integTest distribution. This isn't a valid configuration, and while
we in reality resolve the default distribution artifact, we have other
configuration logic that behaves differently based on whether the
integTest distro was _requested_. Specifically, what to set ES_JAVA_HOME
to. This bug resulted in us attempting to run old nodes using the
current bundled JDK version, which may be incompatible with that older
version of Elasticsearch.

Closes #104858
2024-03-20 12:55:47 -04:00
Ignacio Vera
4bf910c6e8
Use LogDocMergePolicy in GeoPointScriptFieldDistanceFeatureQueryTests#testMatches (#106557) (#106562) 2024-03-20 12:24:13 -04:00
David Turner
80634b494f
Release TranslogSnapshot buffer after iteration (#106398) (#106556)
Closes #106390
2024-03-20 11:41:54 -04:00
David Turner
d281df79bd
Integrate threadpool scheduling with AbstractRunnable (#106542) (#106548)
Today `ThreadPool#scheduleWithFixedDelay` does not interact as expected
with `AbstractRunnable`: if the task fails or is rejected then this
isn't passed back to the relevant callback, and the task cannot specify
that it should be force-executed. This commit fixes that.
2024-03-20 10:50:02 -04:00
David Turner
21f1123113
Force execution of SearchService.Reaper (#106544) (#106547)
If the search threadpool fills up then we may reject execution of
`SearchService.Reaper` which means it stops retrying. We must instead
force its execution so that it keeps on going.

With #106542, closes #106543
2024-03-20 10:31:05 -04:00
István Zoltán Szabó
6d8da67bf1
[DOCS] Changes Cohere inference examples in tutorial and API docs (#106524) (#106551) 2024-03-20 10:29:58 -04:00
Aurélien FOUCRET
e29365583d
Ensure ILM policy is installed before starting the tests. (#106523) (#106545) 2024-03-20 09:19:11 -04:00
Navarone Feekery
d40ff36a20
[Connectors API] Add missing _api_key_id docs (#106469) (#106539) 2024-03-20 07:28:09 -04:00
Ioana Tagirta
a892165bd7
Add links to text_expansion in ELSER tutorial (#106490) (#106530)
* Add links to text_expansion in ELSER tutorial

* Apply suggestions from code review



---------

Co-authored-by: Liam Thompson <32779855+leemthompo@users.noreply.github.com>
2024-03-20 05:24:49 -04:00