Commit graph

61144 commits

Author SHA1 Message Date
Joe Gallo
c845bcda3c
[7.17] Ingest correctly handle upsert operations and drop processors together ( #104585) (#104887) 2024-01-30 12:24:09 -05:00
David Turner
10ca010c44 Allocation awareness allocates some replicas (#104800)
The docs for forced awareness indicate that no replicas will be assigned
until all zones are available, which is definitely undesirable and also
not the actual behaviour. This commit fixes the wording to match what
really happens.

Closes #104777
2024-01-29 08:19:04 +00:00
Joe Gallo
378c22a682
Better handling of async processor failures (#104289) (#104768) 2024-01-25 11:56:43 -05:00
Rene Groeschke
0b6cd20470
Fix dependency check for ignored licenses (#104736) (#104743)
if there are no dependencies declared and the license file is marked as
ignored, no exception should be thrown and dependencylicense check
should pass.

Fixes issues we identified in #104628
2024-01-25 06:37:29 -05:00
Simon Cooper
76be62ad6f
Ignore Antarctica/Vostok timezone differences (#104610)
Antarctica/Vostok, it has been updated by tzdata 2023d, which leads to different timezone offsets between joda and the jdk
2024-01-25 09:40:58 +00:00
Mark Vieira
c0277f89ec
Remove dependency on beats 2024-01-24 07:57:52 -08:00
Simon Cooper
a307e81bd7
Ensure there's only one newline added with new version declarations (#104519) (#104689)
Backport #104519 to 7.17
2024-01-24 12:11:17 +00:00
Iraklis Psaroudakis
06bb0bdc8c
Mute testTimezoneIds (#104691)
Relates #104544
2024-01-24 06:31:33 -05:00
Brian Seeders
c1a724f4ff
Remove 7.17.17 coming soon section 2024-01-23 12:38:57 -05:00
Brian Seeders
d761c158da
Prune changelogs after 7.17.17 release 2024-01-23 12:32:47 -05:00
Brian Seeders
23bb7612ca
Bump versions after 7.17.17 release 2024-01-23 12:32:08 -05:00
Brian Seeders
b41b0e8270
Add release notes for 7.17.17 (#104632) 2024-01-22 18:00:17 -05:00
Jake Landis
6e0679d6d1
[7x] upgrade aws client depdencies (#104346)
This commit bumps the aws client dependencies from from 1.11.749 to
1.12.270.  This aligns the versions used in 7.17.x with main. 

(partial) backport of
https://github.com/elastic/elasticsearch/pull/88932
2024-01-22 10:52:12 -05:00
Simon Cooper
4ba1572dc5
Create extract/tag versions gradle task for 7.17 (#104532)
Create a gradle task to extract version information for the new build release tag build infrastructure.
This also defines a dummy tagVersions task that is implemented on v8 but doesn't have anything to do on 7.17.
2024-01-22 11:25:05 +00:00
David Turner
6481e8a763
Fix deleting index during snapshot finalization (#104380)
* Fix deleting index during snapshot finalization

Today if an index is deleted during a very specific order of snapshot
finalizations then it's possible we'll miscalculate the latest shard
generations for the shards in that index, causing the deletion of a
shard-level `index-UUID` blob which prevents further snapshots of that
shard.

Backports #103817 to 7.17
Closes #101029

* Test fixup
2024-01-18 05:38:18 -05:00
Mark Vieira
aba4da413a
[7.17] Upgrade bundled JDK to 21.0.2 (#104481) (#104486)
* Upgrade bundled JDK to 21.0.2 (#104481)

# Conflicts:
#	gradle/verification-metadata.xml

* Update verification metadata
2024-01-17 15:44:50 -05:00
Chris Hegarty
af3f8e5d67
[7.17] Update ExecutorScalingQueue to workaround LinkedTransferQueue JDK bug (#104347) (#104425)
* Update ExecutorScalingQueue to workaround LinkedTransferQueue JDK bug (#104347)

This commit adds a few overrides to ExecutorScalingQueue (subclass of LinkedTransferQueue) to workaround a JDK bug in LinkedTransferQueue.

* remove usage of var

* fix compilation
2024-01-17 06:24:04 -05:00
David Turner
b6114f4c82
Fix snapshot version in createSnapshotLegacy (#104354)
We shouldn't use `Version#CURRENT` for the snapshot version anywhere,
but especially not on the legacy path.

Closes #86889
2024-01-15 09:16:41 +00:00
Brian Seeders
0ad0ddd479
[ci] Add Amazon Linux 2 to platform support pipeline (#104229) (#104286)
(cherry picked from commit a354b45613)
2024-01-12 11:40:58 -05:00
Simon Cooper
aed04c0577
Backport update versions task to 7.17 (#104303)
Copy update version gradle task from #103335 to 7.17 for future 7.17 releases
2024-01-12 16:01:23 +00:00
Jake Landis
20b46d1e92
[7x] bump dependency in discovery azure classic plugin (#104171)
This commit bumps commons-io for discover azure classic plugin from 2.4 -> 2.7
2024-01-11 09:49:45 -06:00
Francisco Fernández Castaño
f83dd8e286
Fix cancellation order in CancellableRateLimitedFluxIterator (#104259) (#104263)
Closes #103054
2024-01-11 15:38:16 +01:00
Mark Vieira
9923a8719f
Remove BWC testing of snapshot 6.8 versions (#104226) 2024-01-10 14:21:56 -08:00
Jake Landis
f82944c5af
[7x] ingest attachment dependency version bumps (#104169)
This commit bumps the follow dependency version for the ingest attachment plugin:

tika-core 1.27 -> 1.28.5
tika-parsers 1.27 -> 1.28.5
commons-io 2.6 -> 2.11
fontbox 2.0.24 -> 2.0.26
poi 4.1.2 -> 5.2.2
poi-ooxml 4.1.2 -> 5.2.2
and poi-/ooxml-schemas is now poi-ooxml-lite and is using 5.2.2
(see poi.apache.org/changes.html)
xmlbeans 3.0.1 -> 5.0.3

These versions were chosen from one of the following POM files:
repo1.maven.org/maven2/org/apache/tika/tika-parent/1.28.5/tika-parent-1.28.5.pom
repo1.maven.org/maven2/org/apache/tika/tika-parsers/1.28.5/tika-parsers-1.28.5.pom
repo1.maven.org/maven2/org/apache/tika/tika-core/1.28.5/tika-core-1.28.5.pom
repo1.maven.org/maven2/org/apache/poi/poi-ooxml-lite/5.2.2/poi-ooxml-lite-5.2.2.pom
2024-01-10 16:01:30 -06:00
Mark Vieira
ebe2e02189
Disable BWC tests from "monolithic" CI jobs (#104221) (#104225)
# Conflicts:
#	.buildkite/pipelines/periodic.template.yml
#	.buildkite/pipelines/periodic.yml
#	.buildkite/scripts/encryption-at-rest.sh
#	.buildkite/scripts/release-tests.sh
2024-01-10 13:54:02 -05:00
Mark Vieira
6868f0c471
Remove FIPS testing for Java 17 and 18 2024-01-10 08:36:44 -08:00
Jake Landis
fe091e846d
Fix discovery-gce when run in FIPS mode (#104179)
* Fix discovery-gce when run in FIPS mode

* dummy commit to re-kick off build

* spotless
2024-01-10 09:51:29 -05:00
Mark Vieira
d035dffd5d
Tag individual CI job name axis in build scans (#104168) (#104178)
# Conflicts:
#	.buildkite/pipelines/periodic.template.yml
2024-01-09 19:24:14 -05:00
Brian Seeders
b5afdb72f5
[dra] Trigger elasticsearch-hadoop dra build whenever we build a new staging artifact (#104084) (#104096)
(cherry picked from commit 6a386ba20a)
2024-01-09 16:11:52 -05:00
Mark Vieira
5ef0189025
Revert "Add Java 22 to testing matrix"
This reverts commit e39f00facc.
2024-01-09 10:01:16 -08:00
Mark Vieira
8846fbe6b3
Revert "Remove additional matrix dimension in Java compatibility testing"
This reverts commit 0d887b1ae2.
2024-01-09 10:01:07 -08:00
Jake Landis
93af6465bb
[7.x] Sync discovery_gce versions with main (#104086)
This commit syncs the dependencies for discovery GCE plugin with the dependency versions in use in main.

Specifically, this commit upgrades the following for the discovery GCE plugin:

com.google.apis:google-api-services-compute:v1-rev160-1.23.0 -> v1-rev20220322-1.32
com.google.api-client:google-api-client:1.23.0 -> 1.33.1
com.google.oauth-client:google-oauth-client:1.23.0 -> 1.34.1
com.google.code.findbugs:jsr305:1.3.9 -> 3.0.2

and introduces the following for the discovery GCE plugin:

api "com.fasterxml.jackson.core:jackson-core:${versions.jackson}"
api "com.google.http-client:google-http-client-gson:1.41.1"
runtimeOnly 'com.google.guava:guava:32.0.1-jre'
runtimeOnly 'com.google.guava:failureaccess:1.0.1'
api 'io.opencensus:opencensus-api:0.30.0'
api 'io.opencensus:opencensus-contrib-http-util:0.30.0'
api 'io.grpc:grpc-context:1.27.2'

backport of #85132 and #91722
2024-01-09 11:28:32 -06:00
Jake Landis
a586ac70f3
[7.x] Bump protobuf version for repository hdfs (#104076)
This commit bumps the protobuf version for in 7.x to match the version used in main.
Main has been running this version since #92123
2024-01-09 10:00:55 -06:00
Jake Landis
034b8ece08
[7.x] Bump commons codec version (#104106)
This commit bumps common-codec from 1.11 to 1.15
2024-01-09 09:19:44 -06:00
Jake Landis
2aeecfd084
[7.17] Manual backport of 103944 (#104016)
* Manual backport of 103944

* copy RegisteredDomainProcessorTests#testBasic from main
2024-01-08 11:31:01 -05:00
Jake Landis
77bf12f0a0
Upgrade Bouncy Castle jars (except for the FIPS jars) (#103818)
This commit upgrades the non-FIPS jars to the lastest available versions for 7.17.

Bouncy Castle slightly changed their naming as evident by bouncycastle.org/latest_releases.html
They no longer maintain a jdk15on library and instead use strategy for [1.5->1.8) and [1.8 -> ). This commit
adopts the jdk18on libraries with the latest version.

related: #100923
2024-01-05 16:32:05 -06:00
Jake Landis
8b620012de
bump junit version (#103941) (#103989)
This commit bumps the junit version from 4.12 to 4.13.2
2024-01-05 11:04:51 -05:00
Jake Landis
a3c4b0837f
Upgrade Bouncy Castle FIPS jars for plugin cli (#103801)
This commit upgrades bc-fips and bcpg-fips to the lastest available versions for 7.17.

related: #100923
2024-01-05 08:28:21 -06:00
Mark Vieira
0d887b1ae2
Remove additional matrix dimension in Java compatibility testing 2024-01-04 14:13:46 -08:00
Brian Seeders
8340d3bcae
[ci] Add/update docs for .buildkite dir and PR pipeline generator (#103936) (#103940)
(cherry picked from commit b8009d1b1e)
2024-01-04 17:05:26 -05:00
Mark Vieira
e39f00facc
Add Java 22 to testing matrix 2024-01-04 10:38:13 -08:00
Slobodan Adamović
68e2508349
[7.17] [Test] Use larger client ports range for tests running on Windows (#103894) (#103914)
* [Test] Use larger client ports range for tests running on Windows (#103894)

This PR increases client's port ranges for tests which are executed
on Windows in order to avoid failures due to some port ranges being
excluded from use. The larger ports range (300) is chosen based on
the observation where a random consecutive range of 200 ports can
be excluded on Windows test workers.

Closes #102349

(cherry picked from commit bdf5c7fc38)

# Conflicts:
#	modules/transport-netty4/src/internalClusterTest/java/org/elasticsearch/transport/netty4/Netty4TransportMultiPortIntegrationIT.java
#	x-pack/plugin/security/src/internalClusterTest/java/org/elasticsearch/xpack/security/transport/filter/IpFilteringIntegrationTests.java

* Fix compilation error
2024-01-04 10:00:23 -05:00
Rene Groeschke
a8d9293988
Only run snyk for 7.17 and main branch (#103820) (#103842) 2024-01-03 04:05:15 -05:00
Rene Groeschke
8e5de133fa
Support different snyk organisations (#97808) (#103825)
Tweaks our snyk integration to support different snyk orgs which is
required to have support for elasticsearch serverless. Also replaces
hardcoded remote url property by a dynamic version that resolves that
property from the git origin url.

(cherry picked from commit 3e13bd4d4c)
2024-01-02 17:44:09 -05:00
Iraklis Psaroudakis
759e3f6c35
[7.17] Reference stored scripts in snapshot restore (#102966) (#103046)
Backports the following commits to 7.17:

Reference stored scripts in snapshot restore (Reference stored scripts
in snapshot restore #102966)
2023-12-20 07:34:33 -05:00
Iraklis Psaroudakis
d61e9dce10
Correct docs tcp retries timeout (#102968) (#103044)
Closes #102788
2023-12-20 06:20:47 -05:00
Lorenzo Dematté
bfe46b43e2
[7.17] Add full GC fallback within the current attempt (#102563) (#103505)
* Add full GC fallback within the current attempt (#102563)

* Add full GC fallback within the current attempt
* Try re-acquire the lock if we timed out due to a full GC
* Condition full GC to memory reclaimed only

* Fix: transform record to private static class
2023-12-18 09:47:40 -05:00
Brian Seeders
41afa783c1
[ci] Add amazon-2023 to platform-support matrix (#103466) (#103479)
(cherry picked from commit 2517d5c065)
2023-12-14 16:19:05 -05:00
David Turner
450dfc53c1
[7.17] Dispatch ClusterStateAction#buildResponse to executor (#103435) (#103443)
If waiting for a particular cluster state (e.g. on the CCR leader) we
will compute the resulting cluster state and serialize it on the cluster
applier thread, which can be too expensive in a large cluster for this
thread. With this commit we dispatch the final action back to the
original executor.
2023-12-14 15:48:09 +00:00
Brian Seeders
c77b9e9fc7
Prune changelogs after 7.17.16 release 2023-12-13 10:49:18 -05:00