Commit graph

2963 commits

Author SHA1 Message Date
David Turner
db8aecf352
Improve message about insecure S3 settings (#116956)
* Improve message about insecure S3 settings

Clarifies that insecure settings are stored in plaintext and must not be
used. Also removes the mention of the (wrong) system property from the
error message if insecure settings are not permitted.

Backport of #116915 to `7.17`

* CI poke
2024-11-19 06:41:07 +11:00
Mark Vieira
e28bbde894
Upgrade develocity plugin (#115139) (#115151) 2024-10-22 10:55:10 -07:00
Mark Vieira
21df4f545c
Update spotless (#115349) 2024-10-22 10:49:29 -07:00
David Turner
c0d5cce4e6
Flush response stream in EC2RetriesTests (#114115) (#114121)
This is apparently necessary when running with JDK23.

Relates #114101 Closes #114078
2024-10-04 21:59:47 +10:00
David Turner
f75139288e
[7.17] Flush response stream in Ec2DiscoveryTests (#114101) (#114113)
* Flush response stream in `Ec2DiscoveryTests` (#114101)

This is apparently necessary when running with JDK23. Also cleans up
some warnings in the same test suite.

Closes #114088
Closes #114089
Closes #114090

* Revert for compat
2024-10-04 21:08:24 +10:00
Rene Groeschke
0759402ab6
Update Gradle wrapper to 8.10.2 (#113603) (#113720)
Update Gradle wrapper to 8.10.2
2024-09-28 05:49:48 +10:00
Rene Groeschke
1ac1349e01
Update Gradle wrapper to 8.10.1 (#112948) (#113204) 2024-09-20 04:19:52 +10:00
Rene Groeschke
cba614ab55
Update Gradle wrapper to 8.10 (#111736) (#112096)
(cherry picked from commit fb6c5a55dd)
2024-08-22 22:04:51 +10:00
Rene Groeschke
f01427f9ce
Update Gradle wrapper to 8.9 (#110109) (#111097)
(cherry picked from commit cb0ecb86df)
2024-07-19 15:39:44 +02:00
Rene Groeschke
1e0b61419a
[7.17] Update Gradle wrapper to 8.8 (#108021) (#109348)
Fix incompatibility with 8.8 and our internal api usages

- Update ospackage to a version that contains a fix we provided
- Tweak build logic to avoid deprecation warnings
- Use newer permission api
- Use custom shadowplugin
- Rework ElasticsearchDistribution dependencies resolution
- Update Gradle wrapper to 8.8
- Fix one more deprecated permission api usage
- Fix DistroTest dependencies
- Fix permissions in package init.d folder
2024-06-18 16:45:31 +02:00
Athena Brown
766ba1c6c8
[7.17] Align all usages of protobuf to be 3.21.9 (#95431)
Updating repository-hdfs, repository-gcs, and vector-tile to all use the same more recent protobuf.

Co-authored-by: Keith Massey <keith.massey@elastic.co>
2024-05-08 14:59:53 -06:00
Rene Groeschke
eb0e1ad3e2
Update Gradle wrapper to 8.7 (#105854) (#106722)
removed tiny issue on build script that seems like an oversight and doesn't do anything at all

(cherry picked from commit c15f727f2d)

# Conflicts:
#	x-pack/plugin/ent-search/build.gradle
2024-03-26 08:33:29 +01:00
Keith Massey
c53745e8cc
Upgrading mime4j on the 7.17 line (#106380) 2024-03-18 09:44:30 -05:00
Rene Groeschke
457296f31f
Fix :plugins:repository-hdfs:forbiddenApisJavaRestTest (#102983) (#105921)
Reworking forbiddenApis check to use gradle worker api exposed a bug in
how we resolve krb5kdc keytab information. This fixes the depenendency to krb5kdc keytab configuration and
its builtBy task.

This also changes the usage of krb5kdc keytab files to be passed directly to task classpath as
they are only required at runtime and directly having them as part of javaRestTestRuntimeOnly would mean precommit
requires krb5kdc compose up which we definitely not want

(cherry picked from commit ab0bb4889a)
2024-03-05 11:16:20 +01:00
Mark Vieira
d1117aeb3e
Update Gradle wrapper to 8.6 (#103796) (#105466)
Co-authored-by: Rene Groeschke <rene@elastic.co>
2024-02-13 15:14:48 -05:00
Mark Vieira
69f77309f5
Update Gradle Enterprise plugin to 3.16.1 (#104435) (#105463)
# Conflicts:
#	gradle/build.versions.toml
#	settings.gradle
2024-02-13 12:48:02 -05:00
Jake Landis
6e0679d6d1
[7x] upgrade aws client depdencies (#104346)
This commit bumps the aws client dependencies from from 1.11.749 to
1.12.270.  This aligns the versions used in 7.17.x with main. 

(partial) backport of
https://github.com/elastic/elasticsearch/pull/88932
2024-01-22 10:52:12 -05:00
Jake Landis
20b46d1e92
[7x] bump dependency in discovery azure classic plugin (#104171)
This commit bumps commons-io for discover azure classic plugin from 2.4 -> 2.7
2024-01-11 09:49:45 -06:00
Francisco Fernández Castaño
f83dd8e286
Fix cancellation order in CancellableRateLimitedFluxIterator (#104259) (#104263)
Closes #103054
2024-01-11 15:38:16 +01:00
Jake Landis
f82944c5af
[7x] ingest attachment dependency version bumps (#104169)
This commit bumps the follow dependency version for the ingest attachment plugin:

tika-core 1.27 -> 1.28.5
tika-parsers 1.27 -> 1.28.5
commons-io 2.6 -> 2.11
fontbox 2.0.24 -> 2.0.26
poi 4.1.2 -> 5.2.2
poi-ooxml 4.1.2 -> 5.2.2
and poi-/ooxml-schemas is now poi-ooxml-lite and is using 5.2.2
(see poi.apache.org/changes.html)
xmlbeans 3.0.1 -> 5.0.3

These versions were chosen from one of the following POM files:
repo1.maven.org/maven2/org/apache/tika/tika-parent/1.28.5/tika-parent-1.28.5.pom
repo1.maven.org/maven2/org/apache/tika/tika-parsers/1.28.5/tika-parsers-1.28.5.pom
repo1.maven.org/maven2/org/apache/tika/tika-core/1.28.5/tika-core-1.28.5.pom
repo1.maven.org/maven2/org/apache/poi/poi-ooxml-lite/5.2.2/poi-ooxml-lite-5.2.2.pom
2024-01-10 16:01:30 -06:00
Jake Landis
fe091e846d
Fix discovery-gce when run in FIPS mode (#104179)
* Fix discovery-gce when run in FIPS mode

* dummy commit to re-kick off build

* spotless
2024-01-10 09:51:29 -05:00
Jake Landis
93af6465bb
[7.x] Sync discovery_gce versions with main (#104086)
This commit syncs the dependencies for discovery GCE plugin with the dependency versions in use in main.

Specifically, this commit upgrades the following for the discovery GCE plugin:

com.google.apis:google-api-services-compute:v1-rev160-1.23.0 -> v1-rev20220322-1.32
com.google.api-client:google-api-client:1.23.0 -> 1.33.1
com.google.oauth-client:google-oauth-client:1.23.0 -> 1.34.1
com.google.code.findbugs:jsr305:1.3.9 -> 3.0.2

and introduces the following for the discovery GCE plugin:

api "com.fasterxml.jackson.core:jackson-core:${versions.jackson}"
api "com.google.http-client:google-http-client-gson:1.41.1"
runtimeOnly 'com.google.guava:guava:32.0.1-jre'
runtimeOnly 'com.google.guava:failureaccess:1.0.1'
api 'io.opencensus:opencensus-api:0.30.0'
api 'io.opencensus:opencensus-contrib-http-util:0.30.0'
api 'io.grpc:grpc-context:1.27.2'

backport of #85132 and #91722
2024-01-09 11:28:32 -06:00
Jake Landis
a586ac70f3
[7.x] Bump protobuf version for repository hdfs (#104076)
This commit bumps the protobuf version for in 7.x to match the version used in main.
Main has been running this version since #92123
2024-01-09 10:00:55 -06:00
Jake Landis
2aeecfd084
[7.17] Manual backport of 103944 (#104016)
* Manual backport of 103944

* copy RegisteredDomainProcessorTests#testBasic from main
2024-01-08 11:31:01 -05:00
Jake Landis
77bf12f0a0
Upgrade Bouncy Castle jars (except for the FIPS jars) (#103818)
This commit upgrades the non-FIPS jars to the lastest available versions for 7.17.

Bouncy Castle slightly changed their naming as evident by bouncycastle.org/latest_releases.html
They no longer maintain a jdk15on library and instead use strategy for [1.5->1.8) and [1.8 -> ). This commit
adopts the jdk18on libraries with the latest version.

related: #100923
2024-01-05 16:32:05 -06:00
Rene Groeschke
5661f5fbd0
[7.17] Update gradle wrapper to 8.5 (#102154) (#102816)
* Update gradle wrapper to 8.5 (#102154)

Update BuildLayout references

* Remove non existent project
2023-11-30 15:03:30 -05:00
Slobodan Adamović
096e8cc4d7
[Backport] Upgrade reactor netty http to v1.0.39 and reactor core to v3.4.34 (#102629)
This PR upgrades the version of reactor-netty-http library to the latest v1.0.39 version
and its transitive dependencies reactor-core to v3.4.34 and reactor-netty-core to v1.0.39.

Backport of #102311

---------

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2023-11-29 14:59:22 +01:00
Rene Groeschke
468bef1b9e
[7.17] Update gradle wrapper to 8.4 (#99856) (#100926)
* Remove deprecated forConfigurationTime usage
2023-10-17 13:44:48 +02:00
Rene Groeschke
a080bb2bbe
[7.17] Update gradle wrapper to 8.3 (#97838) (#100715)
* Update gradle wrapper to 8.3 (#97838)

Gradle now fully supports compiling, testing and running on Java 20.
Among other general performance improvements this release introduces --test-dry-run command line option that allows checking if tests are filtered or not by gradle.
Required updating nebula ospackage plugin as setuid was broken in gradle 8.3.

(cherry picked from commit b23e000c30)

# Conflicts:
#	build-tools-internal/src/integTest/groovy/org/elasticsearch/gradle/internal/test/rest/LegacyYamlRestCompatTestPluginFuncTest.groovy
#	build-tools-internal/src/main/java/org/elasticsearch/gradle/internal/ElasticsearchJavaModulePathPlugin.java
#	build-tools-internal/src/main/java/org/elasticsearch/gradle/internal/test/rest/compat/compat/AbstractYamlRestCompatTestPlugin.java
#	build-tools-internal/src/main/resources/minimumGradleVersion
#	gradle/verification-metadata.xml
#	gradle/wrapper/gradle-wrapper.jar
#	gradlew
#	x-pack/plugin/watcher/qa/with-monitoring/src/javaRestTest/java/org/elasticsearch/smoketest/MonitoringWithWatcherRestIT.java

* [7.17] Use patched nebula os package gradle plugin

* Update testingconvention precommit integ test
2023-10-16 06:18:08 -04:00
Rene Groeschke
5afd06ae57
[7.17] Update Gradle Wrapper to 8.2 (#96686) (#97484)
* Update Gradle Wrapper to 8.2 (#96686)

- Convention usage has been deprecated and was fixed in our build files
- Fix test dependencies and deprecation
2023-09-27 08:46:44 +02:00
Mark Vieira
0ae698b203
Update Gradle Enterprise plugin to 3.14.1 (#98551) (#99254) 2023-09-20 09:32:42 +02:00
Albert Zaharovits
0df52c8f67
Netty4 HTTP authn enhancements (#92220) (#96703)
This is a backport of multiple work items related to authentication enhancements for HTTP,
which were originally merged in the 8.8 - 8.9 releases.
Hence, the HTTP (only the netty4-based implementation (default), not the NIO one) authentication
implementation gets a throughput boost (especially for requests failing authn).

Relates to: ES-6188 #92220 #95112
2023-08-23 18:52:38 +03:00
Volodymyr Krasnikov
32deaf9ff0
Update Guava dependency version to 32.0.1-jre (#97060)
* Update Guava dependency version to 32.0.1-jre

* Fix dependencies

* Remove direct dependencies on guava ver.31

* Revert "Remove direct dependencies on guava ver.31"

This reverts commit 1e90a271c2.
2023-06-27 11:09:50 -07:00
Iraklis Psaroudakis
2a3d71b1e8
Upgrade Netty to 4.1.94.Final (#97114)
Backport of https://github.com/elastic/elasticsearch/pull/97112
2023-06-26 12:05:24 -04:00
Francisco Fernández Castaño
eb9e452058
[7.17] Fix Azure InputStream#read method (#96034) (#96045) 2023-05-12 18:36:32 +02:00
Armin Braun
38b70f65fb
Upgrade Netty to 4.1.89 (#95559)
Upgrading 7.17.x to the version we've been using in 8.x for a while to
resolve audit issues.
2023-04-28 10:26:15 +02:00
Mark Vieira
ef48222227
Fix MapperSizeClientYamlTestSuiteIT when FIPS is enabled (#93357) (#93365)
The issue with this test failure is actually that we were silently
failing to install the plugin under test into the cluster. The root
cause here was the FIPS security policy file was not copied into cluster
config directory before we attempting to run the plugin installer. Since
we pass the FIPS JVM arguments to all CLI tools as well this caused
plugin installation to fail. We now ensure that these files are copied
before we attempt to run _any_ ES tools.

Closes https://github.com/elastic/elasticsearch/issues/93303
2023-01-30 19:25:04 -05:00
Tanguy Leroux
8d8560787a
[7.17] Correctly mute MapperSizeClientYamlTestSuiteIT test {yaml=mapper_size/10_basic/Mapper Size} (#93315) (#93320)
Relates #93303
2023-01-27 10:47:44 -05:00
Pooya Salehi
12351bae58
Upgrade GCS SDK to 2.13.1 (#92327) (#92527)
Upgrade to the latest version of the SDK that doesn't have known CVEs
and builds w/o complaining. Since 2.2.0 the automatic retry behaviour
has changed and the old behaviour can still be used as
LegacyStorageRetryStrategy. The default retry strategy would cause some
test failures, and therefore we'd need to explicitly set a retry
strategy.

Relates #92474
2023-01-03 10:31:40 +01:00
Mark Vieira
47c6fd34da
[7.17] Add JUnit rule based integration test cluster orchestration framework… (#92517)
This commit adds a new test framework for configuring and orchestrating
test clusters for both Java and YAML REST testing. This will eventually
replace the existing "test-clusters" Gradle plugin and the build-time
cluster orchestration.
2022-12-22 17:48:07 -08:00
Jake Landis
fde7837c63
Bump reactor netty version (#92479)
Bump reactor netty version to 1.0.24

backport: #92457
2022-12-20 17:23:47 -06:00
Rene Groeschke
1744a57312
Revert "[7.17] Update to Gradle 7.6 (#89796) (#92235)"
This reverts commit fc43f0105c.
2022-12-20 12:30:21 +01:00
Simon Cooper
ffcc28e142
Remove unnecessary thirdPartyAudit exclusions (#92352)
These are no longer needed after #92120 updated the jackson version along with the azure plugin
2022-12-14 13:55:20 +00:00
Rene Groeschke
fc43f0105c
[7.17] Update to Gradle 7.6 (#89796) (#92235)
* Fix TestResultProcessor api changes
* Fix inputs for generateProviderManifest
* Ignore tests for now until gradle has fixed reporting issue
* Fix dependency substitution in example plugins build
* Use right java bin path on windows
* Add hint to task onlyif when no docker is available
2022-12-08 16:48:35 +01:00
Francisco Fernández Castaño
3ad22fbc17
[7.17] Update Azure SDK to version 12.20.1 (#92120) 2022-12-08 11:07:24 +01:00
Mark Vieira
ef93cbb7f2
Upgrade Gradle Enterprise plugin to 3.11.4 (#91435) (#91566)
# Conflicts:
#	gradle/verification-metadata.xml
#	plugins/examples/settings.gradle
#	settings.gradle
2022-11-14 17:08:51 -05:00
Keith Massey
2110ecc382
Update HDFS Repository to HDFS 3.3.3 (#88039) (#91418)
* Update HDFS Repository to HDFS 3.3.3 (#88039)

This updates the HDFS repository plugin to use HDFS 3.3.3.
2022-11-08 12:45:43 -06:00
Mark Vieira
822dbb4b27 Revert "Upgrade Gradle Enterprise plugin to 3.11.3 (#91323) (#91327)"
This reverts commit 9abde58fa0.
2022-11-07 08:51:07 -08:00
Mark Vieira
9abde58fa0
Upgrade Gradle Enterprise plugin to 3.11.3 (#91323) (#91327) 2022-11-04 12:17:44 -07:00
David Turner
dab70880f9 Report better error for GCS credentials load failure (#89336)
Today if the GCS credentials file setting is invalid we report some kind
of JSON parsing error but it's not clear what JSON is being parsed so
the error is hard to track down. This commit adds the problematic
setting name to the exception message.
2022-08-15 10:53:17 +01:00