Commit graph

1237 commits

Author SHA1 Message Date
Mark Vieira
d316013670
Provide better error message when attempting to run incompatible tests (#119699) (#119768) 2025-01-09 03:36:10 +11:00
Mark Vieira
0009de3575
Upgrade Bouncy Castle FIPS dependencies (#112989) (#119614)
This PR updates `bc-fips` and `bctls-fips` dependencies to the latest
minor versions.

(cherry picked from commit 6ea3e01958)

Co-authored-by: Slobodan Adamović <slobodanadamovic@users.noreply.github.com>
2025-01-07 08:03:17 +11:00
Rene Groeschke
433661eb56
[Gradle] Make DistroTestPlugin configuration cache compatible (#119497) (#119523) 2025-01-04 04:08:16 +11:00
Rene Groeschke
95a478846a
[Gradle] Make CopyCheckStyleConfTask usage cc compatible in serverless (#119249) (#119493)
This ensures we can use gradle configuration cache with elasticsearch serverless build

(cherry picked from commit 1d5706edfd)

# Conflicts:
#	build-tools-internal/src/main/java/org/elasticsearch/gradle/internal/precommit/CheckstylePrecommitPlugin.java
2025-01-03 16:18:26 +01:00
Rene Groeschke
005a949c25
[Gradle] Support runtime.java 24 and 25 (#119387) (#119399)
We add explicit support for running build with -Druntime.java=24 and
-Druntime.java=24) By default it takes the build that was available at
implementation time (b29 for 24 and b3 for 25)

You can pass the build number also dynamically by running your build
e.g. with

```
-Druntime.java=24 -Druntime.java.build=29
```

which will resolve java ea24 build 29

fixes #118329

(cherry picked from commit f028340958)
2025-01-01 02:06:41 +11:00
Rene Groeschke
4d17b2193a
Update Gradle wrapper to 8.12 (#118683) (#119357)
This updates the gradle wrapper to 8.12

We addressed deprecation warnings due to the update that includes:

- Fix change in TestOutputEvent api
- Fix deprecation in groovy syntax
- Use latest ospackage plugin containing our fix
- Remove project usages at execution time
- Fix deprecated project references in repository-old-versions

(cherry picked from commit ba61f8c7f7)

# Conflicts:
#	build-tools-internal/src/main/java/org/elasticsearch/gradle/internal/distribution/DockerCloudElasticsearchDistributionType.java
#	build-tools-internal/src/main/java/org/elasticsearch/gradle/internal/distribution/DockerUbiElasticsearchDistributionType.java
#	build-tools-internal/src/main/java/org/elasticsearch/gradle/internal/test/Fixture.java
#	plugins/repository-hdfs/hadoop-client-api/build.gradle
#	server/src/main/java/org/elasticsearch/inference/ChunkingOptions.java
#	x-pack/plugin/kql/build.gradle
#	x-pack/plugin/migrate/build.gradle
#	x-pack/plugin/security/qa/security-basic/build.gradle
2024-12-31 08:37:28 +01:00
Rene Groeschke
f75095c7ef
[Build] Make test cluster plugin configuration cache compatible (#116890) (#119367)
This adds infrastructure to make the legacy test cluster plugin and
the legacy test cluster based test plugins generally configuration cache compatible.

(cherry picked from commit 8c20ac5884)

# Conflicts:
#	qa/mixed-cluster/build.gradle
2024-12-31 06:04:16 +11:00
Rene Groeschke
c158859921
[8.16] Reapply "[Build] Do not invalidate configuration cache when branch is switched (#118894)" (#119300) (#119325) (#119338)
* Reapply "[Build] Do not invalidate configuration cache when branch is switched (#118894)" (#119300) (#119325)

* Reapply "[Build] Do not invalidate configuration cache when branch is switched (#118894)" (#119300)

The original PR (#118894) has broken serverless.

* Fix gitinfo plugin for serverless usage

* Update buildscan git revision reference

(cherry picked from commit 5278159987)

# Conflicts:
#	build-conventions/src/main/java/org/elasticsearch/gradle/internal/conventions/PublishPlugin.java

* Fix merge conflict
2024-12-30 15:31:36 +01:00
Rene Groeschke
36d3f6da28
Fix buildscan setup after buildParam rework (#119274) (#119290) 2024-12-27 04:09:41 +11:00
Mark Vieira
9d4762d5a4
Improve efficiency of incremental builds when building bwc distributions (#118713) (#119021) 2024-12-23 11:25:02 -08:00
Mark Vieira
39154c1223
Mute BuildParameterExtensionSpec failing test 2024-12-23 09:25:38 -08:00
Rene Groeschke
c2503868fb
[8.16] [Build] Fix Concurrency issue in buildparams access (#117552) (#118642)
* [Build] Fix Concurrency issue in buildparams access (#117552)

Also provide caching support for buildparams provider
* Extract BuildParameterExtension public api into interface
* Make tests better readable
* Fix test flakyness

* Make BuildParameterExtensionSpec java 17 compatible

* Try fix BuildParameterExtensionSpec
2024-12-20 11:02:10 +11:00
Rene Groeschke
cdf97a5b7f
[8.16] [Gradle] Fix Idea setup when configuration cache enabled (#119123) (#119158)
* [Gradle] Fix Idea setup when configuration cache enabled (#119123)

(cherry picked from commit 2f25f67b38)

# Conflicts:
#	build-tools-internal/src/main/groovy/elasticsearch.ide.gradle

* Fix merge conflict
2024-12-20 00:41:27 +01:00
Rene Groeschke
f28df38704
[8.17] Revert cloud wolfi migration (#119068) (#119103)
This reverts the wolfi migration for cloud ess docker images.

(cherry picked from commit 81f725d3d8)

# Conflicts:
#	build-tools-internal/src/main/java/org/elasticsearch/gradle/internal/DockerBase.java
#	distribution/docker/build.gradle
#	qa/packaging/src/test/java/org/elasticsearch/packaging/test/DockerTests.java
2024-12-20 03:22:05 +11:00
elastic-renovate-prod[bot]
4b8a0ccf5a
Update docker.elastic.co/wolfi/chainguard-base:latest Docker digest to bfdeddb (#118901)
Co-authored-by: elastic-renovate-prod[bot] <174716857+elastic-renovate-prod[bot]@users.noreply.github.com>
2024-12-18 08:11:35 +01:00
Brian Seeders
b13bcbc879
Bump versions after 8.16.2 release 2024-12-17 13:34:31 -05:00
Rene Groeschke
825b4763ce
Update docker.elastic.co/wolfi/chainguard-base:latest Docker digest to 1b51ff6 (#117902) (#118724)
Co-authored-by: elastic-renovate-prod[bot] <174716857+elastic-renovate-prod[bot]@users.noreply.github.com>
Co-authored-by: Rene Groeschke <rene@elastic.co>
(cherry picked from commit 21b7afd669)
2024-12-15 02:30:47 +01:00
Mark Vieira
82ebd0aeb5
Update BWC version logic to support multiple bugfix versions (#117943) (#118116) (#118119) 2024-12-05 16:15:12 -08:00
Brian Seeders
84860a0b75
[CI] Pull in the latest mutes from base branch for PRs at runtime (#117587) (#117661)
(cherry picked from commit a46547c8dc)
2024-11-27 16:56:35 -05:00
Rene Groeschke
581b9ab7c0
[8.16] [Gradle] Remove static use of BuildParams (#115122) (#117434)
* [Gradle] Remove static use of BuildParams (#115122)

Static fields dont do well in Gradle with configuration cache enabled.

- Use buildParams extension in build scripts
- Keep BuildParams.ci for now for easy serverless migration
-  Tweak testing doc

(cherry picked from commit 13c8aaeffa)

# Conflicts:
#	TESTING.asciidoc
#	build-tools-internal/src/main/java/org/elasticsearch/gradle/internal/InternalDistributionBwcSetupPlugin.java
#	build-tools-internal/src/main/java/org/elasticsearch/gradle/internal/test/rest/RestTestBasePlugin.java
#	build-tools-internal/src/main/java/org/elasticsearch/gradle/internal/test/rest/compat/compat/AbstractYamlRestCompatTestPlugin.java
#	build.gradle
#	modules/ingest-geoip/qa/full-cluster-restart/build.gradle
#	qa/mixed-cluster/build.gradle
#	x-pack/plugin/ent-search/qa/full-cluster-restart/build.gradle
#	x-pack/plugin/eql/qa/rest/build.gradle
#	x-pack/plugin/fleet/qa/rest/build.gradle
#	x-pack/plugin/kql/build.gradle
#	x-pack/plugin/mapper-unsigned-long/build.gradle
#	x-pack/plugin/ml/qa/multi-cluster-tests-with-security/build.gradle
#	x-pack/plugin/security/qa/multi-cluster/build.gradle
#	x-pack/plugin/sql/qa/jdbc/build.gradle
#	x-pack/plugin/transform/qa/multi-cluster-tests-with-security/build.gradle

* Fix merge

* [Build] Fix fips testing after buildparams rework (#116934)

* More Cleanup

* [Build] Fix checkstyle exclusions on windows (#115185)

* More merge fixes

* Delete x-pack/plugin/kql/build.gradle
2024-11-27 12:34:32 +01:00
Rene Groeschke
e50a2670e1
[Build] Reapply updating to Gradle 8.11.1 (#117394) (#117429)
This reverts commit b5c6d927c1.
* Simplify and fix dynamic project dependency handling

(cherry picked from commit d2b3dc51d1)
2024-11-25 02:29:31 +11:00
Brian Seeders
89d0acb899
Bump versions after 8.16.1 release 2024-11-21 16:17:30 -05:00
Rene Groeschke
68337ff66e
[Gradle] Update shadow plugin (#116826) (#116877)
- The shadow plugin has changed ownership and plugin id.
- Make some formatting of poms more reproducible

(cherry picked from commit def490ef85)
2024-11-16 15:06:35 +01:00
Jake Landis
3aa26ab364
Bump Netty to 4.1.115.Final (#116696) (#116758)
This commit bumps Netty from 4.1.109.Final to 4.1.115.Final

(cherry picked from commit b42dbab0a4)
2024-11-14 05:01:41 +11:00
elasticsearchmachine
fc8b5fd35e Bump versions after 8.16.0 release 2024-11-12 16:47:20 +00:00
Mark Vieira
22fe37d327
Avoid resolving project dependencies in 'resolveAllDependencies' task (#115888) (#115945) 2024-10-31 02:38:38 +11:00
Ryan Ernst
1a7ab4d4b8
Update bundled jdk to 23 (#114852) (#115335)
After completing additional validation with the JIT workaround in #113817, this commit upgrades the bundled JDK to 23.

This is a backport of #114823
2024-10-25 04:22:49 +11:00
Mark Vieira
211260f719
Temporarily disable buildkite upload on Windows agents (#115449) (#115453) 2024-10-24 07:16:25 +11:00
Rene Groeschke
6192818528
Replace cloud-ess docker image with wolfi-ess (#114413) (#114684)
* Replace cloud-ess docker image with wolfi-ess
   We just replaced the existing implementation of cloud-ess with what was wolfi-ess which is a wolfi based ess image.
   The cloud image itself will be removed in a future commit it was not used anywhere

* Switch to test cloud docker image instead of default docker in packaging pr tests.
  This adds way more coverage than the default docker image which is also barely touched

(cherry picked from commit f1f5ee06a3)

# Conflicts:
#	build-tools-internal/src/main/java/org/elasticsearch/gradle/internal/DockerBase.java
2024-10-14 16:07:11 +02:00
Rene Groeschke
45f57f11a2
[8.x] Update wolfi image and fix breaking change (#114390) (#114489)
* Update wolfi image and fix breaking change (#114390)

(cherry picked from commit 190513dce7)

# Conflicts:
#	build-tools-internal/src/main/java/org/elasticsearch/gradle/internal/DockerBase.java

* Fix spotlight
2024-10-11 21:08:33 +11:00
Rene Groeschke
cec4609543
[CI] Fix PublishPluginFuncTest (#114511) (#114517)
(cherry picked from commit 388d24f2f5)
2024-10-11 04:01:09 +11:00
Mark Vieira
9e56960b56
Bump default timeout for test suites on Windows to 60 minutes (#114428) (#114446)
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2024-10-10 09:02:17 -07:00
Rene Groeschke
94ea8efb90
[Build] Add AGPL license to open source poms (#114403) (#114487)
Aftermath of coming back to open source licensing
2024-10-10 11:36:55 -04:00
Nik Everett
67ce8bd244
ESQL: Entirely remove META FUNCTIONS (#113967) (#114342)
This removes the undocumented `META FUNCTIONS` command that emits
descriptions for all functions. This shouldn't be used because we never
told anyone about it. I'd have preferred if we'd have explicitly
documented it as no public or if we'd have left it snapshot-only. But
sometimes you make a mistake. I'm hopeful no one is relying on it. It
was never reliable and not public.....
2024-10-10 07:51:18 +11:00
Rene Groeschke
69e88f33d4
Timeout on buildkite artifact upload but do not fail the build (#114430) (#114434)
this workarounds an issue we currently see on windows ci boxes where we
run into timeouts in this step in our builds
2024-10-10 06:38:59 +11:00
Slobodan Adamović
8c6b036aa4
Upgrade protobufer to 3.25.5 (#113869) (#114117)
Updating `com.google.protobuf:protobuf-java-util` and
`com.google.protobuf:protobuf-java` dependencies to
the latest 3.x version.

(cherry picked from commit ddf019a1a5)
2024-10-04 22:00:16 +10:00
Rene Groeschke
54ecb2c666
Add wolfi ess docker image (#113810) (#114111)
(cherry picked from commit 54c83d7fa7)
2024-10-04 13:44:42 +02:00
Chris Hegarty
45a08b94b3
Upgrade to Lucene 9.12.0 (#113333) (#113835)
This commit upgrades to Lucene 9.12.0.

Co-authored-by: Adrien Grand <jpountz@gmail.com>
Co-authored-by: Armin Braun <me@obrown.io>
Co-authored-by: Benjamin Trent <ben.w.trent@gmail.com>
Co-authored-by: John Wagster <john.wagster@elastic.co>
Co-authored-by: Luca Cavanna <javanna@apache.org>
Co-authored-by: Mayya Sharipova <mayya.sharipova@elastic.co>
2024-10-01 13:55:02 +01:00
Simon Cooper
5ba445e4b2
Add jvm option to enable test features (#113108) (#113700)
The option is only enabled for test clusters, and turns on features that are only present in tests

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2024-09-30 19:29:26 +10:00
Rene Groeschke
339d4e462b
Update Gradle wrapper to 8.10.2 (#113603) (#113719)
Update Gradle wrapper to 8.10.2
2024-09-28 06:03:48 +10:00
Brian Seeders
c0be2e2c1b
Fix packaging tests after addition of new wolfi-based image (#112831) (#113715) 2024-09-27 16:01:14 -04:00
Ryan Ernst
8b795d4048
Remove plugin classloader indirection (#113154) (#113273)
Extensible plugins use a custom classloader for other plugin jars. When
extensible plugins were first added, the transport client still existed,
and elasticsearch plugins did not exist in the transport client (at
least not the ones that create classloaders). Yet the transport client
still created a PluginsService. An indirection was used to avoid
creating separate classloaders when the transport client had created the
PluginsService.

The transport client was removed in 8.0, but the indirection still
exists. This commit removes that indirection layer.

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2024-09-27 03:55:44 +10:00
Simon Cooper
31d5967d35
Remove use of SPI locale for JDK 23+ (#113182)
On JDK 23 we're just going with what CLDR specifies for week-date calculations - the built-in locales are available for ISO weekdate uses.
2024-09-20 16:48:17 +01:00
Rene Groeschke
28f8803444
Update Gradle wrapper to 8.10.1 (#112948) (#113205) 2024-09-20 04:27:56 +10:00
Mark Vieira
0279c0a909
Add AGPLv3 as a supported license 2024-09-13 14:30:33 -07:00
Martijn van Groningen
47be9bb975
[8.x] Remove zstd feature flag for index codec best compression. (#112665) (#112857)
* Remove zstd feature flag for index codec best compression. (#112665)

ZStandard was added via #103374 a few months ago to snapshot builds of Elasticsearch only and benchmark results have shown that using zstd is a better trade off compared to deflate for when index.codec is set to best_compression.

This change removes the feature flag for ZStandard stored field compression for indices with index.codec set to best_compression.

* Update docs/changelog/112857.yaml

---------

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2024-09-14 02:48:37 +10:00
Brian Seeders
c47162afca
Add missing hyphen for wolfi immage suffix 2024-09-10 22:42:00 -04:00
Mark Vieira
7e16c9bf08
Remove debug logging 2024-09-06 14:08:37 -07:00
Rene Groeschke
4dee614707
Add chainguard docker image (#112103) 2024-09-06 10:32:42 -07:00
Mark Vieira
24f33e95e8
Ensure rest compatibility tests are run when appropriate (#112526) 2024-09-05 08:22:48 -07:00