Commit graph

931 commits

Author SHA1 Message Date
Rene Groeschke
d2ac44dc79
[Gradle] Autoprovision jvm for gradle daemon (#124071) (#125149)
With Gradle 8.13 we can now auto provision the jdk used by the gradle daemon. Our configuration relies on jdk21.
With this autoprovisioning enabled each gradle build will use adoptium jdk 21 for gradle jvm
2025-03-19 07:05:09 +11:00
Mark Vieira
64a6f5aeaa
Generate compatible versions artifact in distributions dir (#124119) (#124130) 2025-03-06 05:57:18 +11:00
Mark Vieira
66ce431341
Add build artifact containing json file of all wire compatible versions (#123740) (#124039)
(cherry picked from commit e54037b7d0)

# Conflicts:
#	build.gradle
2025-03-05 06:14:25 +11:00
Mark Vieira
e577caf6fb
Add forwards compatibility testing CI pipeline (#123544) 2025-02-26 13:47:51 -08:00
Rene Groeschke
37e0c6f214
Move eclipse specific extention property into elasticsearch eclipse plugin (#123320) (#123345) 2025-02-26 13:11:17 +01:00
Rene Groeschke
85ef42376b
Breakup release tests in PR (#120692) (#120729)
* Breakup release tests in PR
* fix test release task dependencies

(cherry picked from commit 1484f783d8)

# Conflicts:
#	build.gradle
2025-01-29 16:51:37 +01:00
Rene Groeschke
e911a8d7fe
[Gradle] Fix deprecation warning in branchConsistency task (#119587) (#119595)
The groovy syntax we use in branchConsistency task was deprecated in
gradle 8.12
2025-01-07 04:44:42 +11:00
Rene Groeschke
49c0f5cf71
Update Gradle wrapper to 8.12 (#118683) (#119356)
This updates the gradle wrapper to 8.12

We addressed deprecation warnings due to the update that includes:

- Fix change in TestOutputEvent api
- Fix deprecation in groovy syntax
- Use latest ospackage plugin containing our fix
- Remove project usages at execution time
- Fix deprecated project references in repository-old-versions

(cherry picked from commit ba61f8c7f7)

# Conflicts:
#	build-tools-internal/src/main/java/org/elasticsearch/gradle/internal/distribution/DockerUbiElasticsearchDistributionType.java
#	build-tools-internal/src/main/java/org/elasticsearch/gradle/internal/test/Fixture.java
#	plugins/repository-hdfs/hadoop-client-api/build.gradle
#	qa/entitlements/build.gradle
#	server/src/main/java/org/elasticsearch/indices/IndicesFeatures.java
#	x-pack/plugin/migrate/build.gradle
#	x-pack/plugin/security/qa/security-basic/build.gradle
2024-12-31 08:37:12 +01:00
Rene Groeschke
ca708f8ff0
[Gradle] Fix configuration cache for validateChangelogs task definition (#116716) (#119276)
(cherry picked from commit 31492f52a3)
2024-12-26 08:14:41 +11:00
Rene Groeschke
086b94facb
[Build] Cache spotless p2 dependencies when baking ci image (#118523) (#118591)
The eclipse formatter used by spotless is resolved at runtime and not declared as
gradle dependency. Therefore we need to run the spotless task to ensure we have
the dependencies resolved as part of our ci image baking.

This should avoid issues with connecting to p2 repos we have experienced lately
in our ci environment

* Revert "[Build] Declare mirror for eclipse p2 repository (#117732)"

This reverts commit c35777a175.
2024-12-12 21:46:03 +01:00
Rene Groeschke
20a78a18e9
[8.17] [Gradle] Remove static use of BuildParams (#115122) (#117433)
* [Gradle] Remove static use of BuildParams (#115122)

Static fields dont do well in Gradle with configuration cache enabled.

- Use buildParams extension in build scripts
- Keep BuildParams.ci for now for easy serverless migration
-  Tweak testing doc

(cherry picked from commit 13c8aaeffa)

# Conflicts:
#	TESTING.asciidoc
#	build-tools-internal/src/main/java/org/elasticsearch/gradle/internal/test/rest/RestTestBasePlugin.java
#	build-tools-internal/src/main/java/org/elasticsearch/gradle/internal/test/rest/compat/compat/AbstractYamlRestCompatTestPlugin.java
#	build.gradle
#	modules/ingest-geoip/qa/full-cluster-restart/build.gradle
#	qa/mixed-cluster/build.gradle
#	x-pack/plugin/ent-search/qa/full-cluster-restart/build.gradle
#	x-pack/plugin/eql/qa/rest/build.gradle
#	x-pack/plugin/fleet/qa/rest/build.gradle
#	x-pack/plugin/kql/build.gradle
#	x-pack/plugin/mapper-unsigned-long/build.gradle
#	x-pack/plugin/ml/qa/multi-cluster-tests-with-security/build.gradle
#	x-pack/plugin/security/qa/multi-cluster/build.gradle
#	x-pack/plugin/sql/qa/jdbc/build.gradle
#	x-pack/plugin/transform/qa/multi-cluster-tests-with-security/build.gradle

* Some cleanup

* Update build.gradle

fix buildparams access
2024-11-25 18:29:26 +01:00
Rene Groeschke
28b2f5248f
[Gradle] Update shadow plugin (#116826) (#116876)
- The shadow plugin has changed ownership and plugin id.
- Make some formatting of poms more reproducible

(cherry picked from commit def490ef85)
2024-11-16 15:06:40 +01:00
Mark Vieira
cb2ac6750d
Don't run validate changelogs task during 'check' tasks (#116028) (#116034) 2024-11-01 05:07:56 +11:00
Brian Seeders
093ce26871
[8.x] Modify verifyVersions to care about 8.x rather than main for backport config (#114957) 2024-10-16 17:57:41 -04:00
Mark Vieira
0279c0a909
Add AGPLv3 as a supported license 2024-09-13 14:30:33 -07:00
Rene Groeschke
320f2414aa
Ignore configs from DistributionDownload plugin and bwc for resolveAllDependencies (#110828) 2024-07-12 17:17:55 +02:00
Rene Groeschke
8ac3e3dd90
Update Gradle wrapper to 8.8 (#108021)
Fix incompatibility with 8.8 and our internal api usages

- Update ospackage to a version that contains a fix we provided
- Tweak build logic to avoid deprecation warnings
- Use newer permission api
- Use custom shadowplugin
- Rework ElasticsearchDistribution dependencies resolution
- Update Gradle wrapper to 8.8
2024-06-04 12:43:02 +02:00
Brian Seeders
7eae95620b
[ci] Move multi-node tests from check part2 to part5 (#107553) 2024-04-29 11:15:43 -04:00
Mark Vieira
392a7599c1
Update verifyVersion task after #106143 2024-03-27 14:49:53 -07:00
Mark Vieira
b1e4407c0a
Reduce BWC testing to include only latest patch releases (#106143)
This commit alters our backward compatibility testing logic to restrict
testing to the latest patch release for any given minor version. Since
our policy is not to do any kind of breaking changes in patches, most of
this testing is superfluous. This change reduces the number of versions
we need to test by over 70%.
2024-03-27 10:31:48 -07:00
Brian Seeders
6f8280c12a
[ci] Refactor BWC templating in Buildkite pipelines to handle more scenarios (#106084) 2024-03-07 16:56:07 -05:00
Mark Vieira
9da3caa0b2
Split out Java matrix BWC tasks (#106078) 2024-03-07 10:36:35 -08:00
ChrisHegarty
237db902d2 Update to 9.9.0 RC 2023-12-04 13:03:55 +00:00
ChrisHegarty
d2584ecfa2 Bump to lucene 9.9.0 RC2 2023-11-30 18:57:48 +00:00
ChrisHegarty
0f394d0606 Use lucene 9.0.0 RC1 2023-11-29 21:35:55 +00:00
Rene Groeschke
19f5bc444c
Fix creation of large build job archives (#102023)
* Fix large file and large path handling in build tar creating
2023-11-21 20:29:27 +01:00
Rene Groeschke
3d6ba88531
Splitup x-pack testing in more build steps (#101987)
We want to keep pull request and intake build time as short as possible.

While testing this I noticed though that all those checkPartX runs are basically building core modules e.g. like :server by themself not leveraging the gradle cache ideally as all 4 checkPart jobs running in parallel likely run :server:compileJava in parallel. Not sure this is a big deal. I remember within the gradle team we had similar issues and addressed this by
quick dedicated "populating build cache" pipeline steps. Not something we need to look into now, but at one point investigating this approach might be valuable for certain scenarios.
2023-11-14 11:02:21 +01:00
Rene Groeschke
e70da0491a
Revert "Keep old plugin name for build complete plugin (#101995)" (#102026)
This reverts commit 46f545cf45 as we need
to sort out the cause of #102022 first
2023-11-10 12:07:20 -05:00
Rene Groeschke
46f545cf45
Keep old plugin name for build complete plugin (#101995)
Fixes incompatibility with serverless builds
2023-11-10 03:11:58 -05:00
Rene Groeschke
841f711a0a
Make gradle build finished logic CC compatible (#96475)
* Make gradle build finished logic CC compatible
* Make ElasticsearchBuildFinishedPlugin configuration cache aware
* Add gradle enterprise plugin to buildlibs version catalogue
2023-11-10 08:05:13 +01:00
Mark Vieira
6d96998ef1
Disable BWC tests in encryption at rest CI job (#100784) 2023-10-12 16:19:53 -07:00
Mark Vieira
6a902684c5
Exclude BWC tests in platform support testing matrix (#100643) 2023-10-11 08:51:25 -07:00
Brian Seeders
4731ceaa1c
[buildkite] Migrate intake pipeline (#99133) 2023-09-06 10:32:44 -04:00
Brian Seeders
077aaf5141
[buildkite] Add most of the remaining periodic pipelines (#98043) 2023-09-05 11:07:57 -04:00
Rene Groeschke
9bcefc3ddf
Resolve java toolchains when prefilling gradle cache (#98796)
As part of creating our ci images we prefill gradle caches to reduce build times. As part of that we now
also cache the java toolchain we resolve using the gradle toolchain provider
2023-08-23 21:43:54 +02:00
Andrei Dan
c632108aa1
Remove feature flag checks from DLM serialisation (#96583)
Remove feature flag checks from DLM serialisation.
2023-06-07 13:13:28 +01:00
Andrei Dan
b73babfefe
Disable bwc tests in preparation for DLM updates (#96644) 2023-06-07 10:51:55 +01:00
Rene Groeschke
4e2f852c08
Resolve runtime java via Gradle tool chain provider (#95319)
Using gradle toolchain support in gradle requires refactoring how the composite build is composed. 
We added three toolchain resolver
1. Resolver for resolving defined bundled version from oracle as openjdk
2. Resolve all available jdks from Adoption
3. Resolve archived Oracle jdk distributions. 

We should be able to remove the JdkDownloadPlugin altogether without having that in place, but we'll do that in a separate effort.

Fixes #95094
2023-05-03 15:28:47 +02:00
Rene Groeschke
9ce5baed0c
Update Gradle wrapper to 8.0.2 (#92751)
- Remove custom checksum build logic in wrapper task
- Adjust jdk home handling adjusting the change in behaviour in gradle. Requires providing canonical paths for provisioned jdk homes.
- Fix test by add workaround to bug in configuration cache
2023-03-09 13:00:12 +01:00
Mark Vieira
c80f7912c5
Avoid building test fixtures when building release artifacts (#94200)
We don't want to build test fixture projects when building our release
artifacts.
2023-02-28 13:09:42 -05:00
Rene Groeschke
08845b78f2
Update Gradle Wrapper to 7.6.1 (#89796) (#92241) (#94122)
This updates the gradle wrapper to 7.6.1. This patch release contains a
fix for  incremental compilation of java modules we have raised against
gradle 7.6

see https://github.com/gradle/gradle/issues/23067
2023-02-24 11:48:08 -05:00
David Kyle
3a8fdf18de
[ML] Adapt Inference actions for backport and reenable BWC
Due to #92819
2023-01-11 16:53:39 +00:00
David Kyle
6acfbbcd8b
[ML] Utilise parallel allocations where the inference request contains multiple documents (#92359)
Divide work from the _infer API among all allocations
2023-01-11 12:38:35 +00:00
David Turner
bdf634f9f5
Fixup BWC after backport of #92259 (#92280)
Adjusts the BWC version for the wire protocol and re-enables the BWC
tests.
2022-12-12 08:36:27 -05:00
David Turner
296eacd1a3 Disable BWC tests for #92277 2022-12-12 12:53:51 +00:00
Rene Groeschke
8b9f3b595f
Revert "Update to Gradle 7.6 (#89796)" (#92241)
We have seen reports of broken compilation after a clean build
after updating to gradle 7.6.

This reverts commit deaf92878a.
2022-12-08 17:55:45 +01:00
Rene Groeschke
deaf92878a
Update to Gradle 7.6 (#89796)
* Fix TestResultProcessor api changes
* Fix inputs for generateProviderManifest
* Ignore tests for now until gradle has fixed reporting issue
* Fix dependency substitution in example plugins build
* Use right java bin path on windows
* Add hint to task onlyif when no docker is available
2022-12-08 11:11:13 +01:00
David Kyle
a04d023547
[ML] Adjust serialisation of inference requests for BWC (#92157)
Adjust serialisation for BWC
2022-12-06 15:09:32 +00:00
David Roberts
92d096cd4b
Muting BWC tests while serialization fix is tested (#92158)
Relates #92153, #92157
2022-12-06 08:38:05 -05:00
Adrien Grand
2e8200a05a
Re-enable bwc tests after #91823. (#91881) 2022-11-28 11:18:29 +01:00