Commit graph

1412 commits

Author SHA1 Message Date
Rene Groeschke
611f5cba4f
[BUILD] Support AARCH64 for docker fips images (#125927)
This updates the docker fips base image which support arm and x84
architectures
2025-03-31 22:41:04 +11:00
Mark Vieira
0c50403ebb
Migrate x-pack core module to new testing framework (#125740) 2025-03-27 10:13:29 -07:00
Rene Groeschke
b476ee19b5
Try fixing mutedTest.yml file not found (#125763) 2025-03-27 13:31:52 +01:00
Mark Vieira
e149a3e10d
Convert :test projects to new testing framework (#125724) 2025-03-26 16:11:50 -07:00
Mark Vieira
930b4ab995
Convert remaining plugin projects to new test clusters framework (#125626) 2025-03-26 13:44:07 -07:00
Mark Vieira
0388a5980c
Migrate legacy QA projects to new test clusters framework (#125545) 2025-03-26 10:05:56 -07:00
elastic-renovate-prod[bot]
2204b4a13c
Update docker.elastic.co/wolfi/chainguard-base:latest Docker digest to c4e10ec (#124565)
This PR contains the following updates:

| Package | Update | Change | |---|---|---| |
docker.elastic.co/wolfi/chainguard-base | digest | `15a4191` ->
`c4e10ec` |

---

### Configuration

📅 **Schedule**: Branch creation - "after 1pm on tuesday" (UTC),
Automerge - At any time (no schedule defined).

🚦 **Automerge**: Disabled by config. Please merge this manually once
you are satisfied.

♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the
rebase/retry checkbox.

🔕 **Ignore**: Close this PR and you won't be reminded about this update
again.

---

 - [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check this box

---

This PR has been generated by [Renovate
Bot](https://redirect.github.com/renovatebot/renovate).
<!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiIzOS4xMDcuMCIsInVwZGF0ZWRJblZlciI6IjM5LjEwNy4wIiwidGFyZ2V0QnJhbmNoIjoibWFpbiIsImxhYmVscyI6WyI6RGVsaXZlcnkvUGFja2FnaW5nIiwiPm5vbi1pc3N1ZSIsIlRlYW06RGVsaXZlcnkiLCJhdXRvLW1lcmdlLXdpdGhvdXQtYXBwcm92YWwiXX0=-->
2025-03-27 04:01:35 +11:00
Mark Vieira
d72d81a0eb
Convert remaining module projects to new test clusters framework (#125613) 2025-03-26 08:42:55 -07:00
Rene Groeschke
653c179b08
[Build] Add FIPS docker image for GovCloud (#117152)
- Adds docker image based on chainguard base fips image
- x86 only for now as the base image is x86 only
- the image does not provide any elasticsearch.yml configuration. for testing purposes you can follow the elasticsearch fips guide available at https://github.com/elastic/FIPSGuide/tree/main/elasticsearch

The image is shipped with:
- org.bouncycastle:bc-fips:1.0.2.5 and org.bouncycastle:bctls-fips:1.0.19 in Elasticsearch libs folder
- config/jvm.options.d/fips.options for fips specific JVM options
- fips_java.security file
- fips_java.policy

Out of scope:
- Add packaging test coverage (part of later PR as we want to provide that image for testing early and packaging tests require more general restructuring for support fips scenarios)
2025-03-26 16:15:15 +01:00
Mark Vieira
65751062f7
Re-enable VerifyVersionConstantsIT (#125605) 2025-03-25 12:16:53 -07:00
Rene Groeschke
59a55c85f3
[Gradle] Wire java toolchain plugin into integration tests (#125347)
* [Gradle] Wire java toolchain plugin into integration tests

This addresses transient issues we see in the integration tests where previously resolved jdk toolchain
is not available. See https://gradle-enterprise.elastic.co/s/66msrp7n2nsdy/tests/task/:build-tools-internal:integTest/details/org.elasticsearch.gradle.internal.test.rest.LegacyYamlRestTestPluginFuncTest/yamlRestTest%20executes%20and%20copies%20api%20and%20tests%20to%20correct%20source%20set\?top-execution\=1 for example

* Fix fix
2025-03-23 19:11:24 +01:00
Armin Braun
50437e79d3
Cleanup missing use of StandardCharsets (#125424)
Random annoyance that I figured, I'd just fix globally:
We can do a bit of a cleaner job when doing byte <-> string conversion here and there.
2025-03-21 20:10:15 +01:00
Rene Groeschke
6f7a206a8a
Update Gradle Enterprise Plugin (Develocity) to 3.19.2 (#125137)
with develocity updated to 2024.3.4 we are unblocked on updating the gradle enterprise plugin
2025-03-19 19:19:54 +01:00
Ryan Ernst
a7c71669a4
Update bundled JDK to Java 24 (#125159)
Bumping bundled JDK to Java 24 since it is now GA.
2025-03-19 01:46:37 +02:00
Rene Groeschke
12c2dd5903
[Gradle] Autoprovision jvm for gradle daemon (#124071)
With Gradle 8.13 we can now auto provision the jdk used by the gradle daemon. Our configuration relies on jdk21.
With this autoprovisioning enabled each gradle build will use adoptium jdk 21 for gradle jvm
2025-03-18 19:50:05 +01:00
Rene Groeschke
df7c20acd8
[Gradle] Fix configuration cache issues in distribution subproject (#124281)
* [Gradle] Fix configuration cache issues in distribution subproject

- do not reference tasks from task execution time
- do not use project references at task execution time
- use layout.settingsDir for resolving root project dir

* Fix test coverage

* [CI] Auto commit changes from spotless

---------

Co-authored-by: elasticsearchmachine <infra-root+elasticsearchmachine@elastic.co>
2025-03-18 15:27:47 +01:00
Rene Groeschke
7f722e98eb
[Build] Rework internal build plugin plugin to work with Isolated Projects (#123461)
This fixes a general flaw in our build logic where we reach out to configurations of other projects.
This is not best practice and breaks future initiatives like IsolatedProjects that allow parallel configuration
of subprojects.
2025-03-17 08:27:03 +01:00
Rene Groeschke
ae569def9c
[Build] Require reason for usesDefaultDistribution (#124707)
This makes using usesDefaultDistribution in our test setup for explicit by requiring a reason why it's needed.
This is helpful as part of revisiting the need for all those usages in our code base.
2025-03-17 08:25:39 +01:00
David Turner
d5d81a57db
Upgrade AWS v2 SDK to 2.30.38 (#124738)
Adopts fix for https://github.com/aws/aws-sdk-java-v2/issues/5754,
removing the need for read permissions of sensitive files in
`${HOME}/.aws`.
2025-03-14 07:38:39 +11:00
Joe Gallo
f8ef78446a
Upgrade httpclient to 5.3.3 for build-tools-internal (#124018) 2025-03-07 11:43:15 -05:00
Rene Groeschke
cfa98f30e5
Fix configuration cache compatibility issues (#124073)
- for running :plugins:discovery-ec2:check
- checking if in idea in build scan background action
2025-03-05 21:06:31 +11:00
Rene Groeschke
496c38e5a5
Reapply "Update Gradle wrapper to 8.13 (#122421)" (#123889) (#123896)
This reverts commit 36660f2e5f.
2025-03-05 08:02:13 +01:00
elastic-renovate-prod[bot]
163730352d
Update docker.elastic.co/wolfi/chainguard-base:latest Docker digest to 15a4191 (#124012)
This PR contains the following updates:

| Package | Update | Change | |---|---|---| |
docker.elastic.co/wolfi/chainguard-base | digest | `c66fdaf` ->
`15a4191` |

---

### Configuration

📅 **Schedule**: Branch creation - "after 1pm on tuesday" (UTC),
Automerge - At any time (no schedule defined).

🚦 **Automerge**: Disabled by config. Please merge this manually once
you are satisfied.

♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the
rebase/retry checkbox.

🔕 **Ignore**: Close this PR and you won't be reminded about this update
again.

---

 - [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check this box

---

This PR has been generated by [Renovate
Bot](https://redirect.github.com/renovatebot/renovate).
<!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiIzOS4xMDcuMCIsInVwZGF0ZWRJblZlciI6IjM5LjEwNy4wIiwidGFyZ2V0QnJhbmNoIjoibWFpbiIsImxhYmVscyI6WyI6RGVsaXZlcnkvUGFja2FnaW5nIiwiPm5vbi1pc3N1ZSIsIlRlYW06RGVsaXZlcnkiLCJhdXRvLW1lcmdlLXdpdGhvdXQtYXBwcm92YWwiXX0=-->
2025-03-05 03:10:01 +11:00
Rene Groeschke
18256a5f28
[Gradle] Fix and simplify disabling assertions in test tasks (#123038)
Fixes misleading assertion configuration for test tasks from the command
line. 

We support the following command line args:

1. `-Dtests.jvm.argline=-disableassertions`

2. `-Dtests.jvm.argline=-da`

3. `-Dtests.asserts=false`
2025-03-04 19:28:46 +11:00
Ryan Ernst
1d04b4f810
Skip internal logging in compat check (#123940)
The stable API compatibility checks ensure public jars don't change
their APIs in incompatible ways. Yet the logging jar has an internal
package which can change arbitrarily. This commit adds a temporary
workaround to skip the internal logging package until the compat check
can be made to look at module-info.
2025-03-04 02:43:27 +00:00
Joe Gallo
e602d569bf
Bump up httpcore version (#123932) 2025-03-03 20:42:33 -05:00
Rene Groeschke
36660f2e5f
Revert "Update Gradle wrapper to 8.13 (#122421)" (#123889)
This reverts commit e19b2264af.
2025-03-03 15:51:07 +01:00
Rene Groeschke
7ad7e60368
Still allow building with gradle 8.12.1 (#123881)
to not break es-serverless
2025-03-03 15:19:19 +01:00
Rene Groeschke
e19b2264af
Update Gradle wrapper to 8.13 (#122421)
* Fix Gradle Deprecation warning as declaring an is- property with a Boolean type has been deprecated.
* Make use of new layout.settingsFolder api to address some cross project references
* Fix buildParams snapshot check for multiprojet projects
2025-03-03 14:10:00 +01:00
Rene Groeschke
cd8fbab5b5
Fix some early tasks creations (#123637)
We want to use the task avoidance api whereever possible and delay task
creation
2025-02-28 07:54:01 +11:00
Rene Groeschke
17e35d431b
[IDEA] Enable Gradle Configuration Cache for Gradle Test Runner (#123552)
* [IDEA] Enable Gradle Configuration Cache for Gradle Runner

This should speedup repetitives usages of the Gradle Runner for the majority of test executions
We added a flag to disable it explicitly if it does not work for certain scenarios
2025-02-27 17:34:02 +01:00
Oleksandr Kolomiiets
8db6f16119
Another set of fixes to IDEA test running (#123553) 2025-02-26 15:33:40 -08:00
Mark Vieira
feb3a60e98
Add forwards compatibility testing (#123436) 2025-02-26 08:56:30 -08:00
Nikolaj Volgushev
ae46613049
Upgrade Netty to 4.1.118.Final (#122371)
This PR upgrades Netty to `4.1.118.Final`.
2025-02-26 11:44:25 +01:00
Ryan Ernst
0dafc9974e
Add JDK 24 release candidate to toolchain resolver (#123321) 2025-02-25 20:50:51 -08:00
elastic-renovate-prod[bot]
48d20839fb
Update docker.elastic.co/wolfi/chainguard-base:latest Docker digest to c66fdaf (#123385)
This PR contains the following updates:

| Package | Update | Change | |---|---|---| |
docker.elastic.co/wolfi/chainguard-base | digest | `d74b1fd` ->
`c66fdaf` |

---

### Configuration

📅 **Schedule**: Branch creation - "after 1pm on tuesday" (UTC),
Automerge - At any time (no schedule defined).

🚦 **Automerge**: Disabled by config. Please merge this manually once
you are satisfied.

♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the
rebase/retry checkbox.

🔕 **Ignore**: Close this PR and you won't be reminded about this update
again.

---

 - [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check this box

---

This PR has been generated by [Renovate
Bot](https://redirect.github.com/renovatebot/renovate).
<!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiIzOS4xMDcuMCIsInVwZGF0ZWRJblZlciI6IjM5LjEwNy4wIiwidGFyZ2V0QnJhbmNoIjoibWFpbiIsImxhYmVscyI6WyI6RGVsaXZlcnkvUGFja2FnaW5nIiwiPm5vbi1pc3N1ZSIsIlRlYW06RGVsaXZlcnkiLCJhdXRvLW1lcmdlLXdpdGhvdXQtYXBwcm92YWwiXX0=-->
2025-02-26 03:44:53 +11:00
Ryan Ernst
1ca04b7bae
Capture core dump files from tests (#123169)
When running Elasticsearch in tests we occassionally have JDK crashes.
It's important to capture the state of the JVM at the time of the crash.
We currently capture the hs_err_pid file for the crash, but the
resulting core file exists in a directory that is no captured. This
commit adjusts the capture patterns to also get core files.
2025-02-21 13:55:32 -08:00
Rene Groeschke
4ab11a5950
[GRADLE] Fix idea setup after removing :plugins:repository-hdfs:hadoop-client-api (#123056) 2025-02-20 19:20:10 +01:00
Lorenzo Dematté
2d56eb3f28
Have ASM recompute frames on patched classes (#123004) 2025-02-20 12:27:06 +01:00
Lorenzo Dematté
340a2ceb29
Fix hdfs-related IT tests for java24 (#122044) 2025-02-19 18:27:09 +01:00
elastic-renovate-prod[bot]
9145ab73cf
Update docker.elastic.co/wolfi/chainguard-base:latest Docker digest to d74b1fd (#122839)
This PR contains the following updates:

| Package | Update | Change | |---|---|---| |
docker.elastic.co/wolfi/chainguard-base | digest | `ecd940b` ->
`d74b1fd` |

---

### Configuration

📅 **Schedule**: Branch creation - "after 1pm on tuesday" (UTC),
Automerge - At any time (no schedule defined).

🚦 **Automerge**: Disabled by config. Please merge this manually once
you are satisfied.

♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the
rebase/retry checkbox.

🔕 **Ignore**: Close this PR and you won't be reminded about this update
again.

---

 - [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check this box

---

This PR has been generated by [Renovate
Bot](https://redirect.github.com/renovatebot/renovate).
<!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiIzOS4xMDcuMCIsInVwZGF0ZWRJblZlciI6IjM5LjEwNy4wIiwidGFyZ2V0QnJhbmNoIjoibWFpbiIsImxhYmVscyI6WyI6RGVsaXZlcnkvUGFja2FnaW5nIiwiPm5vbi1pc3N1ZSIsIlRlYW06RGVsaXZlcnkiLCJhdXRvLW1lcmdlLXdpdGhvdXQtYXBwcm92YWwiXX0=-->
2025-02-19 01:28:38 +11:00
Alex Kattathra Johnson
5462601fd6
Upgrade AWS SDK to v1.12.746 (#122431) 2025-02-18 02:44:38 +11:00
David Turner
e161ff204f
Remove discovery-ec2 QA module mention (#122025)
This module was removed in #119384 so we can drop it from the
`RestrictedBuildApiService` now.
2025-02-17 21:18:13 +11:00
Rene Groeschke
9c19538c06
[BUILD] Rework build cache authentication on CI (#122296)
This is required to update to newer version of gradle enterprise and the gradle enterprise plugin.
2025-02-14 16:48:15 +01:00
Rene Groeschke
93d601c391
Develocity setup does not allow overwriting server url (#122470)
This is a prerequisite to have
https://github.com/elastic/elasticsearch/pull/122296 passing in bwc
tests
2025-02-13 19:41:30 +11:00
Mark Vieira
6c6e8d8768
Add release tooling for adding new transport versions (#122426) 2025-02-12 15:59:51 -08:00
elastic-renovate-prod[bot]
2a04bc3e17
Update docker.elastic.co/wolfi/chainguard-base:latest Docker digest to ecd940b (#121659)
This PR contains the following updates:

| Package | Update | Change | |---|---|---| |
docker.elastic.co/wolfi/chainguard-base | digest | `bd40170` ->
`ecd940b` |

---

### Configuration

📅 **Schedule**: Branch creation - "after 1pm on tuesday" (UTC),
Automerge - At any time (no schedule defined).

🚦 **Automerge**: Disabled by config. Please merge this manually once
you are satisfied.

♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the
rebase/retry checkbox.

🔕 **Ignore**: Close this PR and you won't be reminded about this update
again.

---

 - [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check this box

---

This PR has been generated by [Renovate
Bot](https://redirect.github.com/renovatebot/renovate).
<!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiIzNy40MjUuMSIsInVwZGF0ZWRJblZlciI6IjM5LjEwNy4wIiwidGFyZ2V0QnJhbmNoIjoibWFpbiIsImxhYmVscyI6WyI6RGVsaXZlcnkvUGFja2FnaW5nIiwiPm5vbi1pc3N1ZSIsIlRlYW06RGVsaXZlcnkiLCJhdXRvLW1lcmdlLXdpdGhvdXQtYXBwcm92YWwiXX0=-->
2025-02-12 08:20:00 +11:00
Rene Groeschke
6e6e42f5d4
[Build] Fix the manifest target and source information for jdbc projects (#121888)
The nebula info broker plugin takes the information for the manifest from the java project settings rather then from
the compile task configuration. Instead of setting the compiler task configuration explicitly we now set the project
configuration accordingly. Also tweaked the javaTestCompile tasks to keep compiling with general minimum runtime version as we did before
2025-02-11 09:22:29 +01:00
Mark Vieira
0c667ecd2a
Fix thirdPartyAudit task when running on Java 24 (#121712)
We need to explicitly add the incubating vector API module to the third
party audit task on Java 24.
2025-02-05 10:30:08 +11:00
Ryan Ernst
21218c3a69
Add classifier to version specific jar artifacts (#121083)
The mrjar plugin produces artifacts for each java version that may be
consumed downstream. This commit fixes an issue with gradle dependencies
when multiple java versions are depended on.
2025-02-04 20:47:11 +01:00