Commit graph

1412 commits

Author SHA1 Message Date
Rene Groeschke
30aef7e990
Revert wolfi image update (#114350)
Latest wolfi update caused our wolfi-ess image build to fail
2024-10-09 06:29:11 +11:00
Nik Everett
d3fa42cda0
ESQL: Entirely remove META FUNCTIONS (#113967)
This removes the undocumented `META FUNCTIONS` command that emits
descriptions for all functions. This shouldn't be used because we never
told anyone about it. I'd have preferred if we'd have explicitly
documented it as no public or if we'd have left it snapshot-only. But
sometimes you make a mistake. I'm hopeful no one is relying on it. It
was never reliable and not public.....
2024-10-08 18:37:55 +02:00
elastic-renovate-prod[bot]
0a0a4cb9ad
Update docker.elastic.co/wolfi/chainguard-base:latest Docker digest to 90888b1 (#114284)
This PR contains the following updates:

| Package | Update | Change | |---|---|---| |
docker.elastic.co/wolfi/chainguard-base | digest | `c16d3ad` ->
`90888b1` |

---

### Configuration

📅 **Schedule**: Branch creation - At any time (no schedule defined),
Automerge - At any time (no schedule defined).

🚦 **Automerge**: Disabled by config. Please merge this manually once
you are satisfied.

♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the
rebase/retry checkbox.

🔕 **Ignore**: Close this PR and you won't be reminded about this update
again.

---

 - [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check this box

---

This PR has been generated by [Renovate
Bot](https://togithub.com/renovatebot/renovate).
<!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiIzNy40MjUuMSIsInVwZGF0ZWRJblZlciI6IjM3LjQyNS4xIiwidGFyZ2V0QnJhbmNoIjoibWFpbiIsImxhYmVscyI6W119-->
2024-10-09 01:39:19 +11:00
Slobodan Adamović
ddf019a1a5
Upgrade protobufer to 3.25.5 (#113869)
Updating `com.google.protobuf:protobuf-java-util` and 
`com.google.protobuf:protobuf-java` dependencies to 
the latest 3.x version.
2024-10-04 12:47:39 +02:00
Rene Groeschke
54c83d7fa7
Add wolfi ess docker image (#113810) 2024-10-04 11:01:49 +02:00
Chris Hegarty
32dde26e49
Upgrade to Lucene 9.12.0 (#113333)
This commit upgrades to Lucene 9.12.0.

Co-authored-by: Adrien Grand <jpountz@gmail.com>
Co-authored-by: Armin Braun <me@obrown.io>
Co-authored-by: Benjamin Trent <ben.w.trent@gmail.com>
Co-authored-by: Chris Hegarty <chegar999@gmail.com>
Co-authored-by: John Wagster <john.wagster@elastic.co>
Co-authored-by: Luca Cavanna <javanna@apache.org>
Co-authored-by: Mayya Sharipova <mayya.sharipova@elastic.co>
2024-10-01 08:39:27 +01:00
Jake Landis
2eb9274339
Minor enhancements to compatible test tranformations task (#112840)
This commit adds support to transform the value of the value field in the close_to assertion.
For example, with the following configuration:

tasks.named("yamlRestCompatTestTransform").configure({ task ->
   task.replaceValueInCloseTo("get.fields._routing", 9.5, "my test name")
})

will transform the following in "my test name" from:

 close_to:   { get.fields._routing: { value: 5.1, error: 0.00001 } }

to

 close_to:   { get.fields._routing: { value: 9.5, error: 0.00001 } }

This commit also adds supports to specify a specific test name to apply the replaceIsTrue task configuration.
Before this commit, you could replace the values in the is_true, but it only supported doing so for all tests subject to the configuration.
2024-09-30 17:37:00 -05:00
Rene Groeschke
259b0cdd30
Update Gradle wrapper to 8.10.2 (#113603)
Update Gradle wrapper to 8.10.2
2024-09-28 04:52:13 +10:00
Simon Cooper
074af78b91
Add jvm option to enable test features (#113108)
The option is only enabled for test clusters, and turns on features that are only present in tests
2024-09-27 16:13:34 +01:00
Brian Seeders
fba8045d99
[docker] Rename -ubi8 suffix to -ubi (#112884)
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2024-09-26 15:57:50 -04:00
Jake Landis
888188695a
Bump compatible rest api version to 9/8 (#113151)
This commit bumps the REST API version from 8 to 9. This effectively removes all support for REST API 
compatibility with version 7 (though earlier commits already chipped away at some v7 support).

This also enables REST API compatibility support for version 8, providing support for v8 compatibility headers, 
i.e. "application/vnd.elasticsearch+json;compatible-with=8" and no-op support (no errors) to accept v9 
compatibility headers i.e. "application/vnd.elasticsearch+json;compatible-with=9".

see additional context in the GH PR #113151
2024-09-26 14:52:05 -05:00
Brian Seeders
e9b303322c
Fix packaging tests after addition of new wolfi-based image (#112831)
* Add more missing wolfi references to fix tests
* packaging tests require access to docker registry
* Fix symlink for es distributions jdk cacerts in wolfi docker
* Fix native support on wolfi images
* Fix provided keystore packaging tests for wolfi
* Add utils used for testing to wolfi image
* Explicitly set default shell to bash in docker images
* Fix docker config issues
* Apply review feedback around docker login

---------

Co-authored-by: Rene Groeschke <rene@elastic.co>
2024-09-26 11:11:01 +02:00
Simon Cooper
f9aa6f40cd
Always use CLDR locale on ES v9 (#113184)
Regardless of JDK version, ES should always use CLDR locale database from 9.0.0.
This also removes IsoCalendarDataProvider used to override week-date calculations for the root locale only.
2024-09-23 11:05:08 +01:00
Ryan Ernst
2ecfb397ad
Remove plugin classloader indirection (#113154)
Extensible plugins use a custom classloader for other plugin jars. When
extensible plugins were first added, the transport client still existed,
and elasticsearch plugins did not exist in the transport client (at
least not the ones that create classloaders). Yet the transport client
still created a PluginsService. An indirection was used to avoid
creating separate classloaders when the transport client had created the
PluginsService.

The transport client was removed in 8.0, but the indirection still
exists. This commit removes that indirection layer.
2024-09-20 07:45:40 -07:00
Ryan Ernst
0dfc5f7859
Remove JNA from native access (#112977)
Now that main has a minimum compile version of Java 21, native access no
longer needs JNA. This commit removes JNA as a dependency, and moves the
jdk implementation into the main source set. It also slightly adjusts
the Mrjar plugin so that the main source set also supports preview
features, like the other numbered source sets.
2024-09-19 12:40:08 -07:00
Rene Groeschke
3aa84159fc
Update Gradle wrapper to 8.10.1 (#112948) 2024-09-19 19:23:42 +02:00
Mark Vieira
a59c182f9f
Add AGPLv3 as a supported license 2024-09-13 15:29:46 -07:00
Martijn van Groningen
661efa9d97
Remove zstd feature flag for index codec best compression. (#112665)
ZStandard was added via #103374 a few months ago to snapshot builds of Elasticsearch only and benchmark results have shown that using zstd is a better trade off compared to deflate for when index.codec is set to best_compression.

This change removes the feature flag for ZStandard stored field compression for indices with index.codec set to best_compression.
2024-09-13 10:49:49 +02:00
Mark Vieira
707851834a
Fix verifyVersions task (#112765) 2024-09-11 14:50:06 -07:00
Chris Hegarty
71d4648105
Bump Elasticsearch to a minimum of JDK 21 (#112252) 2024-09-11 21:56:50 +01:00
Mark Vieira
4ce661cc48
Bump Elasticsearch version to 9.0.0 (#112570) 2024-09-11 09:40:11 -07:00
Brian Seeders
c47162afca
Add missing hyphen for wolfi immage suffix 2024-09-10 22:42:00 -04:00
Mark Vieira
7e16c9bf08
Remove debug logging 2024-09-06 14:08:37 -07:00
Rene Groeschke
4dee614707
Add chainguard docker image (#112103) 2024-09-06 10:32:42 -07:00
Mark Vieira
24f33e95e8
Ensure rest compatibility tests are run when appropriate (#112526) 2024-09-05 08:22:48 -07:00
Simon Cooper
a36d90cf34
Use CLDR locale provider on JDK 23+ (#110222)
JDK 23 removes the COMPAT locale provider, leaving CLDR as the only option. This commit configures Elasticsearch
to use the CLDR provider when on JDK 23, but still use the existing COMPAT provider when on JDK 22 and below.

This causes some differences in locale behaviour; this also adapts various tests to still work whether run on COMPAT or CLDR.
2024-09-04 13:42:40 +01:00
Stanislav Malyshev
b2d885c142
Add "CCS" label to validation schema (#112407) 2024-08-30 18:52:43 -06:00
Ryan Ernst
e58644cd6f
Handle spaces in java library path (#106789)
This commit quotes the entire library path in case there are spaces in
any of the paths.
2024-08-31 04:12:39 +10:00
Rene Groeschke
7ddbaa24ec
[Gradle] Simplify Build Scan setup (#112347)
- remove jenkins specific logic
- more simplification on build scan build logic
2024-08-30 14:44:38 +02:00
Ryan Ernst
0aa4758f02
Stop setting java.library.path (#112119)
Native libraries in Java are loaded by calling System.loadLibrary. This
method inspects paths in the java.library.path to find the requested
library. Elasticsearch previously used this to find libsystemd, but now
the only remaining use is to set the additional platform directory in
which Elasticsearch keeps its own native libraries.

One issue with setting java.library.path is that its not set for the cli
process, which makes loading the native library infrastructure from clis
difficult. This commit reworks how Elasticsearch native libraries are
found in order to avoid needing to set java.library.path. There are two
cases. The simplest is production, where the working directory is the
Elasticsearch installation directory, so the platform specific directory
can be constructed. The second case is for tests where we don't have an
installtion. We already pass in java.library.path there, so this change
renames the system property to be a test specific property that the new
loading infrastructure looks for.
2024-08-23 11:16:18 -07:00
Rene Groeschke
fb6c5a55dd
Update Gradle wrapper to 8.10 (#111736) 2024-08-22 12:15:22 +02:00
Rene Groeschke
fcc5d37dcf
[Gradle] Add buildkite ci validation script for configuration cache (#110269)
We see gradle cache incompatibilities sneaking into our code base. Until
we can enable this feature by default we should regular run checks
existing configuration cache achievements are not degrading.

This change includes: - updating spotless gradle plugin to configuration
cache compatible version (its still BETA but imo good enough for our
needs)
2024-08-08 03:33:29 +10:00
Rene Groeschke
741224f244
[Gradle] fix esql compile cacheability (#111651)
- We use a JvmCommandlineprovider to reference the generated source folder and keep gradle cache happy
2024-08-07 09:00:12 +02:00
Rene Groeschke
dd85857558
Fix potential bug in EmbeddedProviderPlugin (#111592)
Ocassionally we see a LISTING.TXT not included in the jar. The cause
seems a timing issue with sync task were target root folder is same
folder as folder containing listing.txt.
2024-08-06 01:48:42 +10:00
Simon Cooper
1329dc333d
Add release version to setCompatibleVersions task (#111489)
The release version is used to determine if it actually needs to update the CCS version or not
2024-08-01 14:33:33 +01:00
Rene Groeschke
1a52716345
Use bundled jdk as default runtime jdk instead of build jvm (#111197)
* Fallback to bundled jdk for runtime jdk instead of build jvm
* Rework bundled jdk resolution to be lazy
* Use fixed runtime jdk for gradle build integ tests
2024-07-31 16:06:27 +02:00
David Turner
3b61cbfbe5
Add support for Azure Managed Identity (#111344)
With this commit, if no key or SAS token is supplied for an Azure
repository then Elasticsearch will use the `DefaultAzureCredential`
chain defined in the Azure SDK, which will obtain credentials from the
instance metadata service when running on an Azure VM.
2024-07-30 08:33:25 +01:00
Rene Groeschke
dd4b410bc0
[Gradle] Remove default Environment variables setup for LoggedExec tasks (#110375)
We do not implicitly rely on all different kind of env variables when leveraging Gradle Configuration Cache
this makes reusing config cache more reliable and improves cache hits

* configure default env variables for logged exec task
* Fix antfixturestop constructor
* Make LoggedExec cc compatible (fix integtests)
* Fix spotless
2024-07-23 15:25:07 +02:00
Ryan Ernst
c7abdbc299
Allow runtime java to match adoptium jdks (#111117)
This commit relaxes the toolchain specification when runtime.java is set
to allow the adoptium toolchain resolver to match the jdk. Before this
only the oracle toolchain resolvers could match. It also removes LTS
releases from the archived oracle resolver since those are not EOL.
2024-07-20 09:11:50 +10:00
Ryan Ernst
589a4fa926
Add Java 21 to archive toolchain resolver (#111112)
Since the bundled JDK is now Java 22, the archive resolver needs to
support resolving Java 21. This commit updates the resolver to know
which version of Java 21 to download.
2024-07-19 12:21:49 -07:00
Rene Groeschke
cb0ecb86df
Update Gradle wrapper to 8.9 (#110109) 2024-07-19 13:42:33 +02:00
Benjamin Trent
14bce355e5
Actually deprecate edge_ngram side parameter (#110829)
this parameter has been "deprecated" for a while, but no action was
actually taken. This actually deprecates the value for future removal.
2024-07-17 03:51:27 +10:00
Mark Vieira
fa8b5375c2
Add runtime classpath as input to ThirdPartyAuditTask (#110882)
The runtime classpath of `ThirdPartyAuditTask` was not being tracked as
an input which can cause issues with task output caching and build
avoidance.
2024-07-16 03:34:51 +10:00
Rene Groeschke
384b6a9956
[Gradle] Replace deprecated build scan api usage (#110783)
We updated to use develocity plugin a while ago but still used
a deprecated api in the build complete logic we have running on ci
2024-07-12 09:55:54 +02:00
Ryan Ernst
8417d3f141
Move preallocate functionality to native access (#110678)
This commit moves the file preallocation functionality into
NativeAccess. The code is basically the same. One small tweak is that
instead of breaking Java access boundaries in order to get an open file
handle, the new code uses posix open directly.

relates #104876
2024-07-11 09:42:44 -07:00
Mark Vieira
3c35fdc0c7
Ensure correct runtime Java is used when it matches build Java (#110730)
Ensures that the value provided by the `runtime.java` system property,
or `RUNTIME_JAVA_HOME` environment variable is respected, even when it
is the same as the current `JAVA_HOME`. The previous logic had
`isRuntimeJavaHomeSet` return `false` when the "requested" Java was the
same as the current one. This isn't strictly correct, as the behavior
when Java home is unset is to use the bundled JDK. The result was that
passing `-Druntime.java=17` when the Gradle daemon was also using Java
17 was to execute tests with the bundled JDK, which could be something
entirely different.
2024-07-11 06:18:25 +10:00
Chris Hegarty
af779d68a2
Upgrade to JMH 1.37 (#110580)
This commit upgrades to JMH 1.37. There are some fixes for Mac that allow easier running of profilers, etc.
2024-07-09 08:59:28 +01:00
Ryan Ernst
27b177938f
Update JDK23 to build 24 (#110549) 2024-07-05 14:32:21 -07:00
elasticsearchmachine
c5eb558371 Bump to version 8.16.0 2024-07-04 09:10:43 +00:00
Rene Groeschke
f3cad241ae
[Gradle] Cleanup build libs vesion catalogue and its usage (#110298)
* [Gradle] Cleanup build libs vesion catalogue and its usage

* Snake yaml version in version.properties still used
2024-07-01 13:57:05 +02:00