Commit graph

3250 commits

Author SHA1 Message Date
Mark Vieira
0009de3575
Upgrade Bouncy Castle FIPS dependencies (#112989) (#119614)
This PR updates `bc-fips` and `bctls-fips` dependencies to the latest
minor versions.

(cherry picked from commit 6ea3e01958)

Co-authored-by: Slobodan Adamović <slobodanadamovic@users.noreply.github.com>
2025-01-07 08:03:17 +11:00
Rene Groeschke
4d17b2193a
Update Gradle wrapper to 8.12 (#118683) (#119357)
This updates the gradle wrapper to 8.12

We addressed deprecation warnings due to the update that includes:

- Fix change in TestOutputEvent api
- Fix deprecation in groovy syntax
- Use latest ospackage plugin containing our fix
- Remove project usages at execution time
- Fix deprecated project references in repository-old-versions

(cherry picked from commit ba61f8c7f7)

# Conflicts:
#	build-tools-internal/src/main/java/org/elasticsearch/gradle/internal/distribution/DockerCloudElasticsearchDistributionType.java
#	build-tools-internal/src/main/java/org/elasticsearch/gradle/internal/distribution/DockerUbiElasticsearchDistributionType.java
#	build-tools-internal/src/main/java/org/elasticsearch/gradle/internal/test/Fixture.java
#	plugins/repository-hdfs/hadoop-client-api/build.gradle
#	server/src/main/java/org/elasticsearch/inference/ChunkingOptions.java
#	x-pack/plugin/kql/build.gradle
#	x-pack/plugin/migrate/build.gradle
#	x-pack/plugin/security/qa/security-basic/build.gradle
2024-12-31 08:37:28 +01:00
Rene Groeschke
f75095c7ef
[Build] Make test cluster plugin configuration cache compatible (#116890) (#119367)
This adds infrastructure to make the legacy test cluster plugin and
the legacy test cluster based test plugins generally configuration cache compatible.

(cherry picked from commit 8c20ac5884)

# Conflicts:
#	qa/mixed-cluster/build.gradle
2024-12-31 06:04:16 +11:00
Rene Groeschke
581b9ab7c0
[8.16] [Gradle] Remove static use of BuildParams (#115122) (#117434)
* [Gradle] Remove static use of BuildParams (#115122)

Static fields dont do well in Gradle with configuration cache enabled.

- Use buildParams extension in build scripts
- Keep BuildParams.ci for now for easy serverless migration
-  Tweak testing doc

(cherry picked from commit 13c8aaeffa)

# Conflicts:
#	TESTING.asciidoc
#	build-tools-internal/src/main/java/org/elasticsearch/gradle/internal/InternalDistributionBwcSetupPlugin.java
#	build-tools-internal/src/main/java/org/elasticsearch/gradle/internal/test/rest/RestTestBasePlugin.java
#	build-tools-internal/src/main/java/org/elasticsearch/gradle/internal/test/rest/compat/compat/AbstractYamlRestCompatTestPlugin.java
#	build.gradle
#	modules/ingest-geoip/qa/full-cluster-restart/build.gradle
#	qa/mixed-cluster/build.gradle
#	x-pack/plugin/ent-search/qa/full-cluster-restart/build.gradle
#	x-pack/plugin/eql/qa/rest/build.gradle
#	x-pack/plugin/fleet/qa/rest/build.gradle
#	x-pack/plugin/kql/build.gradle
#	x-pack/plugin/mapper-unsigned-long/build.gradle
#	x-pack/plugin/ml/qa/multi-cluster-tests-with-security/build.gradle
#	x-pack/plugin/security/qa/multi-cluster/build.gradle
#	x-pack/plugin/sql/qa/jdbc/build.gradle
#	x-pack/plugin/transform/qa/multi-cluster-tests-with-security/build.gradle

* Fix merge

* [Build] Fix fips testing after buildparams rework (#116934)

* More Cleanup

* [Build] Fix checkstyle exclusions on windows (#115185)

* More merge fixes

* Delete x-pack/plugin/kql/build.gradle
2024-11-27 12:34:32 +01:00
Rene Groeschke
e50a2670e1
[Build] Reapply updating to Gradle 8.11.1 (#117394) (#117429)
This reverts commit b5c6d927c1.
* Simplify and fix dynamic project dependency handling

(cherry picked from commit d2b3dc51d1)
2024-11-25 02:29:31 +11:00
Rene Groeschke
68337ff66e
[Gradle] Update shadow plugin (#116826) (#116877)
- The shadow plugin has changed ownership and plugin id.
- Make some formatting of poms more reproducible

(cherry picked from commit def490ef85)
2024-11-16 15:06:35 +01:00
Mark Vieira
396e45f0dd
Upgrade develocity plugin (#115139) (#115149) 2024-10-19 09:19:35 +11:00
David Turner
c13fa515ad
Flush response stream in EC2RetriesTests (#114115) (#114120)
This is apparently necessary when running with JDK23.

Relates #114101 Closes #114078
2024-10-04 22:21:10 +10:00
David Turner
821212f93c
Flush response stream in Ec2DiscoveryTests (#114101) (#114112)
This is apparently necessary when running with JDK23. Also cleans up
some warnings in the same test suite.

Closes #114088
Closes #114089
Closes #114090
2024-10-04 21:16:13 +10:00
Benjamin Trent
da102fcc7d
[8.x] Add assertWarnings capabilities to base token stream test case (#113619) (#113688)
* Add assertWarnings capabilities to base token stream test case (#113619)

We need to be able to assert various warnings and check for such in
typical token stream tests. This adds that capability.

* fixing test

---------

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2024-10-01 23:49:30 +10:00
Rene Groeschke
339d4e462b
Update Gradle wrapper to 8.10.2 (#113603) (#113719)
Update Gradle wrapper to 8.10.2
2024-09-28 06:03:48 +10:00
john-wagster
e19a9760a9
Deduplicate Nori and Kuromoji User Dictionary (#112768) (#113401)
added the ability to deduplicate the user dictionary optionally
2024-09-24 02:43:42 +10:00
Rene Groeschke
28f8803444
Update Gradle wrapper to 8.10.1 (#112948) (#113205) 2024-09-20 04:27:56 +10:00
Mark Vieira
0279c0a909
Add AGPLv3 as a supported license 2024-09-13 14:30:33 -07:00
Kostas Krikellas
9d91867e45
Fix synthetic source field names for multi-fields (#112850) (#112871)
* Fix synthetic source field names for multi-fields

* enable logsdb in randomized tests

* Revert "enable logsdb in randomized tests"

This reverts commit 2e2c22e2bb.

* Update docs/changelog/112850.yaml

* fix

(cherry picked from commit 86a88d735f)
2024-09-14 00:52:58 +10:00
Oleksandr Kolomiiets
082e7211b3
Use fallback synthetic source for copy_to and doc_values: false cases (#112294) 2024-09-10 12:12:51 -07:00
David Turner
8f07d60c2c
Fix trappy timeouts in o.e.a.a.cluster.* (#112674)
Removes all usages of `TRAPPY_IMPLICIT_DEFAULT_MASTER_NODE_TIMEOUT` in
cluster-related APIs in `:server`.

Relates #107984
2024-09-10 08:17:09 +01:00
Sam Xiao
52bb54b7dc
Comment: Correct plugin examples comment (#112609)
Minor change to correct the comment for running YAML test in plugin examples.
2024-09-06 14:43:19 -04:00
Sam Xiao
7cd6de76f4
Adds example plugin for custom ingest processor (#112282)
* Adds example plugin for custom ingest processor

Adds an example for creating a plugin with a simple custom ingest
processor. The example processor repeats the value of an expected filed
in a document, or ignores it if the expected field does not exist.

Closes #111539
2024-09-06 12:05:52 -04:00
Kostas Krikellas
f3bc281978
Refactor build params for FieldMapper, adding SourceKeepMode (#112455)
* Refactor build params for FieldMapper

* more mappers and tests

* more mappers

* more mappers

* spotless

* spotless

* stored by default

* Revert "stored by default"

This reverts commit bbd247d64b.

* restore storeIgnored

* sync

* list valid values for SourceKeepMode

* small refactoring

* spotless
2024-09-06 14:16:17 +03:00
Joe Gallo
9b2bad3949
Update the gradlew stuff in plugins/examples (#112517) 2024-09-04 11:27:17 -04:00
Ryan Ernst
b000271885
Update expert script example with termStats (#112377)
This commit fixes compilation of the expert script example to implement
the new required method of score script making termStats available.
2024-08-30 10:11:24 -07:00
Oleksandr Kolomiiets
38adbb0724
Prevent synthetic field loaders accessing stored fields from using stale data (#112173) 2024-08-27 14:55:00 -07:00
Rene Groeschke
fb6c5a55dd
Update Gradle wrapper to 8.10 (#111736) 2024-08-22 12:15:22 +02:00
john-wagster
5510ad98f8
Updated Function Score Query Test with Explain Fixes for 8.15.1 (#111929)
* updated test for 8.15.1

* Update docs/changelog/111929.yaml

* Delete docs/changelog/111929.yaml
2024-08-16 00:55:52 +10:00
john-wagster
935c0e4e2b
Explain Function Score Query (#111807)
allowing for a custom explanation to be passed through as part of supporting building a plugin with a custom script score; previously threw an npe
2024-08-13 17:03:30 -05:00
Rene Groeschke
cb0ecb86df
Update Gradle wrapper to 8.9 (#110109) 2024-07-19 13:42:33 +02:00
Oleksandr Kolomiiets
349dac284a
Stop iterating over all fields to extract @timestamp value (#110603) 2024-07-11 09:24:53 -07:00
Luca Cavanna
915e4a50c5
Rename Mapper#name to Mapper#fullPath (#110040)
This addresses a long standing TODO that caused quite a few bugs over time, in that the mapper name does not include its full path, while the MappedFieldType name does.

We have renamed Mapper.Builder#name to leafName (#109971) and Mapper#simpleName to leafName (#110030). This commit renames Mapper#name to fullPath for clarity
This required some adjustments in FieldAliasMapper to avoid confusion between the existing path method and fullPath. I renamed path to targetPath for clarity.
ObjectMapper already had a fullPath method that returned name, and was effectively a copy of name, so it could be removed.
2024-06-21 22:47:27 +02:00
Luca Cavanna
54e7b4d93b
Rename Mapper#simpleName to Mapper#leafName (#110030)
This addresses a long standing TODO that caused quite a few bugs over time, in that the mapper name does not include its full path, while
the MappedFieldType name does. We have method called simpleName to signal that, but leafName signals that more clearly and aligns with
the name we have recently introduced in Mapper.Builder (renamed from name to leafName).

Relates to #109971
2024-06-21 14:28:36 +02:00
Luca Cavanna
15c7abe111
Rename Mapper#name to Mapper#leafName (#109971)
This addresses a long standing TODO that caused quite a few bugs over time, in that the mapper name does not include its full path, while
the MappedFieldType name does.
2024-06-21 11:48:17 +02:00
David Turner
5662f988b2
Remove trappy timeouts in snapshot APIs (#109828)
Wholesale fix of every `TRAPPY_IMPLICIT_DEFAULT_MASTER_NODE_TIMEOUT` in
`o.e.snapshots` and `o.e.repositories`, just pulling them up to the REST
layer (where they become API params), the test suite (where they become
`TEST_REQUEST_TIMEOUT`), or some other place where an explicit value is
available.

Relates #107984
2024-06-21 07:11:12 +10:00
Benjamin Trent
29288d6590 Merge remote-tracking branch 'upstream/main' into lucene_snapshot_9_11 2024-06-11 06:54:23 -04:00
Rene Groeschke
02439e321d
Update Gradle gradleEnterprise plugin (develocity now) (#109443)
* Update Gradle gradleEnterprise plugin (develocity now)
* Fix imports in build scan script
* Fix build scan api usage
* Dependency cleanup and API fix
* Fix API update for BuildResult in Build scans
* Fix buildkite buildscan annotations based on gradle failures
2024-06-10 14:26:43 +02:00
Benjamin Trent
cf84416fc5 Merge remote-tracking branch 'upstream/main' into lucene_snapshot_9_11 2024-06-04 12:50:52 -04:00
Rene Groeschke
8ac3e3dd90
Update Gradle wrapper to 8.8 (#108021)
Fix incompatibility with 8.8 and our internal api usages

- Update ospackage to a version that contains a fix we provided
- Tweak build logic to avoid deprecation warnings
- Use newer permission api
- Use custom shadowplugin
- Rework ElasticsearchDistribution dependencies resolution
- Update Gradle wrapper to 8.8
2024-06-04 12:43:02 +02:00
ChrisHegarty
066b8a4d26 Remove awaits fix 2024-05-28 15:16:10 +01:00
ChrisHegarty
12c61e4392 Mute test until Lucene bug is fixed 2024-05-27 16:35:42 +01:00
elasticsearchmachine
325bf47462 Merge remote-tracking branch 'origin/main' into lucene_snapshot 2024-05-22 10:01:47 +00:00
Oleksandr Kolomiiets
91d502cec6
Add generic fallback implementation for synthetic source (#108222)
This PR uses infrastructure from #107567 to implement a fallback implementation of synthetic source for field mappers that don't support it natively. In that case we will store source of such field as is in a separate stored field.
2024-05-21 11:30:30 -07:00
ChrisHegarty
bdcdd2e8b9 Merge branch 'main' into lucene_snapshot 2024-05-07 12:50:34 +01:00
Jake Landis
19e3e732cd
Fix compilation issue for example plugins (#108270) 2024-05-03 16:36:11 -05:00
elasticsearchmachine
2f6283d181 Merge remote-tracking branch 'origin/main' into lucene_snapshot 2024-05-01 10:02:01 +00:00
Oleksandr Kolomiiets
6c82f87074
Add test for docvalue_fields retrieval of murmur3 (#107880) 2024-04-30 08:07:48 -07:00
ChrisHegarty
5596151e18 Merge branch 'main' into lucene_snapshot 2024-04-30 12:04:17 +01:00
eyalkoren
ee262954ee
Adding aggregations support for the _ignored field (#101373)
Enables aggregations on the _ignored metadata field replacing the stored field
with doc values.
2024-04-29 16:41:34 +02:00
elasticsearchmachine
1799b7e426 Merge remote-tracking branch 'origin/main' into lucene_snapshot 2024-04-27 10:02:13 +00:00
Oleksandr Kolomiiets
ca513b1752
Annotated text fields are stored by default with synthetic source (#107922)
This change follows existing implementation for text field.

Closes #107734.
2024-04-26 10:12:17 -07:00
elasticsearchmachine
18361d78c1 Merge remote-tracking branch 'origin/main' into lucene_snapshot 2024-04-26 10:01:26 +00:00
Oleksandr Kolomiiets
e1d902d33b
Implement synthetic source support for annotated text field (#107735)
This PR adds synthetic source support for annotated_text fields. Existing implementation for text is reused including test infrastructure so the majority of the change is moving and making things accessible.

Contributes to #106460, #78744.
2024-04-25 10:31:27 -07:00