Commit graph

384 commits

Author SHA1 Message Date
Niels Bauman
ff1c9b7c6c
Make IndexTemplateRegistry project-aware (#126986)
Ensures the `IndexTemplatesRegistry` installs resources in every project
in the cluster.

ES-10055
2025-04-24 12:22:18 +02:00
Ryan Ernst
991e80d56e
Remove unnecessary generic params from action classes (#126364)
Transport actions have associated request and response classes. However,
the base type restrictions are not necessary to duplicate when creating
a map of transport actions. Relatedly, the ActionHandler class doesn't
actually need strongly typed action type and classes since they are lost
when shoved into the node client map. This commit removes these type
restrictions and generic parameters.
2025-04-07 16:22:56 -07:00
Mark Vieira
cdb6230329
Fix enterprise search yaml rest compatibility test 2025-03-28 15:38:42 -07:00
Mark Vieira
3ac0c136aa
Convert enterprise search module to new testing framework (#125807) 2025-03-28 09:07:00 -07:00
Kathleen DeRusso
00c8ad87c7
Add rule retriever yaml test with empty indices (#125161)
* Add rule retriever yaml test with empty indices

* Add more specificity to NodeFeature name
2025-03-19 18:12:20 +02:00
Armin Braun
4c1c51e870
Remove remoteAddress field from TransportResponse (#120016)
This field is only used (by security) for requests, having it in responses is redundant.
Also, we have a couple of responses that are singletons/quasi-enums where setting the value
needlessly might introduce some strange contention even though it's a plain store.

This isn't just a cosmetic change. It makes it clear at compile time that each response instance
is exclusively defined by the bytes that it is read from. This makes it easier to reason about the
validity of suggested optimizations like https://github.com/elastic/elasticsearch/pull/120010
2025-03-16 19:54:29 +01:00
Mridula
44a3ac444f
Removed logger and also fixed the nitpick comments (#124650) 2025-03-12 18:33:03 +01:00
Mridula
f6538e86e2
Prevent Query Rule Creation with Invalid Numeric Match Criteria (#122823)
* SEARCH-802 - bug fixed - Query rules allows for creation of rules with invalid match criteria

* [CI] Auto commit changes from spotless

* Worked on the comments given in the PR

* [CI] Auto commit changes from spotless

* Fixed Integration tests

* [CI] Auto commit changes from spotless

* Made changes from the PR

* Update docs/changelog/122823.yaml

* [CI] Auto commit changes from spotless

* Fixed the duplicate code issue in queryRuleTests

* Refactored code to clean it up based on PR comments

* [CI] Auto commit changes from spotless

* Logger statements were removed

* Cleaned up the QueryRule tests

* [CI] Auto commit changes from spotless

* Update x-pack/plugin/ent-search/src/test/java/org/elasticsearch/xpack/application/EnterpriseSearchModuleTestUtils.java

Co-authored-by: Mike Pellegrini <mike.pellegrini@elastic.co>

* [CI] Auto commit changes from spotless

---------

Co-authored-by: elasticsearchmachine <infra-root+elasticsearchmachine@elastic.co>
Co-authored-by: Kathleen DeRusso <kathleen.derusso@elastic.co>
Co-authored-by: Mike Pellegrini <mike.pellegrini@elastic.co>
2025-03-12 13:56:13 +01:00
Arpad Kiraly
8da3beaee6
Remove @UpdateForV9 annotation in FullClusterRestartIT.java (#124474)
* Remove @UpdateForV9 annotation in FullClusterRestartIT.java

* Remove UpdateForV9 import from FullClusterRestartIT.java
2025-03-11 12:59:36 +01:00
Armin Braun
a40c6da0d8
Cleanup dead code in o.e.search and o.e.a.search (#124445)
Just some obvious cleanups for stuff that became unused as of late.
2025-03-10 09:11:15 +01:00
Simon Cooper
22a7b5ea12
Collapse transport versions for 8.17.0 (#124005) 2025-03-05 15:18:01 +00:00
Simon Cooper
3b323dc588
Collapse 8.16.1 transport versions (#124003) 2025-03-05 12:29:29 +00:00
David Turner
77a3d30d26
Remove trappy timeouts from IndicesAliasesRequest (#123987)
Relates #107984
2025-03-05 02:11:50 +11:00
Ioana Tagirta
5011a473ce
Query rules: Check if MGET request failed when we retrieve query rules (#123616) 2025-03-03 19:21:32 +01:00
Niels Bauman
afff39ed5c
Run XPack usage actions on local node (#122933)
These actions solely need the cluster state, they can run on any node.

Relates #101805
2025-03-03 13:37:27 +01:00
Tim Vernum
f7e80e7fd2
Merge branch 'main' into feature/multi-project 2025-02-27 12:09:08 +11:00
Efe Gürkan YALAMAN
b86c44c260
Add UpdateForV10 annotations for Behavioral Analytics APIs (#123393)
* Add UpdateForV10 annotations for Behavioral Analytics APIs

* Update docs/changelog/123393.yaml

* [CI] Auto commit changes from spotless

* Delete docs/changelog/123393.yaml

---------

Co-authored-by: elasticsearchmachine <infra-root+elasticsearchmachine@elastic.co>
2025-02-26 14:57:39 +01:00
Tim Vernum
597ab8a7e9 Merge branch 'main' into multi-project 2025-02-26 17:57:01 +11:00
Kathleen DeRusso
ae6474db63
Deprecate Behavioral Analytics CRUD apis (#122960)
* Deprecate Behavioral Analytics CRUD APIs

* Add allowed warning for REST Compatibility tests

* Update docs/changelog/122960.yaml

* Update changelog

* Update docs to add deprecation flags and fix failing tests

* Update changelog

* Update changelog again

* Update docs formatting

Co-authored-by: Liam Thompson <32779855+leemthompo@users.noreply.github.com>

* Skip asciidoc test

---------

Co-authored-by: Efe Gürkan YALAMAN <efeyalaman@gmail.com>
Co-authored-by: Liam Thompson <32779855+leemthompo@users.noreply.github.com>
Co-authored-by: Efe Gürkan YALAMAN <efeguerkan.yalaman@elastic.co>
2025-02-25 16:02:50 +01:00
Tim Vernum
77bf65d9af Merge main into multi-project 2025-02-25 10:33:53 +11:00
David Turner
d007dae1ad
Remove redundant IndexNameExpressionResolver params (#123258)
Follow-up to #120531 to remove all the now-redundant constructor
parameters.
2025-02-25 04:08:31 +11:00
Niels Bauman
621a18d947 Merge main into multi-project 2025-01-30 17:26:28 +10:00
Mark Vieira
61dc93107f
Add lucene version compatibility tests (#121104)
This commit adds compatibility tests that target ES revisions that align with specific Lucene versions. In this case, we are intending to upgrade from Lucene 10.0 to 10.1. Since no on-prem Elasticsearch release exists with 10.0, we need another method to ensure compatibility with Lucene 10.0 indicies.

The work here is a bit hacky since all our compatibility testing infrastructure is centered around versions and we're now effectively doing compatibility tests between two different revisions of Elasticsearch that both report the same version. Ideally this specific testing would be replaced by unit tests, rather that reusing our full cluster restart tests for this purpose.

We'll also want to bump the commit referenced in the CI pipelines here to align with the last commit using Lucene 10.0.
2025-01-29 13:20:25 -08:00
Panagiotis Bailis
375814d007
Adding linear retriever to support weighted sums of sub-retrievers (#120222) 2025-01-28 19:33:12 +02:00
Navarone Feekery
ddb97cc042
Revert "[Search] Add system index descriptors to Connector indices (#118991)" (#120951)
This reverts commit 385e1fdf21.
2025-01-28 08:11:51 +01:00
Navarone Feekery
385e1fdf21
[Search] Add system index descriptors to Connector indices (#118991)
Update the .elastic-connectors and .elastic-connectors-sync-jobs indices into system indices
2025-01-24 13:10:38 +01:00
Panagiotis Bailis
86fbec3cd4
Avoid populating rank docs metadata if explain is not specified (#120536) 2025-01-24 08:25:37 +02:00
Niels Bauman
6495dcbb40 Merge main into multi-project 2025-01-24 15:48:39 +10:00
Ignacio Vera
9a9bc69883
Stop caching source map on SearchHit#getSourceMap (#119888)
This call has the side effect that if you are iterating a number of hits calling this method, you will be increasing the 
memory usage by a non trivial number which in most of cases is unwanted. Therefore this commit removes this caching
all together and add an assertion so the method is call once during the lifetime of the object.
2025-01-23 17:28:52 +01:00
Simon Cooper
569c1fc1cd Merge remote-tracking branch 'upstream-main/main' into merge-main-22-01-25T12 2025-01-22 12:22:36 +00:00
Simon Cooper
39601ed683
Remove IndexNameExpressionResolver from base classes that don't use it (#120531) 2025-01-22 10:17:07 +00:00
Simon Cooper
5a70623d8d Merge remote-tracking branch 'upstream-main/main' into merge-main-16-01-25 2025-01-16 09:23:46 +00:00
Jedr Blaszyk
0317c1ce36
[Connector API] Support hard deletes with new URL param in delete endpoint (#120200)
* [Connector API] Add hard delete support

* Undo accidental change

* undo accidental build gradle change

* Tweak typos

* Update docs/changelog/120200.yaml

* [CI] Auto commit changes from spotless

* Fix yaml test

* Actually skip the feature check since we don't have the feature anyway

---------

Co-authored-by: elasticsearchmachine <infra-root+elasticsearchmachine@elastic.co>
2025-01-16 09:45:10 +01:00
Simon Cooper
ca4ea21fb3
Remove assumed features in xpack for 9.0 (#120049)
Remove all assumed features defined in xpack added before 8.18
2025-01-15 11:06:30 +00:00
Simon Cooper
a2d84b1b90
Remove assumed features in server for 9.0 (#119946)
All features added before 8.18 can now be assumed and removed in 9.0
2025-01-15 08:37:04 +00:00
Simon Cooper
b0cd47de08 Merge remote-tracking branch 'upstream-main/main' into merge-main-10-01-25T17 2025-01-10 17:00:07 +00:00
Jedr Blaszyk
79713f5e99
Restrict Connector APIs to manage/monitor_connector privileges (#119863)
* Reapply "Restrict Connector APIs to manage/monitor_connector privileges (#119389)" (#119833)

This reverts commit e0cefb8ff0.

* Update docs/changelog/119863.yaml

* Update docs/changelog/119863.yaml

* Update changelog

* Fix changelog

---------

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2025-01-10 11:30:44 +01:00
Niels Bauman
83acbcb36b Merge main into multi-project 2025-01-10 15:08:22 +10:00
Niels Bauman
48b9faeb92
Fix trappy timeouts in GetAliasesRequest (#119817)
Removes the use of the trappy default master node timeout and configures
a sensible default instead.
2025-01-10 08:59:42 +10:00
Simon Cooper
75d1050781
Mark all features added before 8.18 as assumed (#119055)
Features added before 8.18 can be removed, starting with 9.0. But first they need to be marked as assumed, so existing code knows they could be removed in later builds.
2025-01-09 16:59:25 +00:00
Simon Cooper
2e04ed09a9 Merge remote-tracking branch 'upstream-main/main' into merge-main-9-1-25 2025-01-09 16:09:21 +00:00
Jedr Blaszyk
750a0ab846
[Connector API] Support soft-deletes of connectors (#118669)
* [Connector API] Add interface for soft-deletes

* Define connector deleted system index

* Got soft-delete logic working

* Add unit tests

* Add yaml e2e test and attempt to update permissions

* Fix permissions

* Update docs

* Fix docs

* Update docs/changelog/118282.yaml

* Change logic

* Fix tests

* Remove unnecessary privilege from yaml rest test

* Update changelog

* Update docs/changelog/118669.yaml

* Adapt yaml tests

* Undo changes to muted-tests.yml

* Fix compilation issue after other PR got merged

* Exclude soft-deleted connector from checks about index_name already in use

* Update docs/reference/connector/apis/get-connector-api.asciidoc

Co-authored-by: Tim Grein <tim@4greins.de>

* Update rest-api-spec/src/main/resources/rest-api-spec/api/connector.list.json

Co-authored-by: Tim Grein <tim@4greins.de>

* Adapt comments, add connector wire serializing test

* Introduce new transport versions for passing the delete flag

* Get rid of wire serialisation, use include_deleted instead of deleted flag

* Remove unused import

* Final tweaks

* Adapt variable name in rest layer

---------

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
Co-authored-by: Tim Grein <tim@4greins.de>
2025-01-09 12:20:28 +00:00
Jedr Blaszyk
e0cefb8ff0
Revert "Restrict Connector APIs to manage/monitor_connector privileges (#119389)" (#119833)
This reverts commit c88eef308c.
2025-01-09 10:02:51 +00:00
Tim Vernum
280fcb1a57 Merge main into multi-project 2025-01-09 19:39:24 +11:00
James Baiera
c3839e1f76
Add selector syntax to index expressions (#118614)
This PR introduces a new syntactical feature to index expression resolution: The selector.

Selectors, denoted with a :: followed by a recognized suffix will allow users to specify which component of 
an index abstraction they would like to operate on within an API call. In this case, an index abstraction is a 
concrete index, data stream, or alias; Any abstraction that can be resolved to a set of indices/shards. We 
define a component of an index abstraction to be some searchable unit of the index abstraction.
2025-01-08 11:37:03 -05:00
Jedr Blaszyk
c88eef308c
Restrict Connector APIs to manage/monitor_connector privileges (#119389)
* [Connector API] Use monitor/manage_connector privilege

* Update docs/changelog/119389.yaml

* Remove index-level permissions from sync job actions

* Don't keep client in class instance variable

---------

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2025-01-08 09:59:26 +01:00
Tim Vernum
4ff691f066 Merge revision 7fb6ca447a into multi-project 2024-12-31 15:41:02 +11:00
Rene Groeschke
ba61f8c7f7
Update Gradle wrapper to 8.12 (#118683)
This updates the gradle wrapper to 8.12

We addressed deprecation warnings due to the update that includes:

- Fix change in TestOutputEvent api
- Fix deprecation in groovy syntax
- Use latest ospackage plugin containing our fix
- Remove project usages at execution time
- Fix deprecated project references in repository-old-versions
2024-12-30 15:34:24 +01:00
Armin Braun
e94f145350
Fix a bunch of non-final static fields (#119185)
Fixing almost all missing `final` spots, who knows maybe we get a small speedup from
some constant folding here and there.
2024-12-26 19:14:36 +01:00
Yang Wang
f7791a0f5f Merge main into multi-project 2024-12-19 14:36:37 +11:00