Commit graph

44 commits

Author SHA1 Message Date
Niels Bauman
1e9db8b248
Make ILM operation mode APIs project-aware (#129678)
Also updates the lifecycle service.
2025-06-26 22:44:38 +10:00
Niels Bauman
bc515c4070
Make IndexLifecycleService project-aware (#129932)
Updates the background service of ILM to process all projects in the
cluster.
2025-06-25 10:38:15 -03:00
Niels Bauman
73d2e30c39
Clean up x-pack multi-project YAML test mutes (#129965) 2025-06-25 11:04:16 +10:00
Luigi Dell'Aquila
8db3ee43ff
ES|QL: Split JOIN yaml tests so that non-alias queries run also on bwc (#128884) 2025-06-04 15:22:47 +02:00
Niels Bauman
99f67fae8f
Bump the MP x-pack YAML test suite timeout to 60m (#127699)
After the `IndexTemplateRegistry` was made project-aware in #126986,
we were seeing timeouts of the MP version of the x-pack YAML test suite.
The original version has a timeout of 60 minutes but the MP-version
still had a timeout of 30 minutes. We've gotten away with that
difference because there are still tests on the blacklist for the MP
version, but now that we're making more and more features project-aware,
we need to align the timeout.

Fixes #127433
2025-05-06 15:33:35 +02:00
Niels Bauman
483a9aee95
Allow REST tests to run in MP mode (#126906)
Mainly moves project setup from `MultipleProjectsClientYamlSuiteTestCase` to
`ESRestTestCase`. This allows both Java REST tests and YAML tests to be run
in MP mode by passing the system property `-Dtests.multi_project.enabled=true`.
Future work will add the required gradle changes to be able to run any REST test in
MP mode more easily.
2025-05-05 14:07:08 +02:00
Niels Bauman
ff1c9b7c6c
Make IndexTemplateRegistry project-aware (#126986)
Ensures the `IndexTemplatesRegistry` installs resources in every project
in the cluster.

ES-10055
2025-04-24 12:22:18 +02:00
James Baiera
7b89f4d4a6
Add ability to redirect ingestion failures on data streams to a failure store (#126973)
Removes the feature flags and guards that prevent the new failure store functionality 
from operating in production runtimes.
2025-04-18 16:33:03 -04:00
Pete Gillin
f9b29efc24
Multi-project for TransportExlainLifecycleAction (#126414)
This converts this class to support multi-project.

There is a drive-by refactoring to split multiple independent tests in one method into separate methods. (Look at this change with whitespace changes hidden to see the 'real' change.)
2025-04-08 14:23:35 +01:00
Alexey Ivanov
fd7efe587e
[main] Move system indices migration to migrate plugin (#125437)
* [main] Move system indices migration to migrate plugin

It seems the best way to fix #122949 is to use existing data stream reindex API. However, this API is located in the migrate x-pack plugin. This commit moves the system indices migration logic (REST handlers, transport actions, and task) to the migrate plugin.

Port of #123551

* [CI] Auto commit changes from spotless

* Fix compilation

* Fix tests

* Fix test

---------

Co-authored-by: elasticsearchmachine <infra-root+elasticsearchmachine@elastic.co>
2025-04-04 18:49:38 +01:00
Sam Xiao
b6c6db9861
Add multi-project support for health indicator data_stream_lifecycle (#126056) 2025-04-03 16:26:22 -04:00
Sam Xiao
bddc14c232
Add multi-project support for health indicator shards_availability (#125512) 2025-03-31 11:12:52 -04:00
Rene Groeschke
ae569def9c
[Build] Require reason for usesDefaultDistribution (#124707)
This makes using usesDefaultDistribution in our test setup for explicit by requiring a reason why it's needed.
This is helpful as part of revisiting the need for all those usages in our code base.
2025-03-17 08:25:39 +01:00
Niels Bauman
20e186a252
Make enrich project-aware (#124099)
Makes the execution and use of enrich policies project-aware.
Note: this does not make the enrich cache project-aware. That is to be
handled in a follow-up PR.
2025-03-06 19:20:46 +01:00
Niels Bauman
2a7eb6e117
Make downsampling project-aware (#124000)
Allows downsampling to work on multiple projects.
2025-03-06 12:55:04 +01:00
Rene Groeschke
496c38e5a5
Reapply "Update Gradle wrapper to 8.13 (#122421)" (#123889) (#123896)
This reverts commit 36660f2e5f.
2025-03-05 08:02:13 +01:00
Rene Groeschke
36660f2e5f
Revert "Update Gradle wrapper to 8.13 (#122421)" (#123889)
This reverts commit e19b2264af.
2025-03-03 15:51:07 +01:00
Rene Groeschke
e19b2264af
Update Gradle wrapper to 8.13 (#122421)
* Fix Gradle Deprecation warning as declaring an is- property with a Boolean type has been deprecated.
* Make use of new layout.settingsFolder api to address some cross project references
* Fix buildParams snapshot check for multiprojet projects
2025-03-03 14:10:00 +01:00
Tim Vernum
d6d56e1b43 Add test prefix to multi_project setting (MP-1960)
This changes the `multi_project.enabled` setting to
`test.multi_project.enabled`
2025-02-25 09:51:29 +11:00
Niels Bauman
b23b6b6103 Mute esql data stream lookup MP YAML tests 2025-02-24 18:55:36 +01:00
Niels Bauman
a9f157cf79 Unmute set_security_user processor tests (MP-1943) 2025-02-05 15:27:50 +10:00
Niels Bauman
bac1b7bfc8 Mute ESQL downsample test for MP 2025-02-04 17:27:04 +10:00
Niels Bauman
b6629659be Mute new ESQL tests for MP 2025-01-24 16:54:28 +10:00
Niels Bauman
d399f94f77 Mute migrate YAML tests for multi-project 2025-01-23 14:38:16 +10:00
Simon Cooper
49ceed728c Add required test mutes for blocks 2025-01-22 13:34:59 +00:00
Niels Bauman
3e65cdcab9 Unmute various multi-project YAML tests (MP-1927)
These tests are already passing.
2025-01-22 08:07:10 +10:00
Simon Cooper
f6d703d221 Mute new tests just added 2025-01-09 14:53:03 +00:00
Tim Vernum
7ca8dcd7b4 Enable muted authz tests (MP-1893)
Enable a number of muted "security/authz" tests that now work
2025-01-08 08:28:45 +00:00
Niels Bauman
ee79f1e037 Mute ESQL tests that fail with multiple projects 2024-12-19 11:07:50 +01:00
Yang Wang
516f55da5f Mute new yaml tests that do not work with multi-project 2024-12-13 13:14:48 +11:00
Tim Vernum
64e999f4b6 Mute broken test on MP 2024-12-11 17:54:54 +11:00
Niels Bauman
33f48b728f Merge main into multi-project 2024-12-10 05:23:29 +00:00
Tim Vernum
fff5ca2048 Make async search project aware (MP-1823)
This updates `CoordinatorRewriteContextProvider` to use `ProjectState`
(instead of `ClusterState`) and enables the async_search YAML tests
2024-11-28 01:45:40 +00:00
Tim Vernum
3f07b1b07a Fix SearchShards to be project aware (MP-1822)
This fixes 1 remaining place in `TransportSearchShardsAction` that
relied on the default project.

This change allows a lot of ES|QL tests to pass
2024-11-27 20:08:42 +11:00
Tim Vernum
a65f1443bb Cleanup XPack YAML exclusions (MP-1811)
This cleans up the exclusion list for
`xpack-rest-tests-with-multiple-projects` to enable some working tests
and be more explicit about which tests are disabled.
2024-11-27 03:46:56 +00:00
Niels Bauman
49f3f549b2 Make ILM CRUD APIs (properly) project aware (MP-1802)
The PUT and DELETE APIs were already project aware, but pushed the
project resolver into the cluster state update task. This commit pushes
the project id down instead - which is consistent with other actions
that have been made project aware.

Additionally, this commit makes the GET ILM policy project aware and it
includes ILM's YAML REST tests in the multi-project test suite.
2024-11-26 16:07:02 +00:00
Yang Wang
4a120ccb96 [Test] More precise matching for muted YAML tests (MP-1807)
The PR makes all patterns for muted YAML tests to start matching from
the beginning to avoid accidentally muting unrelated tests.
2024-11-25 07:07:36 +00:00
Yang Wang
1b0abf9d11 New setting for enabling multi-project (MP-1800)
This PR introduces a new setting to enable the multi-project feature.
Default to false.
2024-11-23 07:33:41 +11:00
Tim Vernum
813c1bde3f Enable various security YAML tests (MP-1792)
This unmutes a number of security-related YAML tests that correctly
function now that we have merged the following PRs

- MP-1752
- MP-1755
- MP-1764 
- MP-1771
- MP-1772
- MP-1775
- MP-1782
2024-11-22 10:44:20 +11:00
Niels Bauman
0edb9fa778 Merge remote-tracking branch 'public/main' into merge-main
# Conflicts:
#	server/src/main/java/org/elasticsearch/action/search/TransportSearchShardsAction.java
#	server/src/main/java/org/elasticsearch/cluster/routing/allocation/AllocationStatsService.java
#	server/src/main/java/org/elasticsearch/gateway/GatewayMetaState.java
#	server/src/main/java/org/elasticsearch/plugins/Plugin.java
#	server/src/test/java/org/elasticsearch/gateway/GatewayMetaStateTests.java
#	server/src/test/java/org/elasticsearch/ingest/IngestMetadataTests.java
2024-11-18 10:53:12 +01:00
Tim Vernum
de9a4b5995 Skip logsdb yaml tests 2024-11-04 16:59:54 +11:00
Tim Vernum
a89cb7b161 Use routing table to check project setup in tests (MP-1740)
In the multi-project yaml rest tests, switch to using the routing table
(from cluster state, see MP-1695) to determine that the projects have been
correctly created and configured in the test client.
2024-10-29 15:29:46 +11:00
Tim Vernum
8c390d4eae Common base class for multi-project YAML tests (MP-1736)
Extract a common base class for running YAML rest tests against core and
x-pack
2024-10-29 12:40:46 +11:00
Tim Vernum
c174706975 Run X-Pack YAML tests on Multi Project (MP-1731)
This runs the X-Pack YAML test suite against a cluster with multiple
projects
2024-10-28 23:20:10 +11:00