Commit graph

61175 commits

Author SHA1 Message Date
Mark Vieira
61d76462ee
[7.17] Make docker packaging test more resilient (#111205) (#111209)
* Make docker packaging test more resilient (#111205)

Wrap check for container shutdown log message in an `assertBusy()` to
deal with race conditions.

Closes #111132
# Conflicts:
#	muted-tests.yml
#	qa/os/src/test/java/org/elasticsearch/packaging/test/DockerTests.java

* Fix compile issue
2024-07-24 05:28:16 +10:00
Rene Groeschke
0d3f9b778d
[7.17] Ignore configs from DistributionDownload plugin and bwc for resolveAllDependencies (#110828) (#110837)
* Ignore configs from DistributionDownload plugin and bwc for resolveAllDependencies (#110828)
skip resolving toolchains
2024-07-23 12:33:57 +02:00
Mark Vieira
aabe0a39ab
Don't run BWC plugin setup tests on Windows (#111166) 2024-07-22 13:59:03 -07:00
Rene Groeschke
0c472ebaa3
Cleanup repository after adding accidental files to PR (#111108) (#111109)
With https://github.com/elastic/elasticsearch/pull/110109 i accidentally added local files to the repo.
This removes them again.
2024-07-20 03:43:40 +10:00
Rene Groeschke
f01427f9ce
Update Gradle wrapper to 8.9 (#110109) (#111097)
(cherry picked from commit cb0ecb86df)
2024-07-19 15:39:44 +02:00
Iraklis Psaroudakis
d7cb6e18f8
Correct force merge disk space requirements (#111066) (#111086)
Correct force merge disk space requirements
2024-07-19 18:56:49 +10:00
Mark Vieira
c364c6017c
Add runtime classpath as input to ThirdPartyAuditTask (#110882) (#110888)
The runtime classpath of `ThirdPartyAuditTask` was not being tracked as
an input which can cause issues with task output caching and build
avoidance.
2024-07-16 04:29:06 +10:00
Rene Groeschke
a51806acca
[7.17] [CI] Do not cache any es distros when creating ci images (#110742) (#110746)
* [CI] Do not cache any es distros when creating ci images (#110742)

(cherry picked from commit 816cedc217)

# Conflicts:
#	qa/os/build.gradle

* Update build.gradle
2024-07-11 16:42:29 +02:00
Benjamin Trent
a9e35d20ce
Fix search template examples by removing params on put (#110660) (#110705) 2024-07-10 22:02:00 +10:00
Rene Groeschke
f1c5807689
[CI] Temporally increase disk space for DRA build jobs (#110601) (#110623)
(cherry picked from commit fbcde9c0fd)
2024-07-09 17:32:59 +10:00
Yang Wang
42b93a5349 [Test] Unmute S3RepositoryThirdPartyTests.testCreateSnapshot
The test failed due to infrastructure issue which seems to disappears
based on the success runs on the main branch.

Relates: #110093
2024-06-27 10:48:24 +10:00
Rene Groeschke
4d9169fa2b
Make Ccs old version remote cluster setup lazy (#110106)
* Rework test cluster setup to be lazy in ccs-old-version-remote-cluster
2024-06-24 22:33:52 +02:00
David Kyle
ccf8734eb2 AwaitsFix: https://github.com/elastic/elasticsearch/issues/110093 2024-06-24 14:22:03 +01:00
shainaraskas
5022d5aa00
(Doc+) Capture Elasticsearch diagnostic (#108259) (#110069)
* (Doc+) Capture Elasticsearch diagnostic

* add diagnostic topic to nav, chunk content, style edits

* fix test

---------

Co-authored-by: shainaraskas <shaina.raskas@elastic.co>
(cherry picked from commit 1a55e2fa76)

Co-authored-by: Stef Nestor <26751266+stefnestor@users.noreply.github.com>
2024-06-22 08:51:20 +10:00
Brian Seeders
34e0a78301
Update intake.yml 2024-06-21 12:12:30 -04:00
Brian Seeders
d2e334ba86
[ci] Bump disk size for agents to 250GB (#109975) (#109977) 2024-06-20 10:47:54 -04:00
Mark Vieira
bb4108eb4c
Install systemd-sysvcompat package on opensuse systems (#109885)
The `systemd-sysv-install` utility is now provided by the
`systemd-sysvcompat` package. Ensure it's installed when running
packaging tests.

Closes #109831
2024-06-19 08:05:38 +10:00
Rene Groeschke
1e0b61419a
[7.17] Update Gradle wrapper to 8.8 (#108021) (#109348)
Fix incompatibility with 8.8 and our internal api usages

- Update ospackage to a version that contains a fix we provided
- Tweak build logic to avoid deprecation warnings
- Use newer permission api
- Use custom shadowplugin
- Rework ElasticsearchDistribution dependencies resolution
- Update Gradle wrapper to 8.8
- Fix one more deprecated permission api usage
- Fix DistroTest dependencies
- Fix permissions in package init.d folder
2024-06-18 16:45:31 +02:00
Tim Vernum
07296d596a
Respect --pass option in certutil csr mode (#109834)
elasticsearch-certutil csr generates a private key and a certificate
signing request (CSR) file. It has always accepted the "--pass" command
line option, but ignore it and always generated an unencrypted private
key.

This commit fixes the utility so the --pass option is respected and the
private key is encrypted.

Backport of: #106105
2024-06-18 14:42:03 +10:00
elasticsearchmachine
de8778823e Mute org.elasticsearch.packaging.test.CertGenCliTests test40RunWithCert #109831 2024-06-18 07:23:33 +10:00
shainaraskas
551011c7ab
[DOCS] Clarify behavior of the generic data node role (#106375) (#109692)
(cherry picked from commit 82d7e4ec93)
2024-06-13 15:05:01 -04:00
shainaraskas
78d60343c1
change from string to array in example (#109263) (#109700)
(cherry picked from commit d12a318304)
2024-06-13 15:04:17 -04:00
elasticsearchmachine
fae0a870be Finalize release notes for v7.17.22 2024-06-14 01:33:56 +10:00
elasticsearchmachine
92d9b7d2c5 Prune changelogs after 7.17.22 release 2024-06-13 15:16:30 +00:00
elasticsearchmachine
10670ce5ad Bump versions after 7.17.22 release 2024-06-13 15:15:24 +00:00
Tim Vernum
4aafcb6136
Extend assertion expiry in SAML auth tests (#109652)
Sometimes buildkite seems to swallow time. This commit extends some of
the authentication/session expiry times to compensate.

Relates: #109299
Backport of: #109607
2024-06-13 10:48:45 +10:00
Tim Vernum
5f6932cd45
Unmute SamlAuthenticatorTests (#109608)
Relates: #109607 Resolves: #109299
2024-06-13 10:44:36 +10:00
Jake Landis
00632845d2
Reintroduce 7.17 Backport for DLS changes (#109494)
* Reapply "[7.17] Backport DLS changes (#108330)" (#109349)

This reverts commit 692a1a2448.

* re-implement excludeDeleteDocs as hack

* Revert "re-implement excludeDeleteDocs as hack"

This reverts commit 6006031692.

* re-implement serialization with metadata

* use correct xContent

* fix unmodifiable exception

* [review comments] use constant and underscore prefix
2024-06-13 09:05:25 +10:00
David Turner
0d006818cd
Avoid port-scan in testThatTransportClientCanConnect (#109590)
300 concurrent connection attempts, each with a 30s timeout, will take
way longer than is reasonable in a test. With this commit we connect
directly to addresses to which we know nodes are bound.
2024-06-12 08:59:42 +01:00
Martijn van Groningen
9021686d2e
Address MappingIT#testMapperDynamicIndexSetting() test failure (#109479)
This is a 7.17 rolling upgrade test.

During upgrade health may be yellow, because due to shard relation on old node the shard can't be allocated due to the bug.
Also ensure each node in the cluster has a copy.

Closes #109455
2024-06-10 09:29:56 +02:00
Mark Vieira
60c36c0fdb AwaitsFix: https://github.com/elastic/elasticsearch/issues/109455 2024-06-06 13:57:08 -07:00
elasticsearchmachine
38e9ca2e81 Mute org.elasticsearch.transport.netty4.Netty4TransportMultiPortIntegrationIT org.elasticsearch.transport.netty4.Netty4TransportMultiPortIntegrationIT #109400 2024-06-06 02:10:18 +10:00
Nhat Nguyen
5e2fac3da5
Add remove index setting command (#109276) (#109328)
The new subcommand elasticsearch-node remove-index-settings can be used
to remove index settings from the cluster state in case where it
contains incompatible index settings that prevent the cluster from
forming. This tool can cause data loss and its use should be your last
resort.

Relates #96075
2024-06-05 02:07:22 +10:00
Jake Landis
692a1a2448
Revert "[7.17] Backport DLS changes (#108330)" (#109349)
This reverts commit 4e08df5 (#108330)
This commit also fixes #109273 in 7.17.
2024-06-04 10:20:58 -05:00
Martijn van Groningen
5d80ef6565
Added known issue section for the index.mapper.dynamic index setting bug. (#109292)
Relates to #109160 and #96075
2024-06-04 18:59:44 +10:00
Martijn van Groningen
da4cec7cb0
Add rolling upgrade test for the index.mapper.dynamic index setting bug. (#109301)
This is for 7.17 branch only. The test in main branch would be a little bit different.


Relates to #109160 and #96075
2024-06-04 09:36:21 +02:00
Jake Landis
4e08df5bda
[7.17] Backport DLS changes (#108330)
This commit introduced stricter DLS rules and is a manual backport of #105709 and #105714 
with additional node level settings to optionally disable the stricter DLS rules. 
Since these settings are not present in 8.x the needed deprecation info API entries have also 
been added to help inform any users that may have set these values to remove them before upgrading.
2024-06-03 10:58:38 -05:00
Max Hniebergall
7fe654b539 AwaitsFix: https://github.com/elastic/elasticsearch/issues/109299 2024-06-03 09:58:52 -04:00
elasticsearchmachine
e2ee2a0dd7
Update docs for v7.17.22 release (#109186) 2024-05-29 14:43:43 -07:00
Ryan Ernst
7ebb32db10
Guard bootstrap plugins loading from detecting plugins cache (#109116)
This commit guards iteration over plugin infos from mistakenly trying to
inspect the plugins cache file as a plugin.

closes #97702
2024-05-29 10:16:44 -07:00
Martijn van Groningen
e4ef0ff0d9
Disable index.mapper.dynamic index setting validation. (#109160)
This setting was removed via #25734, because the setting no longer used
since 6.0.0

However, the validation only kicked when trying to set this setting on a
closed index. Applying the setting on an open index would just work.
With severe consequences later on. For example when upgrading the
cluster, nodes would refuse to boot, because the validation would kick
in.

Relates to #96075
2024-05-29 09:42:28 -04:00
Ryan Ernst
6f20cba5a1
Update bundled JDK to Java 22 (again) (#108654) (#108689)
* Update bundled JDK to Java 22 (again) (#108654)

This commit re-bumps the bundled JDK to Java 22 now that we have
a tested workaround for the G1GC bug
(https://bugs.openjdk.org/browse/JDK-8329528).

relates #108571
relates #106987

* copy main openjdk toolchain resolver

* use 2 lines for workaround

* fix test

* update adoptium test
2024-05-16 10:18:18 -04:00
Simon Cooper
ad03ad6caf
[7.17] Increase interval for task change interval check to prevent stalls failing the test (#94145) (#108667)
Backport #94145 to 7.17
2024-05-15 10:49:55 +01:00
Ryan Ernst
101bebe071
Workaround G1 bug for JDK 22 and 22.0.1 (#108571) (#108631)
See https://bugs.openjdk.org/browse/JDK-8329528. The applied workaround
was suggested on the linked issue, and was tested and confirmed to avoid
the G1 bug.
2024-05-14 12:48:48 -04:00
Albert Zaharovits
b6dad2b7ff
2 @Before methods, not a good idea (#108502)
Fixes IpFilterRemoteAddressFilterTests testThatFilteringWorksByIp. There
were 2 "@ Before"-annotated methods that didn't play well together.

Fixes: #108441
2024-05-13 06:01:22 -04:00
Mark Vieira
572ce11c1b
AwaitsFix #108441 2024-05-09 16:54:27 -07:00
Nick Tindall
2a327b1125
[DOCS] Fix stored_fields parameter description (#98385) (#108445) (#108447)
(referenced from get and multi_get API docs)

Closes #98385
2024-05-09 03:43:07 -04:00
Athena Brown
853958388f AwaitsFix: https://github.com/elastic/elasticsearch/issues/108441 2024-05-08 15:48:30 -06:00
Athena Brown
ad9470b31a
Add note about license to "Restore an Entire Cluster" docs (#87485) (#108437)
One user reached out mentioning that it would be a good idea to remind
users to re-upload the license after full cluster recovery from snapshot
as one can easily miss this when trying to figure out why some features
aren't working after the restore.

(cherry picked from commit 295fba33d8)

Co-authored-by: Rafi Estrada <62263912+TheRiffRafi@users.noreply.github.com>
2024-05-08 17:23:38 -04:00
Athena Brown
766ba1c6c8
[7.17] Align all usages of protobuf to be 3.21.9 (#95431)
Updating repository-hdfs, repository-gcs, and vector-tile to all use the same more recent protobuf.

Co-authored-by: Keith Massey <keith.massey@elastic.co>
2024-05-08 14:59:53 -06:00