Commit graph

61144 commits

Author SHA1 Message Date
Volodymyr Krasnikov
00b68250ab
Add some debug logs to IT test (#98461)
* Add some debug logs to IT test

* Output available index dirs on the node
2023-09-13 13:40:03 -07:00
David Turner
ac9112b909 Reinstate testRunnableRunsAtMostOnceAfterCancellation (#99525)
This test was failing in #34004 due to a race, and although #34296 made
the failures rarer they did not actually fix the race. Then in #99201 we
fixed the race but the resulting test over-synchronizes and no longer
meaningfully verifies the concurrent behaviour we were originally trying
to check. It also fails for other reasons. This commit reverts back to
the original test showing that we might run the action at most once
after cancellation without any further synchronization, but fixes the
assertion to use the value of the counter observed immediately after the
cancellation since we cannot be sure that no extra iterations execute
before the cancellation completes.
2023-09-13 16:01:10 +01:00
Athena Brown
db1e5cc160
[Backport] Check ILM status before reporting node migration STALLED
This commit adjusts the behavior of the node shutdown status
calculation to avoid reporting a `STALLED` status when ILM is
in the process of doing something that might result in the
migration being temporarily stalled (at time of writing, that
means shrinking an index).

This check is only made if ILM is not stopped.

Backport of #98367
2023-09-12 16:01:56 -06:00
Joe Gallo
5c8b796069
Fix a typo in the data_stream _stats API documentation (#99438) (#99444) 2023-09-11 15:37:22 -04:00
Brian Seeders
b6e2e9c2f0
[buildkite] Add snyk-dependency-monitoring pipeline (#99325) (#99380) 2023-09-08 15:54:21 -04:00
Nhat Nguyen
c99902f3f8
Fix PIT when resolving with deleted indices (#99281) (#99331)
* Fix PIT when resolving with deleted indices

* Update docs/changelog/99281.yaml
2023-09-07 18:33:10 -04:00
Craig Taverner
4f5d383427 Remove 'coming' from 7.17.13 release notes 2023-09-07 19:38:57 +02:00
Craig Taverner
256e0aaefb Prune changelogs after 7.17.13 release 2023-09-07 19:00:32 +02:00
Craig Taverner
c6a86e8269 Bump versions after 7.17.13 release 2023-09-07 17:18:38 +02:00
Brian Seeders
efbbf693be
[7.17] [buildkite] Migrate intake pipeline (#99133) (#99273) 2023-09-06 17:26:38 -04:00
Brian Seeders
4a2ce03290
[buildkite] Disable DRA release-manager temporarily (#99274) (#99277)
(cherry picked from commit cb87a2b081)
2023-09-06 17:19:14 -04:00
Brian Seeders
8af7eb9bb4
Fix pre-command 2023-09-06 16:54:41 -04:00
Brian Seeders
764793bd3a
[7.17] [buildkite] Add most of the remaining periodic pipelines (#98043) (#99262) 2023-09-06 15:28:14 -04:00
Brian Seeders
ecc919efeb
[buildkite] Migrate DRA workflows (#99132) (#99259)
(cherry picked from commit 9aa17a5dab)

# Conflicts:
#	.buildkite/hooks/pre-command
2023-09-06 13:28:29 -04:00
Brian Seeders
9ce5484924
Set explicit file permissions in NoticeTask (#99206) (#99255) 2023-09-06 12:48:56 -04:00
Mark Vieira
fff235ba3f
Mute platform testing on Debian 9 2023-09-06 09:18:13 -07:00
James Rodewig
56bb702d5a
[7.17] [DOCS] Fix double-slash in link (#99205) (#99244)
Closes https://github.com/elastic/platform-docs-team/issues/195
2023-09-06 09:55:27 -04:00
Rene Groeschke
bc733b98d8
Fix Painless method lookup over unknown super interfaces (#97062) (#99196)
In Java 21 List now extends SequencedCollection, instead of Collection
directly. When resolving methods Painless starts at the defined type,
and iterates up through super classes and interfaces. Unfortunately if a
superinterface was not known, as it is for SequencedCollection since it
is not in the allowed list of classes, method resolution would give up.
This commit adjusts the superinterface interation to continue traversing
until the method is found or no more superinterfaces are found.

fixes #97022

(cherry picked from commit 16b45575c3)

# Conflicts:
#	gradle.properties

Co-authored-by: Ryan Ernst <ryan@iernst.net>
2023-09-05 15:16:50 +02:00
Rene Groeschke
b8b6316081
Build bwc without es runtime 7x (#99180)
* Fix 6.x bwc build incompatibility with current es java runtime
2023-09-05 07:15:44 +02:00
Craig Taverner
0c9608864f
Updated release notes for 7.17.13 BC1 (#99047) 2023-09-01 11:06:46 +02:00
Mark Vieira
2b211dbb8b
Fix periodic Java matrix jobs to use correct JVM 2023-08-30 12:05:32 -07:00
Albert Zaharovits
82490eb237
Free up allocated buffers in Netty4HttpServerTransportTests (#99005) (#99037)
Closes #98869
2023-08-30 04:47:25 -04:00
Tim Vernum
9d448a0f95
Introduce FilterRestHandler (#98922)
RestHandler has a number of methods that affect the behaviour of request
processing. If the handler is wrapped (e.g. SecurityRestFilter or
DeprecationRestHandler) then these methods must be delegated to the
underlying handler.

This commit introduces a new abstract base class `FilterRestHandler`
that correctly delegates these methods so that wrappers (subclasses) do
not need to implement the behaviour on a case-by-case basis

Backport of: #98861
2023-08-30 07:19:47 +10:00
Brian Seeders
a95036757b
[7.17] [buildkite] Add Windows packaging and platform support tests to periodic pipeline (#98072) (#98329)
* [buildkite] Add Windows packaging and platform support tests to periodic pipeline (#98072)

(cherry picked from commit dfadca83f6)
2023-08-28 13:26:12 -04:00
Mark Vieira
97d53db48c
Add Java 21 to testing matrix 2023-08-28 09:23:30 -07:00
Iraklis Psaroudakis
f7af19baaa
Fix autoexpand during node replace (#98891)
Prior to this change NodeReplacementAllocationDecider was unconditionally skipping both replacement source and target nodes when calculation auto-expand replicas. This is fixed by autoexpanding to the replacement node if source node already had shards of the index

Backport of PR #96281 amended for 7.17.x

Closes #89527

Co-authored-by: Ievgen Degtiarenko <ievgen.degtiarenko@elastic.co>
2023-08-28 10:15:54 +03:00
Albert Zaharovits
0df52c8f67
Netty4 HTTP authn enhancements (#92220) (#96703)
This is a backport of multiple work items related to authentication enhancements for HTTP,
which were originally merged in the 8.8 - 8.9 releases.
Hence, the HTTP (only the netty4-based implementation (default), not the NIO one) authentication
implementation gets a throughput boost (especially for requests failing authn).

Relates to: ES-6188 #92220 #95112
2023-08-23 18:52:38 +03:00
David Turner
fe18a67f02
Make TransportAddVotingConfigExclusionsAction retryable (#98568)
The docs for this API say the following:

> If the API fails, you can safely retry it. Only a successful response
> guarantees that the node has been removed from the voting
> configuration and will not be reinstated.

Unfortunately this isn't true today: if the request adds no exclusions
then we do not wait before responding. This commit makes the API wait
until all exclusions are really applied.

Backport of #98386, plus the test changes from #98146 and #98356.
2023-08-17 04:49:03 -04:00
Volodymyr Krasnikov
bb57a0c81a
Increase timeout for waiting for the cleanup of the shared index folder (#98302) 2023-08-09 07:16:25 -07:00
Nikolaj Volgushev
83e916a9ec
Resolve conflict (#98311)
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2023-08-09 09:45:25 -04:00
Slobodan Adamović
6f66c75c99
[7.17] Enhance regex performance with duplicate wildcards (#98176) (#98277)
This change avoids unnecessary substring allocations and recursion calls
when more than two consecutive wildcards (`*`) are detected. Instead
skipping and calling a method recursively, we now try to skip all
consecutive `*` chars at once.
2023-08-08 14:34:05 +02:00
David Kilfoyle
842e8a410b
[Docs] Fix links to Cloud snapshot and restore docs (#98228) (#98232) 2023-08-04 18:20:15 -04:00
David Kilfoyle
31c912703f
Fix link to removed Cloud snapshot and restore page (#98210) (#98211)
* Fix link to removed Cloud snapshot and restore page

* Add another similar link
2023-08-04 16:27:52 -04:00
Brian Seeders
1b6be92751
Add java-matrix and java-fips-matrix Buildkite pipelines (#97253) (#98040) 2023-07-28 17:50:19 -04:00
Jake Landis
2e2f3ad01a
[7.17] Update certs for PKI tests and re-enable tests (#97766) (#97988)
* Update certs for PKI tests and re-enable tests (#97766)

The certs for the PKI tests expired and the test was muted.
This commit follows the instructions in the read to update the certs and unmutes the test.
The certs will now expire 20 years from now.

fixes: #97756

* precommit
2023-07-26 20:52:17 -04:00
Alan Woodward
ce1a67b8d5
Fix bug in NestedUtils.partitionByChildren() (#97970) (#97986)
If multiple fields appeared between two child scopes, the following children
would be incorrectly assigned to the parent scope.
2023-07-26 15:54:58 -04:00
Przemyslaw Gomulka
fbdb9cd6a8
Add Configuration to PatternLayout backport(97679) (#97971)
in 2.17.2 (patch release) log4j has made a refactoring that requires a Configuration to be manually passed into the created PatternLayout
If the Configuration is not passed, the System Variable lookup will not work This results in cluster.name field not being populated in logs

This commit creates a PatternLayout with a DefaultConfiguration (the same was used previous to the refactoring)

backports #97679
2023-07-26 17:51:43 +02:00
Abdon Pijpelink
f9b064e463
[DOCS] Remove 'coming in 7.17.12' from release notes (#97965)
This PR removes an out-dated "coming" note.
2023-07-26 16:23:28 +02:00
Andrei Dan
f0b7122b16
[7.17] Migrate to data tiers routing configures correct default for mounted indices (#97950)
* Migrate to data tiers routing configures correct default for mounted indices

(cherry picked from commit eaec9602a9c4a4b092f36fd35f58d1e4b8faca52)
Signed-off-by: Andrei Dan <andrei.dan@elastic.co>

* Add isExplicitDataTier method back as it's used in 7.17

---------

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2023-07-26 05:11:10 -04:00
Ryan Ernst
0c21da5ef7
Prune changelogs after 7.17.12 release 2023-07-25 11:26:03 -07:00
Ryan Ernst
fe8d4a23ae
Bump versions after 7.17.12 release 2023-07-25 11:24:15 -07:00
Alan Woodward
72eb60953a
Refactor nested field handling in FieldFetcher (#97683) (#97897)
The current recursive nested field handling implementation in FieldFetcher
can be O(n^2) in the number of nested mappings, whether or not a nested
field has been requested or not. For indexes with a very large number of
nested fields, this can mean it takes multiple seconds to build a FieldFetcher,
making the fetch phase of queries extremely slow, even if no nested fields
are actually asked for.

This commit reworks the logic so that building nested fetchers is only
O(n log n) in the number of nested mappers; additionally, we only pay this
cost for nested fields that have been requested.
2023-07-25 13:45:53 +01:00
Ryan Ernst
92403f7d56
Add release notes for 7.17.12 release (#97864) 2023-07-25 06:54:33 -04:00
Iraklis Psaroudakis
e3b0c3d3c5
Mute some PkiAuthDelegationIntegTests (#97774) (#97779)
Relates #97772
2023-07-19 04:58:31 -04:00
Mark Vieira
ca0aa27289
Upgrade bundle JDK to Java 20.0.2 (#97758) (#97762)
# Conflicts:
#	gradle/verification-metadata.xml

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2023-07-18 20:22:23 -04:00
Mark Vieira
df7528e88c
Fix import 2023-07-18 16:27:47 -07:00
Ryan Ernst
b526892f24
Muting pki tests until expired test certs are regenerated (#97757)
see https://github.com/elastic/elasticsearch/issues/97756
2023-07-18 16:08:27 -07:00
Mark Vieira
0c1c6ffec8
Mute SecurityDocumentationIT.testDelegatePkiAuthentication 2023-07-18 10:34:48 -07:00
Ignacio Vera
a5433e375d
[7.17] Support for Byte and Short as vector tiles value tag (#97619) (#97673)
* Port lucene fix github-12352 to Elasticsearch 7.17

* Update docs/changelog/96721.yaml

* Support for Byte and Short as vector tiles value tag (#97619)

Byte and short data types are not supported by the vector tiles specification. If a user tries to add one of those, it
 actually gets ignored. This add s support to those values by casting them as integers. In addition it will throw an
exception if the value added is a type it cannot understand so it is not silently ignored.
# Conflicts:
#	x-pack/plugin/src/yamlRestTest/resources/rest-api-spec/test/vector-tile/10_basic.yml
2023-07-13 21:59:53 -04:00
David Turner
d4069ef08c
Add note on troubleshooting laggy cancellations (#97485) (#97499)
Today we document that tasks may not react to cancellations immediately,
but in practice it's surprising to users and kind of a bug if they run
for too long after being cancelled. This commit adds a little extra
detail about the information to collect to troubleshoot such a
situation.
2023-07-10 07:09:36 -04:00