Commit graph

76812 commits

Author SHA1 Message Date
Mark Vieira
709225da31
Enable vector module in third party audit tasks in Java 23 (#108638) (#108646) 2024-05-14 18:06:46 -04:00
Mark Vieira
ac22f39843
Upgrade Mockito dependency (#108637) (#108644) 2024-05-14 17:55:50 -04:00
Ryan Ernst
12280019e9
Workaround G1 bug for JDK 22 and 22.0.1 (#108571) (#108630)
See https://bugs.openjdk.org/browse/JDK-8329528. The applied workaround
was suggested on the linked issue, and was tested and confirmed to avoid
the G1 bug.
2024-05-14 12:46:36 -04:00
Slobodan Adamović
3d1ea25a0d
[Test] Ignore closed connections on Windows hosts (#108362) (#108586)
This commit adds special handling for the  `java.io.IOException: An established connection was aborted by the software in your host machine` in `Netty4HttpClient#exceptionCaught ` method. This exception only occurs when running tests on Windows hosts

Resolves: #108193
(cherry picked from commit 93ec9d6142)
2024-05-13 16:24:15 -04:00
Armin Braun
80c5ff28f9
Add internalClusterTest for and fix leak in ExpandSearchPhase (#108562) (#108582)
`ExpandSearchPhase` was leaking `SearchHits` when a pooled `SearchHits`
that was read from the wire was added to an unpooled `SearchHit`.
This commit makes the relevant `SearchHit` instances that need to be
pooled so they released nested hits, pooled. This requires a couple of
smaller adjustments in the codebase, mainly around error handling.
2024-05-13 15:10:45 -04:00
Joe Gallo
4bfcd4947c
Remove leading is_ prefix from Enterprise geoip docs (#108518) (#108569) 2024-05-13 11:49:38 -04:00
Slobodan Adamović
60ec57b412
[DOCS] Document manage_inference and monitor_inference cluster privileges (#108553) (#108572) 2024-05-13 10:55:09 -04:00
Jedr Blaszyk
c05836551c
[Connector API][Docs] List supported enum values for the list request (#108557) (#108567) 2024-05-13 09:43:33 -04:00
Thomas Neirynck
874471b442
[Docs] Add warning kibana has incomplete support for nested fields (#107971) (#108564) 2024-05-13 09:08:12 -04:00
Liam Thompson
0e72305b6e
[DOCS] Update run-elasticsearch-locally.asciidoc (#108545) (#108548)
Remove confusing link as already available in note at end of page
2024-05-13 05:18:01 -04:00
Jim Ferenczi
d0a388d13a
Fix integer overflow in native scalar quantizer (#108493) (#108535)
Offsets in memory segments should be computed as longs to avoid integer overflow on large segments.

---------

Co-authored-by: ChrisHegarty <chegar999@gmail.com>
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2024-05-12 04:09:32 -04:00
elasticsearchmachine
89b13018ce Prune changelogs after 8.13.4 release 2024-05-10 21:40:35 +00:00
elasticsearchmachine
948fab0a25 Bump versions after 8.13.4 release 2024-05-10 21:38:45 +00:00
Luigi Dell'Aquila
17dff75e17
[8.14] ES|QL: Add unit tests for now() function (#108498) (#108505)
* ES|QL: Add unit tests for now() function (#108498)

* Fix for bwc
2024-05-10 10:25:14 -04:00
Jim Ferenczi
9341c15633
[8.14] Handle must_not clauses when disabling the weight matches highlighting mode (#108500)
* Handle must_not clauses when disabling the weight matches highlighting mode (#108453)

This change makes sure we check all queries, even the must_not ones, to decide if we should disable weight matches highlighting or not.

Closes #101667
Closes #106693

* adapt test skip version
2024-05-10 05:50:40 -04:00
Mark Vieira
5616d0c41e
Increase startup timeout in packaging tests (#108487) (#108489) 2024-05-09 20:13:02 -04:00
David Turner
765e6f2273
Document transport.compress trade-offs more clearly (#108458) (#108480)
Spells out explicitly that setting `transport.compress: true` may cost
extra CPU.
2024-05-09 14:29:03 -04:00
David Turner
ac1322fe9d
Clarify docs on deleting searchable snapshots (#108451) (#108478)
The word `cannot` implies Elasticsearch prevents you from doing these
things, but it doesn't have this protection today (see #73947). This
commit clarifies this by saying `must not` instead.

Closes #108450
2024-05-09 13:59:07 -04:00
Nhat Nguyen
1d99311d4f
Log running tasks in EsqlDisruptionIT (#108440) (#108467)
This PR logs tasks that are running after the disruption is cleared, 
allowing us to investigate why the disruption tests failed in #107347.

Relates #107347
2024-05-09 11:33:57 -04:00
Mayya Sharipova
ee58956cfc
Correct typo in documentation (#108462) (#108466)
Correct a small typo: one closing ">" was missing.
2024-05-09 10:55:48 -04:00
István Zoltán Szabó
979b539cbe
[8.14] [DOCS] Adds complete Cohere tutorial (#108415) (#108448)
* [DOCS] Adds complete Cohere tutorial (#108415)

* Apply suggestions from code review
2024-05-09 15:10:27 +02:00
Nick Tindall
f6ac110970
[DOCS] Fix stored_fields parameter description (#98385) (#108445) (#108446)
(referenced from get and multi_get API docs)

Closes #98385
2024-05-09 03:40:59 -04:00
Costin Leau
554974d113
ESQL: Disable quoting in FROM command (#108431) (#108443)
Disable location quoting in FROM command before 8.14 release to allow
 more time to discuss options

(cherry picked from commit e56ed71ef8)
2024-05-08 21:26:47 -04:00
Nhat Nguyen
bfe1df51f6
Remove time-series ordinal rate tests in ESQL (#108148) (#108442)
The rate aggregation will only be used in time-series aggregations,
where ordinal grouping should never be applied. Therefore, we should
remove these tests to reduce unnecessary noise.

Closes #107568
Closes #107710
2024-05-08 19:04:41 -04:00
Lee Hinman
e15ec459c9
Mention alias filters don't apply for get-by-id in docs (#108433) (#108438)
Resolves #3861
2024-05-08 17:50:35 -04:00
Nhat Nguyen
17edd33b35
Exchange should wait for remote sinks (#108337) (#108430)
Today, we do not wait for remote sinks to stop before completing the 
main request. While this doesn't affect correctness, it's important  that
we do not spawn child requests after the parent request is completed.

Closes #105859
2024-05-08 14:32:05 -07:00
Athena Brown
a0d9a7c58e
Add note about license to "Restore an Entire Cluster" docs (#87485) (#108435)
One user reached out mentioning that it would be a good idea to remind
users to re-upload the license after full cluster recovery from snapshot
as one can easily miss this when trying to figure out why some features
aren't working after the restore.

(cherry picked from commit 295fba33d8)

Co-authored-by: Rafi Estrada <62263912+TheRiffRafi@users.noreply.github.com>
2024-05-08 17:24:08 -04:00
Andrew Wilkins
733620d66a
nativeaccess: try to load all located libsystemds (#108238) (#108428)
Linux systems with multiarch (e.g. i386 & x86_64) libraries
may have libsystemd.0 in two subdirectories of an entry in
java.library.path. For example, libsystemd.so.0 may be found
in both /usr/lib/i386-linux-gnu and /usr/lib/x86_64-linux-gnu.

Instead of attempting to load any library found, attempt all
and stop as soon as one is successfully loaded.
2024-05-08 15:02:15 -04:00
Mark Vieira
3458f211d6
Refactor rolling upgrade tests to make it easier to customize (#108393) (#108419)
# Conflicts:
#	qa/rolling-upgrade/src/javaRestTest/java/org/elasticsearch/upgrades/IgnoredMetaFieldRollingUpgradeIT.java
2024-05-08 12:15:42 -04:00
David Kyle
7debd6ebbf
[ML] Fix startOffset must be non-negative error in XLMRoBERTa tokenizer (#107891) (#108405)
Fixes an error is when the normalisation step produces text that is longer 
than the input text and an offset needs to be added to map back to the
original.
2024-05-08 07:05:18 -04:00
Albert Zaharovits
a2e519cccd
Fix Netty4HttpServerTransportTests testChannelAcceptorCannotTamperThreadContext (#108374) (#108399)
Fix Netty4HttpServerTransportTests testChannelAcceptorCannotTamperThreadContext
2024-05-08 04:25:16 -04:00
Jedr Blaszyk
41e985c20d
[Bugfix] Connector API - fix status serialisation issue in termquery (#108365) (#108397) 2024-05-08 04:14:03 -04:00
Fang Xing
4c5d59a345
[ES|QL] More implicit casting for binary comparison and IN list predicate (#107859) (#108384)
* implicit casting for IN and binary comparison on ip, version, and boolean

(cherry picked from commit 47a18d293c)
2024-05-07 17:13:59 -04:00
Liam Thompson
869bffb7db
[DOCS] Add retrievers overview (#107959) (#108378) 2024-05-07 12:44:09 -04:00
Liam Thompson
f88eecca23
[DOCS] Add local dev setup instructions (#107913) (#108376)
* [DOCS] Add local dev setup instructions

- Replace existing Run ES in Docker locally page, with simpler no-security local dev setup
- Move this file into Quickstart folder, along with existing quickstart guide
- Update self-managed instructions in Quickstart guide to use local dev approach
2024-05-07 12:33:55 -04:00
Bogdan Pintea
2382fb5262
Add docs clarifications on DATE_DIFF args (#108301) (#108370)
This adds some clarifications on the time unit strings the function
takes as arguments, noting the differences between these and the time
span literals, as well as the abbreviations' source.

(cherry picked from commit de725aef80)
2024-05-07 18:14:21 +02:00
Liam Thompson
be453d6b0e
[DOCS] ESQL goes GA (#108342) (#108359) 2024-05-07 08:35:49 -04:00
Yang Wang
a3195f49ae
[8.14] Unmute Azure 3rd party tests (#108336) (#108344)
* Unmute Azure 3rd party tests (#108336)

Unmute Azure 3rd party tests (again) after re-generating credentials
following the updated guide.

Relates: #107928
Fixes: #107720
Fixes: #107502
(cherry picked from commit eba6a848df)

# Conflicts:
#	modules/repository-azure/src/internalClusterTest/java/org/elasticsearch/repositories/azure/AzureStorageCleanupThirdPartyTests.java
#	x-pack/plugin/snapshot-repo-test-kit/qa/azure/src/javaRestTest/java/org/elasticsearch/repositories/blobstore/testkit/AzureSnapshotRepoTestKitIT.java

* remove redundant change
2024-05-07 05:15:33 -04:00
Martijn van Groningen
61d1da7805
Remove zstd change from changelog. (#108307)
ZSTD compression was added behind feature flag in #103374.
But the feature flag isn't removed yet and therefor the zstd compression will not be enabled, deflate and lz4 are still active.
2024-05-07 10:03:44 +02:00
Nhat Nguyen
22dd291603
Fix BlockHash DirectEncoder (#108283) (#108328)
The DirectEncoder currently returns the incorrect value for the
positionCount() method, which should be the number of positions ready in
the current batch. We need to keep track of whether a position is loaded
via encodeNextBatch() and consumed via the read() method. However, we
can always return 1 for positionCount(), indicating that one position is
already loaded. Our tests failed to catch this because mv_ordering
wasn't enabled when generating test blocks, effectively disabling the
DirectEncoders.

Closes #108268
2024-05-06 12:57:48 -04:00
Nik Everett
217ffa0335
ESQL: Rework integration-only csv testing (#108313) (#108326)
This reworks the integration-test-only csv testing for `metadata` to use
the `required_feature:` syntax instead of the `-IT_tests_only`
extension. This is a little more flexible and way nicer on the eyes.
2024-05-06 12:34:02 -04:00
Nik Everett
176901076d
ESQL: Log queries at debug level (#108257) (#108325)
Previously we were logging all ESQL queries. That's a lot! Plus maybe
there's PII in there or something. Let's not do that unless you ask for
it. This changes the query logging to the `debug` log level you can
still get at these if you want them, but you don't have them by default.
you have to turn it on.
2024-05-06 12:08:50 -04:00
Nhat Nguyen
23527872fe
Fix random limit in AsyncOperatorTests (#108289) (#108322)
Adjust the lower bound to include the case where the number of positions is zero.

Closes #107847
2024-05-06 11:40:37 -04:00
Nikolaj Volgushev
b09df64dc7
Invalidate cross cluster API key docs (#108297) (#108316)
This PR documents privilege requirements for cross-cluster API key
invalidation, which were updated in
https://github.com/elastic/elasticsearch/pull/107411.
2024-05-06 10:25:38 -04:00
Liam Thompson
be436e6b4d
[DOCS] Clarify retriever is not API (#108295) (#108315) 2024-05-06 10:15:19 -04:00
Bogdan Pintea
e31c80601e
Introduce an IP functions group (#108304) (#108309)
This takes the CIDR_MATCH out of the operators group and adds it to a
new `IP functions` group.
The change also re-aranges the groups, grouping together the
type-specific functions and ordering them alphabetically.

(cherry picked from commit b26d7d3e14)
2024-05-06 09:09:30 -04:00
Bogdan Pintea
701d8db20b
Fix docs generation of signatures for variadic functions (#107865) (#108252)
This fixes the generation of the signatures for variadic functions,
except for those that take a list as last argument; i.e.  functions with
optional arguments (like ROUND) or functions with overloading-like
signatures (like BUCKET).

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2024-05-06 07:20:37 -04:00
Yang Wang
16d7e9f36f
Ensure necessary security context for s3 bulk deletions (#108280) (#108298)
This PR moves the doPrivileged wrapper closer to the actual deletion
request to ensure the necesary security context is established at all
times. Also added a new repository setting to configure max size for s3
deleteObjects request.

Fixes: #108049
2024-05-06 07:08:23 -04:00
István Zoltán Szabó
524c62078a
[DOCS] Documents param for Health API. (#108296) (#108302) 2024-05-06 06:48:43 -04:00
Nhat Nguyen
e07f4b9f5a
Fix tsdb codec when doc-values spread in two blocks (#108276) (#108281)
Currently, loading ordinals multiple times (after advanceExact) for 
documents with values spread across multiple blocks in the TSDB codec
will fail due to the absence of re-seeking for the ordinals block.

Doc-values of a document can spread across multiple blocks in two cases:
when it has more than 128 values or when it exceeds the remaining space
in the current block.
2024-05-04 17:51:00 -04:00