Support CCS minimize round trips in async search (#96012)

Browse source

* Support CCS minimize round trips in async search

This commit makes the smallest set of changes to allow async-search based cross-cluster search
to work with the CCS minimize_round_trips feature without changing the internals/architecture of
the search action.

When ccsMinimizeRoundtrips is set to true on SubmitAsyncSearchRequest, the AsyncSearchTask on the
primary CCS coordinator sends a synchronous SearchRequest to all to clusters for a remote coordinator
to orchestrate and return the entire result set to the CCS coordinator as a single response.

This is the same functionality provided by synchronous CCS search using minimize_roundtrips.
Since this is an async search, it means that the async search coordinator has no visibility
into search progress on the remote clusters while they are running the search, thus losing one of
the key features of async search. However, this is a good first approach for improving overall search
latency for cross cluster searches that query a large number of shards on remote clusters, since
Kibana does not currently expose incremental progress of an async search to users.

Relates #73971

...

This commit is contained in:

Michael Peterson 2023-06-01 10:34:16 -04:00 • committed by GitHub

parent ff9c0aab37

commit 8b1cd47455

No known key found for this signature in database

GPG key ID: 4AEE18F83AFDEB23

15 changed files with 774 additions and 177 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download patch file Download diff file Expand all files Collapse all files

652

qa/multi-cluster-search/src/test/java/org/elasticsearch/search/CCSDuelIT.java

View file

File diff suppressed because it is too large Load diff