[DOCS] Expand simple query string query's multi-position token section (#68753)

This commit is contained in:
James Rodewig 2021-02-09 16:07:02 -05:00 committed by GitHub
parent 20cab22875
commit c65615911f
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
2 changed files with 28 additions and 20 deletions

View file

@ -39,6 +39,10 @@ record the `positionLength` for multi-position tokens. This filters include:
* <<analysis-synonym-graph-tokenfilter,`synonym_graph`>>
* <<analysis-word-delimiter-graph-tokenfilter,`word_delimiter_graph`>>
Some tokenizers, such as the
{plugin}/analysis-nori-tokenizer.html[`nori_tokenizer`], also accurately
decompose compound tokens into multi-position tokens.
In the following graph, `domain name system` and its synonym, `dns`, both have a
position of `0`. However, `dns` has a `positionLength` of `3`. Other tokens in
the graph have a default `positionLength` of `1`.