elasticsearch/docs/reference/vectors
Benjamin Trent 616b3908a0
[8.x] Add support for bitwise inner-product in painless (#116082) (#116285)
* Add support for bitwise inner-product in painless (#116082)

This adds bitwise inner product to painless. 

The idea here is:

 - For two bit arrays, which we determine to be a byte array whose dimensions match `dense_vector.dim/8`, we simply return bitwise `&`
 - For a stored bit array (remember, with `dense_vector.dim/8` bytes), sum up the provided byte or float array using the bit array as a mask.

This is effectively supporting asynchronous quantization. A prime
example of how this works is:
https://github.com/cohere-ai/BinaryVectorDB

Basically, you do your initial search against the binary space and then
rerank with a differently quantized vector allowing for more information
without additional storage space. 

closes:  https://github.com/elastic/elasticsearch/issues/111232

* removing unnecessary task adjustment

---------

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2024-11-07 00:35:19 +11:00
..
vector-functions.asciidoc [8.x] Add support for bitwise inner-product in painless (#116082) (#116285) 2024-11-07 00:35:19 +11:00