elasticsearch/qa/rolling-upgrade
Salvatore Campagna bdd3a4ffbe
Hash the tsid to overcome dimensions limits (#98023)
A Lucene limitation on doc values for UTF-8 fields does not allow  us to
write keyword fields whose size is larger then 32K. This limits  our
ability to map more than a certain number of dimension fields  for time
series indices. Before introducing this change the tsid is created as a
catenation of dimension field names and values into a keyword field.

To overcome this limitation we hash the tsid. This PR is intended to be
used as a draft to test different options.

Note that, as a side effect, this reduces the size of the tsid field as
a result of storing far less data when the tsid is hashed. Anyway, we
expect tsid hashing to affect compression of doc values and resulting in
larger storage footprint. Effect on query latency needs to be evaluated
too.

Resolves #93564
2024-02-01 08:25:31 -05:00
..
src/javaRestTest/java/org/elasticsearch/upgrades Hash the tsid to overcome dimensions limits (#98023) 2024-02-01 08:25:31 -05:00
build.gradle Make Legacy test cluster infrastructure configuration cache compatible (#101903) 2023-11-28 12:15:03 +01:00