mirror of
https://github.com/elastic/elasticsearch.git
synced 2025-06-28 09:28:55 -04:00
19550a838f
This change enhances the dense_vector section of the Nodes stats and Index stats APIs so that they report the desired size of off-heap memory for all indexed vectors. The dense_vector section of the Custer stats API remains unchanged.
The retrieval mechanism and structure of the new stats is the same across the various three stats APIs, but more fine-grained information is disclosed as when moving from Cluster -> Node -> Index API.
For Node stats, we aggregate the total byte sizes for all vectors, categorised by the data type. For example:
"dense_vector" : {
"value_count" : 5,
"off_heap" : {
"total_size_in_bytes" : 27,
"total_veb_size_in_bytes" : 3,
"total_vec_size_in_bytes" : 23,
"total_veq_size_in_bytes" : 0,
"total_vex_size_in_bytes" : 1
}
}
Index stats: same as Node stats with included field break down . For example:
"dense_vector" : {
"value_count" : 5,
"off_heap" : {
"total_size_in_bytes" : 27,
"total_veb_size_in_bytes" : 3,
"total_vec_size_in_bytes" : 23,
"total_veq_size_in_bytes" : 0,
"total_vex_size_in_bytes" : 1,
"fielddata" : {
"bar" : {
"veb_size_in_bytes" : 3,
"vec_size_in_bytes" : 14,
"vex_size_in_bytes" : 1
},
"foo" : {
"vec_size_in_bytes" : 9
}
}
}
The implementation accesses the actual statistics through reflection. This will be completely removed when Lucene exposes this, which is expected in Lucene 10.3
|
||
|---|---|---|
| .. | ||
| ccs-common-rest | ||
| ccs-rolling-upgrade-remote-cluster | ||
| ccs-unavailable-clusters | ||
| custom-rest-controller | ||
| evil-tests | ||
| full-cluster-restart | ||
| logging-config | ||
| logging-spi | ||
| lucene-index-compatibility | ||
| mixed-cluster | ||
| multi-cluster-search | ||
| no-bootstrap-tests | ||
| packaging | ||
| remote-clusters | ||
| repository-multi-version | ||
| restricted-loggers | ||
| rolling-upgrade | ||
| rolling-upgrade-legacy | ||
| smoke-test-http | ||
| smoke-test-ingest-disabled | ||
| smoke-test-ingest-with-all-dependencies | ||
| smoke-test-multinode | ||
| smoke-test-plugins | ||
| stable-api | ||
| system-indices | ||
| unconfigured-node-name | ||
| verify-version-constants | ||
| build.gradle | ||