elasticsearch/docs/reference/aggregations/pipeline
Benjamin Trent 8069e9b233
[ML] add new bucket_correlation aggregation with initial count_correlation function (#72133)
This commit adds a new pipeline aggregation that allows correlation within the aggregation frame work in bucketed values. 

The initial function is a `count_correlation` function. The purpose of which is to correlate the count in a consistent number of buckets with a pre calculated indicator. The indicator and the aggregated buckets should related to the same metrics with in documents. 

Example for correlating terms within a `service.version.keyword` with latency percentiles. The percentiles and provided correlation indicator both refer to the same source data where the indicator was previously calculated.:
```
GET apm-7.12.0-transaction-generated/_search
{
  "size": 0,
  "aggs": {
    "field_terms": {
      "terms": {
        "field": "service.version.keyword",
        "size": 20
      },
      "aggs": {
        "latency_range": {
          "range": {
            "field": "transaction.duration.us",
            "ranges": [<snip>],
            "keyed": true
          }
        },
        "correlation": {
          "bucket_correlation": {
            "buckets_path": "latency_range>_count",
            "count_correlation": {
              "indicator": {
                 "expectations": [<snip>],
                 "doc_count": 20000
               }
            }
          }
        }
      }
    }
  }
}
```
2021-05-10 12:46:11 -04:00
..
avg-bucket-aggregation.asciidoc [DOCS] Fix gap policy xref 2021-03-03 09:31:02 -05:00
bucket-correlation-aggregation.asciidoc [ML] add new bucket_correlation aggregation with initial count_correlation function (#72133) 2021-05-10 12:46:11 -04:00
bucket-script-aggregation.asciidoc [DOCS] Change agg titles to sentence case (#64425) 2020-10-30 13:25:21 -04:00
bucket-selector-aggregation.asciidoc [DOCS] Change agg titles to sentence case (#64425) 2020-10-30 13:25:21 -04:00
bucket-sort-aggregation.asciidoc [DOCS] Change agg titles to sentence case (#64425) 2020-10-30 13:25:21 -04:00
cumulative-cardinality-aggregation.asciidoc [DOCS] Fix double spaces (#71082) 2021-03-31 09:57:47 -04:00
cumulative-sum-aggregation.asciidoc [DOCS] Change agg titles to sentence case (#64425) 2020-10-30 13:25:21 -04:00
derivative-aggregation.asciidoc [DOCS] Fix double spaces (#71082) 2021-03-31 09:57:47 -04:00
extended-stats-bucket-aggregation.asciidoc [DOCS] Change agg titles to sentence case (#64425) 2020-10-30 13:25:21 -04:00
inference-bucket-aggregation.asciidoc [DOCS] Removes beta labels from DFA related docs. (#70808) 2021-03-26 09:46:41 +01:00
max-bucket-aggregation.asciidoc [DOCS] Change agg titles to sentence case (#64425) 2020-10-30 13:25:21 -04:00
min-bucket-aggregation.asciidoc [DOCS] Change agg titles to sentence case (#64425) 2020-10-30 13:25:21 -04:00
movfn-aggregation.asciidoc [DOCS] Fix double spaces (#71082) 2021-03-31 09:57:47 -04:00
moving-percentiles-aggregation.asciidoc [DOCS] Fix double spaces (#71082) 2021-03-31 09:57:47 -04:00
normalize-aggregation.asciidoc [DOCS] Change agg titles to sentence case (#64425) 2020-10-30 13:25:21 -04:00
percentiles-bucket-aggregation.asciidoc [DOCS] Fix double spaces (#71082) 2021-03-31 09:57:47 -04:00
serial-diff-aggregation.asciidoc [DOCS] Fix double spaces (#71082) 2021-03-31 09:57:47 -04:00
stats-bucket-aggregation.asciidoc [DOCS] Change agg titles to sentence case (#64425) 2020-10-30 13:25:21 -04:00
sum-bucket-aggregation.asciidoc [DOCS] Change agg titles to sentence case (#64425) 2020-10-30 13:25:21 -04:00