[8.9] [ML] Fix anomaly detection module manifest queries for kibana sample data sets (#164332) (#164458)

# Backport

This will backport the following commits from `main` to `8.9`:
- [[ML] Fix anomaly detection module manifest queries for kibana sample
data sets (#164332)](https://github.com/elastic/kibana/pull/164332)

<!--- Backport version: 8.9.7 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sqren/backport)

<!--BACKPORT [{"author":{"name":"James
Gowdy","email":"jgowdy@elastic.co"},"sourceCommit":{"committedDate":"2023-08-22T13:39:58Z","message":"[ML]
Fix anomaly detection module manifest queries for kibana sample data
sets (#164332)\n\nFollow up to
https://github.com/elastic/kibana/pull/119635\r\nAll modules which
contain a query in their manifest file should have a\r\nfilter to avoid
querying cold and frozen tiers.\r\nThe original PR did not include the
sample data sets as it was assumed\r\nit was not necessary due to these
data sets never being added to cold or\r\nfrozen tiers.\r\nHowever it
was overlooked that these queries will be run on any index\r\npattern
passed to the `/internal/ml/modules/recognize` endpoint and so\r\nhas
the potential to negatively impact the speed of all calls to
this\r\nendpoint, especially if the index pattern contains multiple
indices
and\r\nwildcards.","sha":"cd219942d12083897d7c56723f83da2a2f3c2586","branchLabelMapping":{"^v8.11.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["bug","release_note:fix",":ml","v8.10.0","v8.11.0","v8.9.2"],"number":164332,"url":"https://github.com/elastic/kibana/pull/164332","mergeCommit":{"message":"[ML]
Fix anomaly detection module manifest queries for kibana sample data
sets (#164332)\n\nFollow up to
https://github.com/elastic/kibana/pull/119635\r\nAll modules which
contain a query in their manifest file should have a\r\nfilter to avoid
querying cold and frozen tiers.\r\nThe original PR did not include the
sample data sets as it was assumed\r\nit was not necessary due to these
data sets never being added to cold or\r\nfrozen tiers.\r\nHowever it
was overlooked that these queries will be run on any index\r\npattern
passed to the `/internal/ml/modules/recognize` endpoint and so\r\nhas
the potential to negatively impact the speed of all calls to
this\r\nendpoint, especially if the index pattern contains multiple
indices
and\r\nwildcards.","sha":"cd219942d12083897d7c56723f83da2a2f3c2586"}},"sourceBranch":"main","suggestedTargetBranches":["8.10","8.9"],"targetPullRequestStates":[{"branch":"8.10","label":"v8.10.0","labelRegex":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"main","label":"v8.11.0","labelRegex":"^v8.11.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/164332","number":164332,"mergeCommit":{"message":"[ML]
Fix anomaly detection module manifest queries for kibana sample data
sets (#164332)\n\nFollow up to
https://github.com/elastic/kibana/pull/119635\r\nAll modules which
contain a query in their manifest file should have a\r\nfilter to avoid
querying cold and frozen tiers.\r\nThe original PR did not include the
sample data sets as it was assumed\r\nit was not necessary due to these
data sets never being added to cold or\r\nfrozen tiers.\r\nHowever it
was overlooked that these queries will be run on any index\r\npattern
passed to the `/internal/ml/modules/recognize` endpoint and so\r\nhas
the potential to negatively impact the speed of all calls to
this\r\nendpoint, especially if the index pattern contains multiple
indices
and\r\nwildcards.","sha":"cd219942d12083897d7c56723f83da2a2f3c2586"}},{"branch":"8.9","label":"v8.9.2","labelRegex":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}]
BACKPORT-->

Co-authored-by: James Gowdy <jgowdy@elastic.co>
This commit is contained in:
Kibana Machine 2023-08-22 11:08:11 -04:00 committed by GitHub
parent e059c8434a
commit 072be8c23f
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
2 changed files with 4 additions and 2 deletions

View file

@ -7,7 +7,8 @@
"defaultIndexPattern": "kibana_sample_data_ecommerce",
"query": {
"bool": {
"filter": [{ "term": { "event.dataset": "sample_ecommerce" } }]
"filter": [{ "term": { "event.dataset": "sample_ecommerce" } }],
"must_not": { "terms": { "_tier": [ "data_frozen", "data_cold" ] } }
}
},
"jobs": [

View file

@ -7,7 +7,8 @@
"defaultIndexPattern": "kibana_sample_data_logs",
"query": {
"bool": {
"filter": [{ "term": { "event.dataset": "sample_web_logs" } }]
"filter": [{ "term": { "event.dataset": "sample_web_logs" } }],
"must_not": { "terms": { "_tier": [ "data_frozen", "data_cold" ] } }
}
},
"jobs": [