github-mirrors/kibana
1
0
Fork 0
mirror of https://github.com/elastic/kibana.git synced 2025-04-25 02:09:32 -04:00
Code Issues Projects Releases Packages Wiki Activity
kibana/docs
History
Tim Sullivan 56383ccdde
Use Data Stream for Reporting storage (#176022) 
## Summary

Closes https://github.com/elastic/kibana/issues/161608

* [X] Depends on https://github.com/elastic/elasticsearch/pull/97765
* [x] Depends on https://github.com/elastic/elasticsearch/pull/107581
* [x] Add create a new report job and check the details of the templated
data stream.
* [x] Run Discover tests in Flaky Test Runner:
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/5999

## Release Note

Reporting internal storage has been changed from using regular indices
to a data stream configuration for a more efficient sharding strategy.
This change is not expected to have any impact to users.

## Screenshots

### Upgrade test (manual process)
Using a report generated before this change, and a report generated
after "upgrading":

![image](f92193d8-70d6-4fa5-b1b7-8f6c1a0a5e9f)
Even though the two reports are in different types storage, they are
still managed by the same policy:

![image](9bd68d99-72ed-4cf0-bef9-55e644f039b7)
Looking at the details of the policy shows how the different types of
storage are used:

![image](6c0d1f80-97cb-4990-b2a8-45deab7528bc)

### Log lines

Initial startup in clean environment
```
[2024-05-13T13:22:49.138-07:00][INFO ][plugins.reporting.store] Creating ILM policy for reporting data stream: kibana-reporting
[2024-05-13T13:22:53.337-07:00][INFO ][plugins.reporting.store] Linking ILM policy to reporting data stream: .kibana-reporting, component template: kibana-reporting@custom
```

Kibana restart with ES running continuously
```
[2024-05-13T13:24:32.733-07:00][DEBUG][plugins.reporting.store] Found ILM policy kibana-reporting; skipping creation.
[2024-05-13T13:24:32.733-07:00][INFO ][plugins.reporting.store] Linking ILM policy to reporting data stream: .kibana-reporting, component template: kibana-reporting@custom
```

### Checklist

- [x]
[Documentation](https://www.elastic.co/guide/en/kibana/master/development-documentation.html)
was added for features that require explanation or tutorials
- [x] [Unit or functional
tests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)
were updated or added to match the most common scenarios
- [ ] [Flaky Test
Runner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1) was
used on any tests changed
~~See
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/5302
(internal link)~~
2024-05-21 10:11:45 -07:00
..
api [Roles] Added optional role description (#183145) 2024-05-16 17:14:09 +02:00
apm [DOCS] Update Observability docs to fix problems found during testing (#175636) 2024-01-29 11:05:21 -08:00
canvas Removes duplicate images (#173097) 2023-12-11 11:36:25 -08:00
concepts [DOCS] Update ESQL docs (#183617) 2024-05-17 14:50:05 +02:00
dev-tools Sort out objectization in variable substitution (#162382) 2023-07-27 09:30:52 +09:00
developer Upgrade Node.js to v20.13.1 (#183345) 2024-05-14 12:11:56 -07:00
development/plugins/expressions/public Remove old doc generation system for core APIs (#134313) 2022-06-21 17:43:17 +02:00
discover [DOCS] Update ESQL docs (#183617) 2024-05-17 14:50:05 +02:00
fleet [DOCS] Fleet managed content (#178380) 2024-03-25 22:14:29 +00:00
getting-started [DOCS] Updates the quick start guide (#163165) 2023-08-04 15:55:25 +02:00
management [ES|QL] Rename the setting to a more generic one and move to the general section (#182074) 2024-05-01 16:13:53 +02:00
maps [Docs][Chore] Fix asset tracking tutorial from 8.12 improvements (#176061) 2024-02-02 05:22:55 -07:00
migration [DOCS] Remove breaking changes tags (#162928) 2023-08-02 08:27:22 -04:00
observability
osquery [DOCS] Documents Osquery Timeout setting (#174595) 2024-01-17 15:29:23 +00:00
playground [DOCS] Add gpt-4o model support to Playground (#183372) 2024-05-14 21:08:13 +01:00
settings Use Data Stream for Reporting storage (#176022) 2024-05-21 10:11:45 -07:00
setup [DOCS] Update (Enterprise) Search ingestion tool info (#183233) 2024-05-13 16:57:54 +02:00
siem [DOCS] Elastic Sec Overview (Fixing Image) (#104529) 2021-07-07 09:58:09 -04:00
spaces Removing docs about multi-tenancy (#143698) 2022-10-24 16:01:43 -04:00
user Use Data Stream for Reporting storage (#176022) 2024-05-21 10:11:45 -07:00
accessibility.asciidoc
action-type-template.asciidoc [DOCS] Add preconfigured AWS Bedrock connector (#168663) 2023-10-16 08:23:12 -07:00
CHANGELOG.asciidoc [DOCS] Kibana 8.13.4 release notes (#182795) 2024-05-07 12:38:16 +01:00
gs-index.asciidoc [DOCS] Remove or move book-scoped attributes (#155210) 2023-04-20 09:12:09 -07:00
index.asciidoc [Docs] remove Kibana book-scoped variables (#178676) 2024-03-14 11:53:33 -04:00
index.x.asciidoc
landing-page.asciidoc [DOCS] Fix welcome-to-elastic link (#166357) 2023-09-14 06:08:35 -04:00
limitations.asciidoc [DOCS] Reallocates limitations to point-of-use (#79582) 2020-11-19 10:49:27 -06:00
migration.asciidoc
redirects.asciidoc [DOCS] Add Playground docs (#182692) 2024-05-08 17:29:17 +01:00
rule-type-template.asciidoc [DOCS] Create and manage rule action frequencies (#150957) 2023-02-23 13:16:46 -08:00
template.asciidoc [DOCS] Remove snapshot and restore docs (#114836) 2021-11-16 16:59:24 -05:00