Commit graph

129 commits

Author SHA1 Message Date
Martijn van Groningen
bea09c004e
Explain tsdb counters better. (#97618) 2023-07-13 17:15:17 +02:00
Abdon Pijpelink
a9b3d7ada7
[DOCS] Clarify that disk impact of TSDS varies per data set (#97571) 2023-07-13 10:14:09 +02:00
Mary Gouseti
a432313ff3
Data stream lifecycle class names (#97381) 2023-07-05 12:28:32 +03:00
Mary Gouseti
1abd51b167
Start with data stream lifecycle documentation (#95326) 2023-06-28 16:18:05 +03:00
Martijn van Groningen
d5f9e113a5
Update tsds-index-settings.asciidoc (#96366)
* index.routing_path only gets generated for backing indices of tsdb data streams.
* Updated the dimension_fields.limit setting default.

Closes #96330
2023-05-26 19:23:53 +02:00
David Kilfoyle
8e7d4b0750
[DOCS] Note limits for queries on downsampled indices (#95749) 2023-05-03 09:58:23 -04:00
Martijn van Groningen
49e8ee4269
Remove remaining tsdb tech preview labels (#95563)
Remove tech preview label from a number of tsdb settings and mapping attributes.
2023-04-26 12:11:03 +02:00
Pablo Alcantar Morales
132290f8a3
fix flaky docs tests get-lifecycle (#95529)
The `data-streams/downsampling.asciidoc` test was missing a teardown clean of the ILM policies created. Due to this tests *do not have* the string `ilm` in its name, the automatic teardown process that cleans up the resources (check `ESRestTestCase.java#L815` & `DocsClientYamlTestSuiteIT.java` lines 177 & 195) is not executed for this specific test. In the case this test runs right before the `get-lifecycle` test, the policy won't be automatically deleted hence the test checking the version will fail. Finally, the order of execution of the test is not guaranteed by the suite.
2023-04-26 12:10:49 +02:00
Salvatore Campagna
ec2bdee31b
Add time_series_dimensions param to flattened docs (#95374) 2023-04-20 10:58:12 +02:00
Andrei Dan
7b994ba8d0
Document that DS backing indices can have gaps in the name counter (#95237) 2023-04-17 17:11:05 +01:00
Martijn van Groningen
b41f096756
Document counter field limitation. (#95155)
As is listed here:
https://github.com/elastic/elasticsearch/issues/93539#issuecomment-1420473031

Relates to #93539
2023-04-11 12:14:20 -04:00
Abdon Pijpelink
20dd5d3191
[DOCS] Rerun agg at the end of manual downsampling example (#95122)
* [DOCS] Rerun agg at the end of manual downsampling example

* Replace 'index' with 'data stream'

* One more 'index'
2023-04-11 17:33:52 +02:00
David Kilfoyle
9a673ad7f1
95017 fix downsampling step (#95054)
* Remove extra step in manual downsampling docs

* create -> view
2023-04-05 10:09:03 -04:00
Abdon Pijpelink
ccc2d94baf
[DOCS] Explain how to change aliases in data streams documentation (#94110) 2023-03-21 15:34:00 +01:00
Abdon Pijpelink
6e21e4a600
Update TSDS disk space reduction percentage (#94549) 2023-03-20 15:19:58 +01:00
richcollier
1da70cbe08
Update tsds.asciidoc (#94208)
fixed typo
2023-03-01 11:05:15 +01:00
Martijn van Groningen
92f229d643
Update tsdb docs to include warning and additional limitations (#93191)
Update tsdb docs to include a warning that the format of the `_tsid` field shouldn't be relied upon and added additional limitations about dimension fields.
2023-01-24 12:05:50 +01:00
David Kilfoyle
3f880613f8
[Docs] Remove tech preview notice from downsampling docs (#92913) 2023-01-19 09:05:59 -05:00
Abdon Pijpelink
64ce4d1189
[DOCS] Downsampling code snippet formatting (#92981) 2023-01-17 15:31:25 +01:00
Martijn van Groningen
e1d0ba83f5
Fixed typo in docs. 2023-01-17 09:34:21 +01:00
David Kilfoyle
7c6025dd27
Remove tech preview disclaimer from TSDS ingest docs (#91519)
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2022-11-22 09:23:40 -05:00
David Kilfoyle
3295662697
[DOCS] Add time range info to TSDS docs (#91291)
* [DOCS] Add time range info to TSDS docs

* Fixup
2022-11-04 09:18:35 -04:00
David Kilfoyle
56397f5d4c
[Docs] Remove feature flag from downsampling page (#91228) 2022-11-01 09:51:22 -04:00
David Kilfoyle
cad87c4d5a
[DOCS] Add Downsampling docs (#88571)
This adds documentation for downsampling of time series indices.
2022-10-12 12:10:16 -04:00
Christos Soulios
1a709caa65 [TSDB] Removed summary and histogram metric types (#89937)
It seems that for now we don't have a good use for the histogram and summary metric types. 
They had been left as place holders for a while, but at this point there is no concrete plan forward for them.

This PR removes the histogram and summary metric types. We may add them back in the future.

Also, this PR completely removes the time_series_metric mapping parameter from the histogram field type and only allows the gauge metric type for aggregate_metric_double fields.
2022-09-09 15:04:30 +03:00
David Kilfoyle
2a44a8982f
[DOCS] Remove feature flag from TSDS docs (#89673)
* Docs: Remove feature flag and add preview label to TSDS docs

* Fix technical preview tag
2022-08-29 10:33:55 -04:00
Martijn van Groningen
6ca2e796a9
Added additional index.look_ahead_time validation (#87847)
Added a requirement that index.look_ahead_time index setting
can't be lower than time_series.poll_interval setting.

Additional changes:
* Fixed a mistake in the docs that referenced indices.lifecycle.poll_interval
  instead of time_series.poll_interval.
* Moved index.look_ahead_time setting to data stream module.
2022-06-21 10:50:33 +02:00
David Kilfoyle
40e9f3097c
[DOCS] Add TSDS docs, take two (#87703)
* Revert "Revert "[DOCS] Add TSDS docs (#86905)" (#87702)"

This reverts commit 0c86d7b9b2.

* First fix to tests

* Add data_stream object to index template

* small rewording

* Add enable data stream object in gradle example setup

* Add bullet about data stream must be enabled in template
2022-06-16 12:44:10 -04:00
David Kilfoyle
0c86d7b9b2
Revert "[DOCS] Add TSDS docs (#86905)" (#87702)
Reverts elastic/elasticsearch#86905
2022-06-15 13:32:12 -04:00
David Kilfoyle
d57f4ac2c6
[DOCS] Add TSDS docs (#86905)
* [DOCS] Add TSDB docs

* Update docs/build.gradle

Co-authored-by: Adam Locke <adam.locke@elastic.co>

* Address Nik's comments, part 1

* Address Nik's comments, part deux

* Reword write index

* Add feature flags

* Wrap one more section in feature flag

* Small fixes

* set index.routing_path to optional

* Update storage reduction value

* Update create index template code example

Co-authored-by: James Rodewig <40268737+jrodewig@users.noreply.github.com>
Co-authored-by: Adam Locke <adam.locke@elastic.co>
2022-06-15 12:22:07 -04:00
James Rodewig
6c8f0b170b
[DOCS] Fix ordered list formatting in data stream docs (#81667) 2021-12-13 12:53:48 -05:00
Martijn van Groningen
e20fe6d639
Add replicated field to get data stream api response. (#80988)
Internally we already kept track of whether a data stream is replicated by CCR.
It is part of the `DataStream` class. This just adds it to the xcontent serialization
of the get data stream api response class.

Relates to elastic/kibana#118899
2021-11-30 09:30:05 +01:00
Dan Hermann
1a0ae11f0d
[DOCS] Data stream modification API (#80094) 2021-11-10 08:37:12 -06:00
Dan Hermann
4a36d5cd79
Remove endpoint for freezing indices (#78918) 2021-10-26 06:37:56 -05:00
James Rodewig
58abbe941f
[DOCS] Fix cluster update settings refs (#79580)
The API is named 'cluster update settings,' not 'update cluster settings.'
2021-10-20 13:16:35 -04:00
Nikola Grcevski
055c770083
Deprecation of transient cluster settings (#78794)
This PR changes uses of transient cluster settings to
persistent cluster settings. 

The PR also deprecates the transient settings usage.

Relates to #49540
2021-10-15 13:00:52 -04:00
xiaoping
7e08c6b98a
Data stream support read and write with custom routing and partition size (#74394) 2021-10-11 07:14:15 -05:00
Joe Gallo
4a14f2f6f9
Validate that snapshot repository exists for ILM policies at creation/update time (#78468) 2021-10-04 15:19:10 -04:00
James Rodewig
e246e1ce53
[DOCS] Remove 'step' from headings (#76753) 2021-08-20 08:52:04 -04:00
James Rodewig
0c205b0d68
[DOCS] Document how to switch ILM policies (#73967)
To switch an index's lifecycle policy, you must first remove the existing
policy. Otherwise, phase execution for the index may silently fail.

Closes #70151
2021-06-28 10:32:01 -04:00
James Rodewig
5729bb8d49
[DOCS] Update alias references (#73427)
Updates several `index aliases` references to `aliases`.
2021-05-27 16:00:57 -04:00
James Rodewig
39a0314d30
[DOCS] Update alias xrefs (#73380)
Updates several internal 'alias' xrefs to point to the aliases guide rather than
API docs.
2021-05-25 16:19:00 -04:00
James Rodewig
b3a197715e
[DOCS] Update allowed operations on data stream write index (#72994)
With #70908, you can now close a write index in 7.12.1 and later versions.
This removes an outdated reference from the data stream overview docs.
2021-05-12 14:26:22 -04:00
Jay Modi
a7dbb31765
Add Fleet action results system data stream (#71667)
This commit adds support for system data streams and also the first use
of a system data stream with the fleet action results data stream. A
system data stream is one that is used to store system data that users
should not interact with directly. Elasticsearch will manage these data
streams. REST API access is available for external system data streams
so that other stack components can store system data within a system
data stream. System data streams will not use the system index read and
write threadpools.
2021-04-20 13:33:12 -06:00
James Rodewig
c23f001151
[DOCS] Add how-to guide for time series data (#71195) 2021-04-05 13:00:06 -04:00
James Rodewig
4963118fcc
[DOCS] Update button copy (#71220) 2021-04-02 09:06:50 -04:00
James Rodewig
3c02ab4190
[DOCS] Add ECS and runtime fields tip to data stream tutorial (#71183) 2021-04-01 15:54:53 -04:00
James Rodewig
115d2b2680 [DOCS] Reword data stream indexing section 2021-04-01 10:23:48 -04:00
James Rodewig
a4fa22c099 [DOCS] Reword link to Fleet data stream docs 2021-04-01 10:15:56 -04:00
James Rodewig
f41320616c
[DOCS] Refactor data stream setup tutorial (#71074) 2021-03-31 17:28:55 -04:00