kibana/x-pack/scripts
Dario Gieselaar ec8bdf0054
[8.x] [Streams] Replay loghub data with synthtrace (#212120) (#214916)
# Backport

This will backport the following commits from `main` to `8.x`:
- [[Streams] Replay loghub data with synthtrace
(#212120)](https://github.com/elastic/kibana/pull/212120)

<!--- Backport version: 9.6.6 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sorenlouv/backport)

<!--BACKPORT [{"author":{"name":"Dario
Gieselaar","email":"dario.gieselaar@elastic.co"},"sourceCommit":{"committedDate":"2025-03-11T12:30:06Z","message":"[Streams]
Replay loghub data with synthtrace (#212120)\n\nDownload, parse and
replay loghub data with Synthtrace, for use in the\nStreams project. In
summary:\n\n- adds a `@kbn/sample-log-parser` package which parses
Loghub sample\ndata, creates valid parsers for extracting and replacing
timestamps,\nusing the LLM\n- add a `sample_logs` scenario which uses
the parsed data sets to replay\nLoghub data continuously as if it were
live data\n- refactor some parts of Synthtrace (follow-up work captured
in\nhttps://github.com/elastic/kibana/issues/212179)\n\n## Synthtrace
changes\n\n- Replace custom Logger object with Kibana-standard
ToolingLog\n- Report progress and estimated time to completion for
long-running jobs\n- Simplify scenarioOpts (allow comma-separated
key-value pairs instead\nof just JSON)\n- Simplify client
initialization\n- When using workers, only bootstrap once (in the main
thread)\n- Allow workers to gracefully shutdown\n- Downgrade some
logging levels for less noise\n\n---------\n\nCo-authored-by:
kibanamachine
<42973632+kibanamachine@users.noreply.github.com>","sha":"ba13e86a70c331275d40ed8f84c3f264845afc6e","branchLabelMapping":{"^v9.1.0$":"main","^v8.19.0$":"8.x","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","backport
missing","v9.0.0","ci:project-deploy-observability","Team:obs-ux-infra_services","backport:version","Feature:Streams","v9.1.0","v8.19.0"],"title":"[Streams]
Replay loghub data with
synthtrace","number":212120,"url":"https://github.com/elastic/kibana/pull/212120","mergeCommit":{"message":"[Streams]
Replay loghub data with synthtrace (#212120)\n\nDownload, parse and
replay loghub data with Synthtrace, for use in the\nStreams project. In
summary:\n\n- adds a `@kbn/sample-log-parser` package which parses
Loghub sample\ndata, creates valid parsers for extracting and replacing
timestamps,\nusing the LLM\n- add a `sample_logs` scenario which uses
the parsed data sets to replay\nLoghub data continuously as if it were
live data\n- refactor some parts of Synthtrace (follow-up work captured
in\nhttps://github.com/elastic/kibana/issues/212179)\n\n## Synthtrace
changes\n\n- Replace custom Logger object with Kibana-standard
ToolingLog\n- Report progress and estimated time to completion for
long-running jobs\n- Simplify scenarioOpts (allow comma-separated
key-value pairs instead\nof just JSON)\n- Simplify client
initialization\n- When using workers, only bootstrap once (in the main
thread)\n- Allow workers to gracefully shutdown\n- Downgrade some
logging levels for less noise\n\n---------\n\nCo-authored-by:
kibanamachine
<42973632+kibanamachine@users.noreply.github.com>","sha":"ba13e86a70c331275d40ed8f84c3f264845afc6e"}},"sourceBranch":"main","suggestedTargetBranches":["9.0","8.x"],"targetPullRequestStates":[{"branch":"9.0","label":"v9.0.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"main","label":"v9.1.0","branchLabelMappingKey":"^v9.1.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/212120","number":212120,"mergeCommit":{"message":"[Streams]
Replay loghub data with synthtrace (#212120)\n\nDownload, parse and
replay loghub data with Synthtrace, for use in the\nStreams project. In
summary:\n\n- adds a `@kbn/sample-log-parser` package which parses
Loghub sample\ndata, creates valid parsers for extracting and replacing
timestamps,\nusing the LLM\n- add a `sample_logs` scenario which uses
the parsed data sets to replay\nLoghub data continuously as if it were
live data\n- refactor some parts of Synthtrace (follow-up work captured
in\nhttps://github.com/elastic/kibana/issues/212179)\n\n## Synthtrace
changes\n\n- Replace custom Logger object with Kibana-standard
ToolingLog\n- Report progress and estimated time to completion for
long-running jobs\n- Simplify scenarioOpts (allow comma-separated
key-value pairs instead\nof just JSON)\n- Simplify client
initialization\n- When using workers, only bootstrap once (in the main
thread)\n- Allow workers to gracefully shutdown\n- Downgrade some
logging levels for less noise\n\n---------\n\nCo-authored-by:
kibanamachine
<42973632+kibanamachine@users.noreply.github.com>","sha":"ba13e86a70c331275d40ed8f84c3f264845afc6e"}},{"branch":"8.x","label":"v8.19.0","branchLabelMappingKey":"^v8.19.0$","isSourceBranch":false,"state":"NOT_CREATED"}]}]
BACKPORT-->

---------

Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2025-03-19 10:57:02 +01:00
..
api_debug.js
data_forge.js [Dev] Add High Cardinality Indexer to Kibana as kbn-data-forge (#174559) 2024-01-23 16:32:09 -07:00
functional_test_runner.js
functional_tests_server.js
jest.js [Security solution] Add field validation to data views on Network map (#147899) 2023-01-10 12:22:54 -07:00
sample_log_parser.js [8.x] [Streams] Replay loghub data with synthtrace (#212120) (#214916) 2025-03-19 10:57:02 +01:00
synthetics_private_location.js [Synthetics] add synthetics-private-location command (#189531) 2024-08-09 07:02:02 -04:00