Commit graph

15 commits

Author SHA1 Message Date
Kibana Machine
ed40c16ce9
[8.6] [ML] Adds anomaly alerts screenshot test suite (#146552) (#146861)
# Backport

This will backport the following commits from `main` to `8.6`:
- [[ML] Adds anomaly alerts screenshot test suite
(#146552)](https://github.com/elastic/kibana/pull/146552)

<!--- Backport version: 8.9.7 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sqren/backport)

<!--BACKPORT [{"author":{"name":"István Zoltán
Szabó","email":"szabosteve@gmail.com"},"sourceCommit":{"committedDate":"2022-12-02T10:01:51Z","message":"[ML]
Adds anomaly alerts screenshot test suite (#146552)\n\n##
Summary\r\n\r\nThis PR adds a new test suite to the screenshot creation
script that\r\ncovers the screenshots on [Generating alerts for anomaly
detection\r\njobs](https://www.elastic.co/guide/en/machine-learning/master/ml-configuring-alerts.html).","sha":"475e47ed993fba0ecd69caa211150f298e1eefe4","branchLabelMapping":{"^v8.7.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":[":ml","release_note:skip","v8.6.0","v8.7.0","v8.5.3"],"number":146552,"url":"https://github.com/elastic/kibana/pull/146552","mergeCommit":{"message":"[ML]
Adds anomaly alerts screenshot test suite (#146552)\n\n##
Summary\r\n\r\nThis PR adds a new test suite to the screenshot creation
script that\r\ncovers the screenshots on [Generating alerts for anomaly
detection\r\njobs](https://www.elastic.co/guide/en/machine-learning/master/ml-configuring-alerts.html).","sha":"475e47ed993fba0ecd69caa211150f298e1eefe4"}},"sourceBranch":"main","suggestedTargetBranches":["8.6","8.5"],"targetPullRequestStates":[{"branch":"8.6","label":"v8.6.0","labelRegex":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"main","label":"v8.7.0","labelRegex":"^v8.7.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/146552","number":146552,"mergeCommit":{"message":"[ML]
Adds anomaly alerts screenshot test suite (#146552)\n\n##
Summary\r\n\r\nThis PR adds a new test suite to the screenshot creation
script that\r\ncovers the screenshots on [Generating alerts for anomaly
detection\r\njobs](https://www.elastic.co/guide/en/machine-learning/master/ml-configuring-alerts.html).","sha":"475e47ed993fba0ecd69caa211150f298e1eefe4"}},{"branch":"8.5","label":"v8.5.3","labelRegex":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}]
BACKPORT-->

Co-authored-by: István Zoltán Szabó <szabosteve@gmail.com>
2022-12-02 04:10:06 -07:00
Kibana Machine
e5e68c6c16
[8.6] Update Elastic Package Registry distribution docker image for V2 (#146673) (#146684)
# Backport

This will backport the following commits from `main` to `8.6`:
- [Update Elastic Package Registry distribution docker image for V2
(#146673)](https://github.com/elastic/kibana/pull/146673)

<!--- Backport version: 8.9.7 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sqren/backport)

<!--BACKPORT [{"author":{"name":"Mario Rodriguez
Molins","email":"mario.rodriguez@elastic.co"},"sourceCommit":{"committedDate":"2022-11-30T13:19:32Z","message":"Update
Elastic Package Registry distribution docker image for V2
(#146673)\n\n## Summary\r\n\r\nUpdate the docker image used as Elastic
Package Registry distribution\r\nfor Package Storage V2, so it contains
the latest packages published.\r\n\r\nTested updating
fleet_packages.json to use endpoint version 8.6.0
(and\r\nreverted).","sha":"c6c612ef81ed7c11d3b0a39ea6d3579e7bd6cabe","branchLabelMapping":{"^v8.7.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","Team:Fleet","backport:prev-minor","v8.7.0"],"number":146673,"url":"https://github.com/elastic/kibana/pull/146673","mergeCommit":{"message":"Update
Elastic Package Registry distribution docker image for V2
(#146673)\n\n## Summary\r\n\r\nUpdate the docker image used as Elastic
Package Registry distribution\r\nfor Package Storage V2, so it contains
the latest packages published.\r\n\r\nTested updating
fleet_packages.json to use endpoint version 8.6.0
(and\r\nreverted).","sha":"c6c612ef81ed7c11d3b0a39ea6d3579e7bd6cabe"}},"sourceBranch":"main","suggestedTargetBranches":[],"targetPullRequestStates":[{"branch":"main","label":"v8.7.0","labelRegex":"^v8.7.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/146673","number":146673,"mergeCommit":{"message":"Update
Elastic Package Registry distribution docker image for V2
(#146673)\n\n## Summary\r\n\r\nUpdate the docker image used as Elastic
Package Registry distribution\r\nfor Package Storage V2, so it contains
the latest packages published.\r\n\r\nTested updating
fleet_packages.json to use endpoint version 8.6.0
(and\r\nreverted).","sha":"c6c612ef81ed7c11d3b0a39ea6d3579e7bd6cabe"}}]}]
BACKPORT-->

Co-authored-by: Mario Rodriguez Molins <mario.rodriguez@elastic.co>
2022-11-30 07:30:20 -07:00
Kibana Machine
82bf59b272
[8.6] [UA] fix flaky test (#146351) (#146441)
# Backport

This will backport the following commits from `main` to `8.6`:
- [[UA] fix flaky test
(#146351)](https://github.com/elastic/kibana/pull/146351)

<!--- Backport version: 8.9.7 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sqren/backport)

<!--BACKPORT [{"author":{"name":"Ahmad
Bamieh","email":"ahmad.bamyeh@elastic.co"},"sourceCommit":{"committedDate":"2022-11-28T16:52:15Z","message":"[UA]
fix flaky test (#146351)\n\nCo-authored-by: kibanamachine
<42973632+kibanamachine@users.noreply.github.com>\r\nCloses
https://github.com/elastic/kibana/issues/144885","sha":"ab8dd04073a4f9b8bcf26444f35a33d85f98b600","branchLabelMapping":{"^v8.7.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","v8.6.0","v8.7.0","8.6.1"],"number":146351,"url":"https://github.com/elastic/kibana/pull/146351","mergeCommit":{"message":"[UA]
fix flaky test (#146351)\n\nCo-authored-by: kibanamachine
<42973632+kibanamachine@users.noreply.github.com>\r\nCloses
https://github.com/elastic/kibana/issues/144885","sha":"ab8dd04073a4f9b8bcf26444f35a33d85f98b600"}},"sourceBranch":"main","suggestedTargetBranches":["8.6"],"targetPullRequestStates":[{"branch":"8.6","label":"v8.6.0","labelRegex":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"main","label":"v8.7.0","labelRegex":"^v8.7.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/146351","number":146351,"mergeCommit":{"message":"[UA]
fix flaky test (#146351)\n\nCo-authored-by: kibanamachine
<42973632+kibanamachine@users.noreply.github.com>\r\nCloses
https://github.com/elastic/kibana/issues/144885","sha":"ab8dd04073a4f9b8bcf26444f35a33d85f98b600"}}]}]
BACKPORT-->

Co-authored-by: Ahmad Bamieh <ahmad.bamyeh@elastic.co>
2022-11-28 10:56:36 -07:00
Kibana Machine
a8164ed83c
[8.6] [DOCS] Automate connector-listing.png (#143605) (#145659)
# Backport

This will backport the following commits from `main` to `8.6`:
- [[DOCS] Automate connector-listing.png
(#143605)](https://github.com/elastic/kibana/pull/143605)

<!--- Backport version: 8.9.7 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sqren/backport)

<!--BACKPORT [{"author":{"name":"Lisa
Cawley","email":"lcawley@elastic.co"},"sourceCommit":{"committedDate":"2022-11-18T01:08:41Z","message":"[DOCS]
Automate connector-listing.png (#143605)\n\nCo-authored-by: Robert
Oskamp
<traeluki@gmail.com>","sha":"31ca6447332e52e502f0ed3645ebb02f054807c7","branchLabelMapping":{"^v8.7.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","Team:ResponseOps","docs","v8.6.0","v8.5.1","v8.7.0"],"number":143605,"url":"https://github.com/elastic/kibana/pull/143605","mergeCommit":{"message":"[DOCS]
Automate connector-listing.png (#143605)\n\nCo-authored-by: Robert
Oskamp
<traeluki@gmail.com>","sha":"31ca6447332e52e502f0ed3645ebb02f054807c7"}},"sourceBranch":"main","suggestedTargetBranches":["8.6","8.5"],"targetPullRequestStates":[{"branch":"8.6","label":"v8.6.0","labelRegex":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.5","label":"v8.5.1","labelRegex":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"main","label":"v8.7.0","labelRegex":"^v8.7.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/143605","number":143605,"mergeCommit":{"message":"[DOCS]
Automate connector-listing.png (#143605)\n\nCo-authored-by: Robert
Oskamp
<traeluki@gmail.com>","sha":"31ca6447332e52e502f0ed3645ebb02f054807c7"}}]}]
BACKPORT-->

Co-authored-by: Lisa Cawley <lcawley@elastic.co>
2022-11-17 19:46:30 -07:00
John Dorlus
f5acf76351
CCS Smoke Test for Remote Clusters and Index Management (#142423)
* Removed comment of the issue that was referenced for the skip. But the tests were already skipped.

* Added initial tests and page objects for remtoe clusters.

* [CI] Auto-commit changed files from 'node scripts/eslint --no-cache --fix'

* Fixed the test and test names.

* removed exclusive suite.

* [CI] Auto-commit changed files from 'node scripts/eslint --no-cache --fix'

* Fixed i18n issue.

* [CI] Auto-commit changed files from 'node scripts/eslint --no-cache --fix'

* Added more testing stuff.

* [CI] Auto-commit changed files from 'node scripts/precommit_hook.js --ref HEAD~1..HEAD --fix'

* Added more testing stuff.

* [CI] Auto-commit changed files from 'node scripts/precommit_hook.js --ref HEAD~1..HEAD --fix'

* Added test and stuff.

* [CI] Auto-commit changed files from 'node scripts/precommit_hook.js --ref HEAD~1..HEAD --fix'

* Fixed the tests. The only things to update now are the permissions so we stop using super user and also need to fix the cleanup.

* [CI] Auto-commit changed files from 'node scripts/eslint --no-cache --fix'

* Fixed accessibility test to use new ccr page function.

* Fixed an error in checks.

* Restored original settings.

* Adjusted cleanup.

* Removed exclusive suite.

* Removed unused variable.

* Removed unused variable.

* Working with perms.

* Fixes per comments in PR.

* added follower index user.

* [CI] Auto-commit changed files from 'node scripts/precommit_hook.js --ref HEAD~1..HEAD --fix'

* Added comment about super user issue.

* Removed the console.log.

* Fixed nits per PR.

* Removed extra assertion.

Co-authored-by: cuffs <cuffs@cuffss-Office-MacBook-Pro.local>
Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
2022-11-01 01:14:21 -04:00
Yulia Čech
ebc8bfe50b
[Guided onboarding] Removed plugin config (#143354)
* [Guided onboarding] Removed the config that hide the guided onboarding by default in 8.5

* [Guided onboarding] Fixed types errors

* [Guided onboarding] For now deleted the guide button when there is no active guide to pass CI

* [Guided onboarding] Skipping the disabled button tests for now

* [Guided onboarding] Deleted the configPath from kibana.json

* [Guided onboarding] Deleted the config from the tests

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2022-10-20 12:55:04 -04:00
Alison Goryachev
048b11d274
[Guided onboarding] Update observability tour (#143006) 2022-10-19 08:16:49 -04:00
Kyle Pollich
ff0edb4195
[Fleet] Update fleet_package.json + bump endpoint version to 8.4.0 (#138742)
* Update fleet_package.json + bump endpoint version

* Bump endpoint to 8.4.1

* Bump docker images

* Update docker image in Fleet FTR tests

* Try using production docker image

* Try using v2 docker image globally

* Re-enable bundled package test + exclude APM from verification

* Remove comment about failing test

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2022-08-16 15:28:59 -04:00
Shahzad
1b8236c768
[Fleet Synthetics] Upgrade to 0.10.2 (#138879) 2022-08-16 13:05:21 +01:00
Shahzad
e5aa1b46a6
[Fleet Synthetics] Upgrade to 0.10.1 (#137667)
* update to 0.10.1

* fix integeration test

* update policy test
2022-08-02 18:01:27 -04:00
Kyle Pollich
4e10f5cb87
Update pinned EPR docker image for 8.3.0 (#133300) 2022-06-02 09:16:55 -04:00
John Dorlus
302d40e2c7
Migrate security tests to use test user (#133076) 2022-06-01 12:49:25 -04:00
Stratoula Kalafateli
c05f891793
[Pie] Run all functional tests for the new implementation (#131700)
* [Pie] Run all functional tests for the new implementation

* Fix CI

* Fix tests

* More fixes

* More test foxes

* Fix a11y tests

* Further fies

* Fix

* Further fixes

* Final fixes

* Fix more pie related tests

* Fixes more fixes

* Fix dashboard tests

* Fix dashboard filtering test

* Fix the reporting tests

* BWC tests
2022-05-11 17:31:15 +03:00
Shahzad
3d947896aa
[Synthetics] Hide behind feature flag (#131502)
Co-authored-by: Colleen McGinnis <colleen.j.mcginnis@gmail.com>
Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
2022-05-06 13:44:38 +02:00
Spencer
542b381fa5
[ftr] automatically determine config run order (#130983)
* [ftr] automatically determine config run order

* split lens config into two groups

* support ftr configs always running against CI

* Split detection_engine_api_integration rule exception list tests

* Add configs from previous commit

* [ftr] remove testMetadata and maintain a unique lifecycle instance per run

* Revert "[ftr] remove testMetadata and maintain a unique lifecycle instance per run"

This reverts commit d2b4fdb824.

* Split alerting_api_integration/security_and_spaces tests

* Add groups to yaml

* Revert "Revert "[ftr] remove testMetadata and maintain a unique lifecycle instance per run""

This reverts commit 56232eea68.

* stop ES more forcefully and fix timeout

* only cleanup lifecycle phases when the cleanup is totally complete

* only use kill when cleaning up an esTestInstance

* fix broken import

* fix runOptions.alwaysUseSource implementation

* fix config access

* fix x-pack/ccs config

* fix ml import file paths

* update kibana build id

* revert array.concat() change

* fix baseConfig usage

* fix pie chart data

* split up maps tests

* pull in all of group5 so that es archives are loaded correctly

* add to ftr configs.yml

* fix pie chart data without breaking legacy version

* fix more pie_chart stuff in new vis lib

* restore normal PR tasks

* bump kibana-buildkite-library

* remove ciGroup validation

* remove the script which is no longer called from checks.sh

* [CI] Auto-commit changed files from 'yarn kbn run build -i @kbn/pm'

* adapt flaky test runner scripts to handle ftrConfig paths

* fix types in alerting_api_integration

* improve flaky config parsing and use non-local var name for passing explicit configs to ftr_configs.sh

* Split xpack dashboard tests

* Add configs

* [flaky] remove key from ftr-config steps

* [CI] Auto-commit changed files from 'node scripts/eslint --no-cache --fix'

* restore cypress builds

* remove ciGroups from FTR config files

* fixup some docs

* add temporary script to hunt for FTR config files

* use config.base.js naming for clarity

* use script to power ftr_configs.yml

* remove usage of removed x-pack/scripts/functional_tests

* fix test names in dashboard snapshots

* bump kibana-buildkite-library

* Try retrying only failed configs

* be a little quieter about trying to get testStats from configs with testRunners defined

* Remove test code

* bump kibana-buildkite-library

* update es_snapshot and on_merge jobs too

* track duration and exit code for each config and print it at the end of the script

* store results in order, rather than by key, in case there are duplicates in $config

* bash is hard

* fix env source and use +e rather than disabling e for whole file

* bash sucks

* print config summary in jest jobs too

* define results in jest_parallel.sh

* simplify config summary print, format times a little better

* fix reference to unbound time variable, use better variable name

* skip the newline between each result

* finish with the nitpicking

* sync changes with ftr_configs.sh

* refuse to execute config files which aren't listed in the .buildkite/ftr_configs.yml

* fix config.edge.js base config import paths

* fix some readmes

* resolve paths from ftr_configs manifest

* fix readConfigFile tests

* just allow __fixtures__ configs

* list a few more cypress config files

* install the main branch of kibana-buildkite-library

* split up lens group1

* move ml data_visualizer tests to their own config

* fix import paths

* fix more imports

* install specific commit of buildkite-pipeline-library

* sort configs in ftr_configs.yml

* bump kibana-buildkite-library

* remove temporary script

* fix env var for limiting config types

* Update docs/developer/contributing/development-functional-tests.asciidoc

Co-authored-by: Christiane (Tina) Heiligers <christiane.heiligers@elastic.co>

* produce a JUnit report for saved objects field count

* apply standard concurrency limits from flaky test runner

* support customizing FTR concurrency via the env

Co-authored-by: Brian Seeders <brian.seeders@elastic.co>
Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
Co-authored-by: Christiane (Tina) Heiligers <christiane.heiligers@elastic.co>
2022-05-04 17:05:58 -05:00
Renamed from x-pack/test/functional/config.js (Browse further)