Commit graph

593 commits

Author SHA1 Message Date
Hannah Mudge
e0ea600d54
Add group 6 to FTR config (#132655) 2022-05-20 13:55:31 -07:00
Spencer
3effa893da
[ci] always supply defaults for parallelism vars (#132520) 2022-05-19 09:28:47 -05:00
Vitalii Dmyterko
d2b61738e2
[Security solution]Dynamic split of cypress tests (#125986)
- adds `parallelism: 4` for security_solution cypress buildkite pipeline
- added parsing /integrations folder with cypress tests, to retrieve paths to individual test files using `glob` utility
- list of test files split equally between agents(there are approx 70+ tests files, split ~20 per job with **parallelism=4**)
- small refactoring of existing cypress runners for `security_solution`

Old metrics(before @MadameSheema https://github.com/elastic/kibana/pull/127558 performance improvements):
before split: average time of completion ~ 1h 40m for tests, 1h 55m for Kibana build
after split in 4 chunks: chunk completion between 20m - 30m, Kibana build 1h 20m

**Current metrics:**
before split: average time of completion ~ 1h for tests, 1h 10m for Kibana build
after split in 4 chunks: each chunk completion between 10m - 20m, 1h Kibana build 1h
2022-05-19 15:09:31 +01:00
Jonathan Budzenski
4ada2066e3
[es snapshots] Skip cloud build errors (#132469) 2022-05-18 15:58:18 -05:00
Brian Seeders
dac92b2b84
[CI] Move PR skippable changes to pr-bot config (#132461) 2022-05-18 15:21:47 -04:00
Jonathan Budzenski
3409ea325f
[artifacts] Verify docker UBI context (#132346)
* [artifacts] Verify docker UBI context

* add step

* fix filename
2022-05-18 09:21:13 -05:00
spalger
1d69e5e761 add comment about "secret" committed to source 2022-05-18 08:41:53 -05:00
Spencer
63fd2dd552
[kbn/es] capture es debug files (#132355)
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2022-05-17 17:23:13 -05:00
Jonathan Budzenski
e401c41e78
[artifacts/staging] Skip docker cloud verification (#132348)
Cloud builds should be skipped pending implementation of phase 2 of
daily releasable artifacts.
2022-05-17 11:22:08 -07:00
Søren Louv-Jansen
dc1bd86ad3
[APM] Fix cypress —open (#132326) 2022-05-17 07:15:14 -07:00
Jonathan Budzenski
4cfa1c8ac2
[artifacts] Enable Cloud smoke tests (#132158)
* [artifacts] Enable Cloud smoke tests

* login selection for cloud

* fix config path

* fix protocol

* fix url

* cleanup

* fix syntax

* logs

* fix username

* update

* -r

* revert unused
2022-05-16 15:00:07 -05:00
Spencer
e474e9460d
[ci] support skip:auto-commit label on CI (#132138)
Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
2022-05-12 17:00:57 -05:00
Jonathan Budzenski
7e5fc82674
[artifacts] Only upload beats artifacts if they exist (#132136)
* [artifacts] Only upload beats artifacts if they exist

Beats artifacts are downloaded as a side effect  of building the cloud
image.  At times (e.g. a staging build, where we don't have the correct
sha) we may skip the cloud image build and these artifacts will not be
available to upload.

* Update .buildkite/scripts/steps/artifacts/build.sh

Co-authored-by: Spencer <email@spalger.com>

Co-authored-by: Spencer <email@spalger.com>
2022-05-12 13:58:32 -05:00
Spencer
eda92d49e0
[precommit-hook] autofix precommit check failures on CI (#132141)
Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
2022-05-12 12:01:28 -05:00
Jonathan Budzenski
179cf309ec
[artifacts testing] Re-enable FTR smoke tests (#132076)
* [artifacts testing] Re-enable FTR smoke tests

* --quiet

* docker disable chromium sandbox

* newline
2022-05-12 08:03:39 -07:00
Spencer
3670316789
[ci] bump kibana-buildkite-library (#132081) 2022-05-11 16:22:58 -07:00
Jonathan Budzenski
b16486a999
[artifacts] Test cloud context (#130394)
* [artifacts] Test cloud context

This artifact currently has no consumers, but in the near future the
release-manager will produce Cloud images using the context.  This
ensures builds are working before we publish artifacts.

* update permissions

* fix if statement

* DOCKER_CONTEXT -> KIBANA_DOCKER_CONTEXT
2022-05-11 12:03:40 -07:00
Brian Seeders
c21c8f7006
[bazel] Use a GCS bucket for local dev remote bazel cache (#131866) 2022-05-11 14:21:23 -04:00
Spencer
77896df877
bump kibana-buildkite-library (#131987) 2022-05-10 18:00:56 -05:00
Jonathan Budzenski
9044d1f76f [artifacts] skip smoke tests 2022-05-10 08:57:12 -05:00
Robert Oskamp
c79eb03319
[ML] Functional tests - split ML test groups (#131716)
This PR splits up the ML functional UI test groups and renames them to better match the contained test suites.
2022-05-09 17:22:03 +02:00
Spencer
ee846edf07
[ci] bump kibana-buildkite-library (#131754) 2022-05-06 13:24:24 -05:00
Spencer
c8624cdd98
[ci] break out skip patterns so they can change without triggering CI (#131726) 2022-05-06 10:48:41 -05:00
Lee Drengenberg
0998b67ded
exclude "Team:Unified observability" from Kibana QA team PR list (#131673)
* exclude "Team:Unified observability"

* exclude "Feature:Unified Integrations"

* exclude "Team: AWP: Visualization"

* skip config file in ci

Co-authored-by: spalger <spencer@elastic.co>
2022-05-06 08:44:56 -05:00
Stratoula Kalafateli
0d4cc4dc32
[Unified search] Improves the current filter/search experience (#128401)
* [Unified search] Moves dataview picker to the search bar (#126560)

* [Unified search] Moves dataview picker to the search bar

* alter texts

* Remove unused file

* [ChangeDataView] Design cleanup

* Fix services mock failure

* Show newly created datavuew on the list

* Keep dataview picker in discover in mobile view

* Cleanup

* Cleanup translations

* Fix some discover FTs

* Fix management FTs

* More test fixes

* Added a dismissible tour

* Pulled the selectabl list into a new component

… for reuse

Called `DataViewsList`. I then changed Lens’ config panel’s own EuiSelectableList to use this new component instead.

*Didn’t do any test updates*

* Fix broken jest test

* Use the same picker component on Discover mobile view

* Apply some CI fixes

* Fix more functional tests

* More FTs fixes

* Close the tour popover for lens tests

* More FTs fixes

* Fix lens FTs

* Using new `styles.ts` pattern for custom styles and allowing for `fullWidth` buttons

* Better tour text and i18n

* Update copy

* No exclamation point

* Cleanup

* Fixes on discover tests

* Fixes on Lens Fts - create runtime fields

* Fixes on edit permission of add field in discover and some FTs fixes

* Further Fts fixes

* More FTs fixes

* Made tour opt-in with `showNewMenuTour`

* Refactor the OSS FTs to change less files

* Further cleanup on the FTs

* Remove unecessary action

* Fix dataview creation bug

* Add a unit test to the new component

* More fixes

* Fix OSS a11y tests

* Adds another unit test for Lens permissions

* Make a change to stabilize the tests

* Clear flyout prop as it is not used anymore

* Deisgn fixes for mobile view

* Address PR comments WIP

* Update the layrpanl dataview list when a new dataview is created

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
Co-authored-by: cchaos <caroline.horn@elastic.co>
Co-authored-by: Caroline Horn <549577+cchaos@users.noreply.github.com>

* fix test

* Fix CI

* Fix i18n checks

* [Unified search] Redesign search bar (#126566)

* [Unified search] Redesign search bar

* Changes to the saved queries design

* Remove `globalQueryBar` from nested under `.kbnTopNavMenu__wrapper`

* [Security Solution] Removing overrides of `.globaQueryBar`

* Cleanup of `.globalQueryBar` styles and variants

* General layout fixes/adjustments

* More general layout fixes and better defaults

* Enable Clear all button if saved query is applied

* Clear should be enabled if searched query is applied but not the save as new

* fix some bugs on enabling and disabling the menu options

* [design] Working on Load Filter set menu

* Indicate selection even before the user clicks apply

* prettify the time text

* Add delete saved qquery confirmation modal

* Some cleaning up

* Fix the manage saved queries link

* Enable load filter set if saved query is created for the first time

* Some fixes on linting and on translations

* Clanup scss

* Make some fixes

* Fix navigatation unit test

* Fix translations check

* Fix rest jest tests

* Fix some functional tests

* Fix checks

* Fixes the appearance of the searchbar components depending on the flags

* Fix OSS tests

* Fixes on tests and query bar logic

* Fix the OSS ally tests

* Fix graph and lens KQL bar display problems, apply saveQuery flag correctly

* Fix more tests

* Fix security solution test

* Undo tweaks for graph

* Better fix for Graph

- Emulate new look, not old
- Uses same context menu panel as the new one
- Provides the same button type (filter button)

* Fix checks and jest test

* Further fixes

* Fix language switcher test

* Hopefully fixes the rest of the solution tests

* Cleanup

* Fixes on maps filtering

* Fix Discover padding

* [Discover] Added New Field button to bottom of fields list

* Simple responsive behavior

* Quick filter updates

* CI fixes

* area-label fix

* 18n translate the add filed btn in discover

* Fix lens functional test

* fix functional tests

* Refactor and add unit test for the add filter button

* Add unit test to the saved management list component

* Stabilize lens test

* Second try to solve the flakiness

* Fix panels depending on the flags

* Fix jest tests

* Fix double menu when only the queryInput is on

* Add storybook for the different layouts of the unified search bar

* Fix ci checks

* Removee hooks comment

* Fix flakiness

* Fix problem with lens dataview change

* Fix checks

* Ensure that the query is submitted

* Fixes oon CI

* Fixes flakiness

* Fix checks CI

* Update texts

* Cleanup

* Fix unskipped funtional test

* Fix FT

* Update src/plugins/unified_search/public/saved_query_form/save_query_form.tsx

Co-authored-by: gchaps <33642766+gchaps@users.noreply.github.com>

* Fix eslint

* Fix checks

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
Co-authored-by: cchaos <caroline.horn@elastic.co>
Co-authored-by: Caroline Horn <549577+cchaos@users.noreply.github.com>
Co-authored-by: gchaps <33642766+gchaps@users.noreply.github.com>

* Fix jest

* Fix jest tests

* Stabilize discover security tests

* [Unified search] Further enhancements (#129877)

* [Unified search] Redesign search bar

* Changes to the saved queries design

* Remove `globalQueryBar` from nested under `.kbnTopNavMenu__wrapper`

* [Security Solution] Removing overrides of `.globaQueryBar`

* Cleanup of `.globalQueryBar` styles and variants

* General layout fixes/adjustments

* More general layout fixes and better defaults

* Enable Clear all button if saved query is applied

* Clear should be enabled if searched query is applied but not the save as new

* fix some bugs on enabling and disabling the menu options

* [design] Working on Load Filter set menu

* Indicate selection even before the user clicks apply

* prettify the time text

* Add delete saved qquery confirmation modal

* Some cleaning up

* Fix the manage saved queries link

* Enable load filter set if saved query is created for the first time

* Some fixes on linting and on translations

* Clanup scss

* Make some fixes

* Fix navigatation unit test

* Fix translations check

* Fix rest jest tests

* Fix some functional tests

* Fix checks

* Fixes the appearance of the searchbar components depending on the flags

* Fix OSS tests

* Fixes on tests and query bar logic

* Fix the OSS ally tests

* Fix graph and lens KQL bar display problems, apply saveQuery flag correctly

* Fix more tests

* Fix security solution test

* Undo tweaks for graph

* Better fix for Graph

- Emulate new look, not old
- Uses same context menu panel as the new one
- Provides the same button type (filter button)

* Fix checks and jest test

* Further fixes

* Fix language switcher test

* Hopefully fixes the rest of the solution tests

* Cleanup

* Fixes on maps filtering

* Fix Discover padding

* [Discover] Added New Field button to bottom of fields list

* Simple responsive behavior

* Quick filter updates

* CI fixes

* area-label fix

* 18n translate the add filed btn in discover

* Fix lens functional test

* fix functional tests

* Refactor and add unit test for the add filter button

* Add unit test to the saved management list component

* Stabilize lens test

* Second try to solve the flakiness

* Fix panels depending on the flags

* Fix jest tests

* Fix double menu when only the queryInput is on

* Add storybook for the different layouts of the unified search bar

* Fix ci checks

* Removee hooks comment

* Fix flakiness

* Fix problem with lens dataview change

* Fix checks

* Ensure that the query is submitted

* Fixes oon CI

* Fixes flakiness

* Fix checks CI

* Update texts

* Cleanup

* Fix unskipped funtional test

* Fix FT

* Fixes filter bar responsiveness

* Add filter button option to the main menu

* Filter form design pass

- Added tooltip around “Add filter” icon button
- Fixed padding
- Stubbed in “Add” vs “Edit” labels

* Query menu icon button tooltip

* ‘Update’ not ‘Edit’ button label

* Apply different strings for adding filter mode vs edit

* Hide Manage SO link if the user donesnt have the permissions

* Fix the wrapping of the badges and datepicker badge

* Minor props naming fix

* Fix checks

* Fix mobile

* Cleanup

* Fix checks

* Faux button group

* Changes on the search input placeholder

* Fix CI

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
Co-authored-by: cchaos <caroline.horn@elastic.co>
Co-authored-by: Caroline Horn <549577+cchaos@users.noreply.github.com>

* Fix translations

* Fix security solution add filter bug

* Filter bar / items: Reduce to only necessary wrappers and styles

- Switch to Emotion for styling
- Rename `FilterBadgesWrapper` to `FilterItems`
- Move `FilterItems` and `FilterItem` so own folder `filter_item/`

# Conflicts:
#	src/plugins/unified_search/public/filter_bar/filter_bar.tsx
#	src/plugins/unified_search/public/filter_bar/filter_editor/lib/filter_label.tsx
#	src/plugins/unified_search/public/filter_bar/filter_item/filter_item.tsx
#	src/plugins/unified_search/public/filter_bar/filter_item/filter_items.tsx
#	src/plugins/unified_search/public/filter_bar/filter_view/index.tsx
#	src/plugins/unified_search/public/query_string_input/filter_editor_wrapper.tsx
#	src/plugins/unified_search/public/search_bar/search_bar.tsx

* Fix styles by removing styled-components

Also added prop `afterQueryBar` to signify that it needs the top margin

# Conflicts:
#	packages/kbn-babel-preset/styled_components_files.js

* Refactor `SearchBar` and `QueryBarTopRow` a bit

- Added `showSubmitButton` to explicitely hide the submit button (defaults to true)
- SearchBar always renders the `QueryBarTopRow` which now fully controls visibility of the pieces
- Renamed class with new `uni` prefix
- Tried and failed to use Emotion

* Update usages

# Conflicts:
#	x-pack/plugins/security_solution/public/common/components/query_bar/index.tsx

* Fix a test

* Fix jest test

* Attaches filter menu when no add button and better dropdown styles

* Fix lint errors

* Clearing the query and filters of a saved query should unload the saved query

* Do not allow to update the loaded saved query if no filters or no query

* Fix Graph by creating reusable `KibanaFilterButtonGroup`

* Use EuiTheme for SearchBar styles

Updated `displayStyle` for Lens & Discover

* Fix displayStyle prop problem

* Correct alignment of data visualizer

* Super nit comment

* Data visualizer improvements

* Apply useMemo in editPermission cont in Discover

* Fix translations checks

* Fix translations checks

* Fix filter badge popover bug

* [Submit button] Changed to EuiSuperUpdateButton

- Quickly adds tooltip content and filled state for more prominence when dirty
- Fixed 18n

* Fix tests

* Align the position with the other tolltips and check that functional tests succeed

* Give some time to the tooltip to disappear

* Fix tests

* Fix CI checks

* Address PR comments

* Move constants outside render

* Apply PR comments

* Fix dataview picker glich

* lovercase emotion function

* Fix a11y problem on dataview picker

* Lowercase rest of emotion style functions

* Clean up

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
Co-authored-by: cchaos <caroline.horn@elastic.co>
Co-authored-by: Caroline Horn <549577+cchaos@users.noreply.github.com>
Co-authored-by: gchaps <33642766+gchaps@users.noreply.github.com>
2022-05-06 10:10:01 +03:00
Dzmitry Lemechko
7f62a784df
[packages] add kbn-performance-testing-dataset-extractor (#131631) 2022-05-06 04:11:51 +02:00
Dominique Clarke
78b2241770
synthetics - fix test directory (#131655) 2022-05-05 16:17:09 -04:00
Spencer
af8810fede
[ci/test-groups] define scripts externally (#131645) 2022-05-05 14:46:50 -04:00
Brian Seeders
267c674d42
[CI] Split check types into its own step, use spot for checks (#131096) 2022-05-05 13:26:34 -04:00
Brian Seeders
25e3526358
[CI] Use node_modules cache baked into agent image (#131555) 2022-05-05 13:22:33 -04:00
Spencer
896b0e28dd
[ci] include test_group_env in more ci scripts (#131633) 2022-05-05 10:59:09 -05:00
Brian Seeders
4dd33a9009
[es-snapshots] Fix verify job dependencies after FTR configs change (#131640) 2022-05-05 11:41:07 -04:00
Dzmitry Lemechko
1d1e1f6430
[ci] extract apm traces after in single user benchmarking pipeline (#130777)
* [ci] extract apm traces after in single user benchmarking pipeline

* add performance-testing-dataset-extractor dependency

* use BUILD_ID for queries

* bump version for extractor, update script

* bump extractor version

* fix path

* upload artifacts to the public bucket
2022-05-05 09:44:11 +02:00
spalger
8d54b1547b include test_group_env when running saved_object_field_metrics.sh 2022-05-04 18:00:03 -05:00
spalger
0ea6374777 fix "Default Saved Object Field Metrics" task in main on-merge job 2022-05-04 17:42:04 -05:00
Spencer
542b381fa5
[ftr] automatically determine config run order (#130983)
* [ftr] automatically determine config run order

* split lens config into two groups

* support ftr configs always running against CI

* Split detection_engine_api_integration rule exception list tests

* Add configs from previous commit

* [ftr] remove testMetadata and maintain a unique lifecycle instance per run

* Revert "[ftr] remove testMetadata and maintain a unique lifecycle instance per run"

This reverts commit d2b4fdb824.

* Split alerting_api_integration/security_and_spaces tests

* Add groups to yaml

* Revert "Revert "[ftr] remove testMetadata and maintain a unique lifecycle instance per run""

This reverts commit 56232eea68.

* stop ES more forcefully and fix timeout

* only cleanup lifecycle phases when the cleanup is totally complete

* only use kill when cleaning up an esTestInstance

* fix broken import

* fix runOptions.alwaysUseSource implementation

* fix config access

* fix x-pack/ccs config

* fix ml import file paths

* update kibana build id

* revert array.concat() change

* fix baseConfig usage

* fix pie chart data

* split up maps tests

* pull in all of group5 so that es archives are loaded correctly

* add to ftr configs.yml

* fix pie chart data without breaking legacy version

* fix more pie_chart stuff in new vis lib

* restore normal PR tasks

* bump kibana-buildkite-library

* remove ciGroup validation

* remove the script which is no longer called from checks.sh

* [CI] Auto-commit changed files from 'yarn kbn run build -i @kbn/pm'

* adapt flaky test runner scripts to handle ftrConfig paths

* fix types in alerting_api_integration

* improve flaky config parsing and use non-local var name for passing explicit configs to ftr_configs.sh

* Split xpack dashboard tests

* Add configs

* [flaky] remove key from ftr-config steps

* [CI] Auto-commit changed files from 'node scripts/eslint --no-cache --fix'

* restore cypress builds

* remove ciGroups from FTR config files

* fixup some docs

* add temporary script to hunt for FTR config files

* use config.base.js naming for clarity

* use script to power ftr_configs.yml

* remove usage of removed x-pack/scripts/functional_tests

* fix test names in dashboard snapshots

* bump kibana-buildkite-library

* Try retrying only failed configs

* be a little quieter about trying to get testStats from configs with testRunners defined

* Remove test code

* bump kibana-buildkite-library

* update es_snapshot and on_merge jobs too

* track duration and exit code for each config and print it at the end of the script

* store results in order, rather than by key, in case there are duplicates in $config

* bash is hard

* fix env source and use +e rather than disabling e for whole file

* bash sucks

* print config summary in jest jobs too

* define results in jest_parallel.sh

* simplify config summary print, format times a little better

* fix reference to unbound time variable, use better variable name

* skip the newline between each result

* finish with the nitpicking

* sync changes with ftr_configs.sh

* refuse to execute config files which aren't listed in the .buildkite/ftr_configs.yml

* fix config.edge.js base config import paths

* fix some readmes

* resolve paths from ftr_configs manifest

* fix readConfigFile tests

* just allow __fixtures__ configs

* list a few more cypress config files

* install the main branch of kibana-buildkite-library

* split up lens group1

* move ml data_visualizer tests to their own config

* fix import paths

* fix more imports

* install specific commit of buildkite-pipeline-library

* sort configs in ftr_configs.yml

* bump kibana-buildkite-library

* remove temporary script

* fix env var for limiting config types

* Update docs/developer/contributing/development-functional-tests.asciidoc

Co-authored-by: Christiane (Tina) Heiligers <christiane.heiligers@elastic.co>

* produce a JUnit report for saved objects field count

* apply standard concurrency limits from flaky test runner

* support customizing FTR concurrency via the env

Co-authored-by: Brian Seeders <brian.seeders@elastic.co>
Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
Co-authored-by: Christiane (Tina) Heiligers <christiane.heiligers@elastic.co>
2022-05-04 17:05:58 -05:00
Spencer
1cdf0a45a6
[ci] hide browserslist outdated warnings (#131549) 2022-05-04 13:04:40 -05:00
Spencer
1a849dc2b6
[flaky-tests] require using the new UI to trigger (#131534) 2022-05-04 09:52:34 -07:00
Brian Seeders
3bc9c42485
[CI] Use GCS buckets for bazel remote caching (#131345) 2022-05-03 16:49:37 -04:00
Spencer
3295c9ffc7
changes to the nav-kibana-dev.docnav.json file are "docs only" (#131408) 2022-05-03 12:37:05 -05:00
Anton Dosov
e603d92552
Remove data_enhanced plugin (#122075)
Code moved into `data` plugin
2022-04-29 16:43:59 +02:00
Spencer
7327155dbc
[ci] validate that all tests are in a ciGroup (#131173)
* [ci] validate that all tests are in a ciGroup

* make new checks script executable

* skip failing suite
2022-04-28 15:41:17 -05:00
Gloria Hornero
8771527334
adding new dependencies (#125187) 2022-04-27 12:42:55 -07:00
Spencer
0b37272c8e
[jest] automatically determine run order (attempt 2) (#131091) 2022-04-27 11:18:15 -07:00
spalger
f149a17871 Revert "[jest] automatically determine run order (#130857)"
This reverts commit 1a05ce5cab.
2022-04-27 11:38:19 -05:00
Spencer
1a05ce5cab
[jest] automatically determine run order (#130857) 2022-04-27 11:10:47 -05:00
Brian Seeders
7ff1ffca5e
[CI] Split OSS CI Group 11 (#130927) 2022-04-26 13:07:32 -04:00
Dominique Clarke
dad4963bf0
Update synthetics.sh (#130940) 2022-04-26 08:42:50 -04:00
Spencer
fa7323769d
[jest] try running unit tests in parallel (#130823) 2022-04-21 16:37:06 -05:00
Brian Seeders
e3d221ed39
[CI] Bump kibana-buildkite-library for getPrChanges fix (#130824) 2022-04-21 13:38:59 -07:00