## Summary
This PR attempts to fix config duration time warning
```
The following "Functional Tests" configs have durations that exceed the maximum amount of time desired for a single CI job. This is not an error, and if you don't own any of these configs then you can ignore this warning.If you own any of these configs please split them up ASAP and ask Operations if you have questions about how to do that.
x-pack/test/functional_basic/config.ts: 38.8 minutes
```
<img width="1188" alt="image"
src="https://user-images.githubusercontent.com/10977896/214912243-800a1c80-13fa-406b-93dd-0f5ab208cda9.png">
PR initially splits original test suite into 3 config files based on
area: permission, data visualizer and transform.
- x-pack/test/functional_basic/apps/ml/data_visualizer/config.ts
duration: **19m 24s** (left for later)
- x-pack/test/functional_basic/apps/transform/config.ts duration: **18m
14s** -> let's split in 5 configs
- x-pack/test/functional_basic/apps/ml/permissions/config.ts. duration:
5m 10s
2nd split round:
-
x-pack/test/functional_basic/apps/transform/feature_controls/config.ts.
duration: 2m 4s
- x-pack/test/functional_basic/apps/transform/group1/config.ts duration:
**8m 16s** -> let's split in 2 configs
- x-pack/test/functional_basic/apps/transform/group2/config.ts.
duration: 5m 20s
- x-pack/test/functional_basic/apps/transform/group3/config.ts.
duration: 5m 12s
- x-pack/test/functional_basic/apps/ml/permissions/config.ts. duration:
5m 10s -> let's split in 3 configs (1 test file each)
3rd split round:
- x-pack/test/functional_basic/apps/ml/permissions/group1/config.ts.
duration: 3m 11s
- x-pack/test/functional_basic/apps/ml/permissions/group2/config.ts
duration: 3m 42s
- x-pack/test/functional_basic/apps/ml/permissions/group3/config.ts
duration 2m 14s
- x-pack/test/functional_basic/apps/transform/group4/config.ts duration:
4m 43s
lets split into 3 configs
- x-pack/test/functional_basic/apps/ml/data_visualizer/config.ts
duration: **19m 24s**
4th split round:
- x-pack/test/functional_basic/apps/ml/data_visualizer/group1/config.ts
duration: 4m 42s
- x-pack/test/functional_basic/apps/ml/data_visualizer/group2/config.ts
duration: 9m 27s
- x-pack/test/functional_basic/apps/ml/data_visualizer/group3/config.ts
duration: 7m 39s
[Build time
](https://buildkite.com/elastic/kibana-pull-request/builds/103355) is
49m 26sec (55 FTR groups)
Currently on-merge pipeline for
[main](https://buildkite.com/elastic/kibana-on-merge/builds?branch=main)
takes around 1h
* fix redirect to the data vis
* update jest tests
* remove window.location.href from the clone action
* assert the redirect
* update power user tests
* use plugin id const, return promise reject
* [ftr] automatically determine config run order
* split lens config into two groups
* support ftr configs always running against CI
* Split detection_engine_api_integration rule exception list tests
* Add configs from previous commit
* [ftr] remove testMetadata and maintain a unique lifecycle instance per run
* Revert "[ftr] remove testMetadata and maintain a unique lifecycle instance per run"
This reverts commit d2b4fdb824.
* Split alerting_api_integration/security_and_spaces tests
* Add groups to yaml
* Revert "Revert "[ftr] remove testMetadata and maintain a unique lifecycle instance per run""
This reverts commit 56232eea68.
* stop ES more forcefully and fix timeout
* only cleanup lifecycle phases when the cleanup is totally complete
* only use kill when cleaning up an esTestInstance
* fix broken import
* fix runOptions.alwaysUseSource implementation
* fix config access
* fix x-pack/ccs config
* fix ml import file paths
* update kibana build id
* revert array.concat() change
* fix baseConfig usage
* fix pie chart data
* split up maps tests
* pull in all of group5 so that es archives are loaded correctly
* add to ftr configs.yml
* fix pie chart data without breaking legacy version
* fix more pie_chart stuff in new vis lib
* restore normal PR tasks
* bump kibana-buildkite-library
* remove ciGroup validation
* remove the script which is no longer called from checks.sh
* [CI] Auto-commit changed files from 'yarn kbn run build -i @kbn/pm'
* adapt flaky test runner scripts to handle ftrConfig paths
* fix types in alerting_api_integration
* improve flaky config parsing and use non-local var name for passing explicit configs to ftr_configs.sh
* Split xpack dashboard tests
* Add configs
* [flaky] remove key from ftr-config steps
* [CI] Auto-commit changed files from 'node scripts/eslint --no-cache --fix'
* restore cypress builds
* remove ciGroups from FTR config files
* fixup some docs
* add temporary script to hunt for FTR config files
* use config.base.js naming for clarity
* use script to power ftr_configs.yml
* remove usage of removed x-pack/scripts/functional_tests
* fix test names in dashboard snapshots
* bump kibana-buildkite-library
* Try retrying only failed configs
* be a little quieter about trying to get testStats from configs with testRunners defined
* Remove test code
* bump kibana-buildkite-library
* update es_snapshot and on_merge jobs too
* track duration and exit code for each config and print it at the end of the script
* store results in order, rather than by key, in case there are duplicates in $config
* bash is hard
* fix env source and use +e rather than disabling e for whole file
* bash sucks
* print config summary in jest jobs too
* define results in jest_parallel.sh
* simplify config summary print, format times a little better
* fix reference to unbound time variable, use better variable name
* skip the newline between each result
* finish with the nitpicking
* sync changes with ftr_configs.sh
* refuse to execute config files which aren't listed in the .buildkite/ftr_configs.yml
* fix config.edge.js base config import paths
* fix some readmes
* resolve paths from ftr_configs manifest
* fix readConfigFile tests
* just allow __fixtures__ configs
* list a few more cypress config files
* install the main branch of kibana-buildkite-library
* split up lens group1
* move ml data_visualizer tests to their own config
* fix import paths
* fix more imports
* install specific commit of buildkite-pipeline-library
* sort configs in ftr_configs.yml
* bump kibana-buildkite-library
* remove temporary script
* fix env var for limiting config types
* Update docs/developer/contributing/development-functional-tests.asciidoc
Co-authored-by: Christiane (Tina) Heiligers <christiane.heiligers@elastic.co>
* produce a JUnit report for saved objects field count
* apply standard concurrency limits from flaky test runner
* support customizing FTR concurrency via the env
Co-authored-by: Brian Seeders <brian.seeders@elastic.co>
Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
Co-authored-by: Christiane (Tina) Heiligers <christiane.heiligers@elastic.co>
* [ML] Initial embed
* [ML] Initial embed props
* [ML] Add top nav link to data viz
* Add visible fields
* Add add data service to register links
* Renames, refactor, use constants
* Renames, refactor, use constants
* Update tests and mocks
* Embeddable
* Update hook to update upon time udpate
* Add filter support to query
* Refactor filter utilities
* Add filter support for embeddable
* Fix saved search data undefined
* Prototype aggregated view/document view switcher
* Prototype flyout
* Prototype save document view option in storage
* Fix filter and query conflict with saved search
* Minor styling edits
* [ML] Initial embed
* [ML] Initial embed props
* Add embeddable 1
* Add visible fields
* Embeddable 2
* Add filter support to query
* Refactor filter utilities
* Add filter support for embeddable
* Fix saved search data undefined
* Prototype aggregated view/document view switcher
* Prototype flyout
* Prototype save document view option in storage
* Fix filter and query conflict with saved search
* Minor styling edits
* Fix missing code after conflicts
* Remove dv locator and flyout
* Make types happy
* Fix types
* Rename toggle option
* Resolve conflicts
* [ML] Reduce size of chart
* [ML] Unbold name, switch icons of show distributions
* [ML] Make size consistent
* [ML] Make page size 25
* [ML] Switch to arrow right and down
* [ML] Make legend font smaller
* [ML] Add user setting
* [ML] Add show preview by default setting
* [ML] Match icon
* Add panels around the subcontent
* Add preference for aggregated vs doc
* Fix types
* Fix types, add constants for adv settings
* Change to data view type
* Temp fix for Kibana/EUI table overflow issue
* Modify line height so text is not cut off, modify widths for varying screen sizes
* Different width padders for different screens
* Fix CI
* Merge latest, move button to the right
* Fix width for bar charts previews
* Fix toggle buttons, fix maps
* Delete unused file
* Fix boolean styling
* Change to enum, discover mode
* Hide field stats
* Hide field stats
* Persist show mini preview/distribution settings
* Remove window size, use size observer instead
* Default to document view
* Remove bold, switch icon
* Set fixed width for top values, reduce font size in table
* Fix custom url tests
* Update width styling for panels
* Fix missing flag for Discover sidebar, jest tests
* Fix max width
* Workaround for sorting
* Fix import
* Fix styling
* Make height uniform, center alignment, fix map and keyword map not same size
Move styling
* Revert "Make height uniform, center alignment, fix map and keyword map not same size"
This reverts commit 8fc42e2f
* Revert "Make height uniform, center alignment, fix map and keyword map not same size"
This reverts commit 8fc42e2f
* Uniform height, left aligned, flex grid
* Switch top values to have labels
* Center content
* Replace fixed widths with percentage
* Fix table missing field types
* Add dashboard embeddable and filter support
* Fix file data viz styling and tests, lean up imports, remove hard coded pixels
* Add search panel/kql filter bar
* Temporarily fix scrolling
* New kql filters for data visualizer
* Set map height so it will fit the sampler shard size text
* Use eui progress labels
* Fix spacer
* Add beta badge
* Temporarily fix scrolling
* Fix grow for Top Values for
* [ML] Update functional tests to reflect new arrow icons
* [ML] Add filter buttons and KQL bars
* [ML] Update filter bar onChange behavior
* [ML] Update top values filter onChange behavior
* [ML] Update search filters when opening saved search
* [ML] Clean up
* [ML] Remove fit content for height
* [ML] Fix boolean legend
* [ML] Fix header section when browser width is small to large and when index pattern title is too large
* [ML] Hide expander icon when dimension is xs or s & css fixes
* [ML] Delete embeddables because they are not use
* [ML] Rename view mode, refactor to separate hook, add error prompt if can't show, rename wrapper, clean up & fix tests
* [ML] Make doc count 0 for empty fields, update t/f test
* [ML] Add unit testing for search utils
* Fix missing unsubscribe for embeddable output
* Remove redundant onAddFilter for this PR, fix width
* Rename Field Stats to Field stats to match convention
* [ML] Fix expand all/collapse all behavior to override individual setting
* [ML] Fix functional tests should be 0/0%
* [ML] Fix docs content spacing, rename classnames, add filters to Discover, lens, and maps
* [ML] Fix doc count for fields that exists but have no stats
* [ML] Fix icon styling to match Discover but have text/keyword/histogram
* [ML] Fix doc count for fields that exists but have no stats
* [ML] Rename classnames to BEM style
* Resolve latest changes
* [ML] Add tests for data viz in Discover
* Update tests & dashboard behavior to reflect new advanced settings
* Update telemetry
* Remove workaround after eui bump fix
* Fix missing bool clause
* Add login
* Fix saved search attributes broken with latest changes
* Update tests
* Fix import
* Match the no results found
* Fix query util to return search source's results right away. Fix texts.
* Rename old test suits to farequoteDataViewTestData
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
* [ML] Fixing missing data visualizer links
* adding index dataviz links
* fixing permission
* re-enabling tests
* fixing typo
* adding check for non time based index
* catching possible error when getting index pattern
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
* Link to home file data visualizer
* remove unused import
* i18n cleanup
* remove unused import from EmptyState
* use const
* remove ml functional test cases checking for ml_file_data_visualizer
* more clean-up of ml_file_data_visualizer
* jest snapshot and nav to home page in no_ml_access tests
* revert change to functional test dual_privileges_all at everything_space
* revert another change to security_and_spaces/tests/catalogue.ts
* revert changes to x-pack/test/ui_capabilities/security_only/tests/catalogue.ts
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
* [ML] Add index visualizer
* [ML] Readd support for global state
* [ML] Add time buckets & fix dependencies
* [ML] Working ver
* [ML] Add back and boolean support
* [ML] Remove old files inside ml
* [ML] Rename files
* [ML] Move field type icon
* [ML] Create new folder structure
* [ML] Organize index_data_visualizer
* [ML] Move types into index_data_visualizer folder
* [ML] Move more files into file_data_visualizer
* [ML] Move more files into index_data_visualizer
* [ML] Add new data visualizer model
* [ML] Remove getVisualizerFieldStats which is not used by dv
* [ML] Delete redundant folder
* [ML] Copy old data visualizer routes to new plugin
* [ML] Remove old routes
* [ML] Disable for ml job cards tests for now
* [ML] Remove todos
* [ML] Move the toast error to the UI component
* [ML] Fix map styling
* [ML] Add runtime_mappings for internal/file_upload/time_field_range
* [ML] Move routes into folder
* [ML] Update permissions
* [ML] Update texts
* [ML] Update schemas import and api get_field_stats
* [ML] Reorg folders into common
* [ML] Update types & tests
* [ML] Update internal/data_visualizer permissions and action panel tests
* [ML] Update imports after #100863
* [ML] Fix CI
* [ML] Rename folder from file_data_visualizer to data_visualizer
* [ML] Rename i18n ids
* [ML] Update fileDataVisualizer -> dataVisualizer dependency name in ml plugin
* [ML] Remove ml prefix in data test subjs
* [ML] Fix settings and docs
* [ML] Update plugin description
* [ML] Remove mlContext dependency completely
* [ML] Set query to optional
* Revert "[ML] Update plugin description"
This reverts commit 4ab1a25c
* [ML] Update plugins list docs
* [ML] Fix types and i18n
* [ML] Revert ml data test subj/class name changes
* [ML] Split up data visualizer model, remove Logger
* [ML] Remove empty file and indexPatternFieldEditor
* [ML] Move imports of file_upload
* [ML] Update plugin dependencies
* Re-add missing data_visualizer.json
* Remove capabilities in data_visualizer
* Fix test subjs
* Update ownership for data_visualizer and file_upload code to be ml
* Update estypes after 98266
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
* [ftr] validate that suites are not in multiple ciGroups
* remove unused import
* include filename in error message
* remove redundant ciGroup tags
* fix more duplicate ciGroups
Co-authored-by: spalger <spalger@users.noreply.github.com>
* [ML] Adds functional tests for the index data visualizer card contents
* [ML] Fix translations
* [ML] Fix type errors in permissions tests
* [ML] Address comments from review
