## Summary
Fixes#182514.
The links menu for the anomalies table used a custom field caps wrapper
API endpoint to identify the type of the categorization field. This PR
changes this to use the data view API instead to use `esTypes` for the
same check. This allows us to remove the custom field caps API endpoint
completely.
Removes the route `POST /internal/ml/indices/field_caps` as it is no
longer required by the ml plugin.
### Checklist
- [x] [Unit or functional
tests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)
were updated or added to match the most common scenarios
- [x] This was checked for breaking API changes and was [labeled
appropriately](https://www.elastic.co/guide/en/kibana/master/contributing.html#kibana-release-notes-process)
## Summary
This PR makes the following updates to our pre-built Security ML jobs:
- Adds user-friendly names to our pre-built Anomaly Detection jobs.
These will be displayed in the Anomalies tab on the new Entity Analytics
page in the Security App instead of job IDs.
- Fixes formatting
- One job was missing the `security` job group which is required to
display jobs in the Security App. Added that as well.
- Changed the names of two modules: `siem_cloudtrail` ->
`security_cloudtrail` and `siem_packetbeat` -> `security_packetbeat`.
This should have happened a while ago per
[this](https://github.com/elastic/kibana/issues/69319) issue.
## Side effects
- Any QA tests that reference the `siem_cloudtrail` and
`siem_packetbeat` modules will need to be changed to reference the new
modules instead
- Any references to the siem modules in the Security App will need to be
updated
Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
Co-authored-by: Robert Oskamp <robert.oskamp@elastic.co>
* [ML] Initial embed
* [ML] Initial embed props
* [ML] Add top nav link to data viz
* Add visible fields
* Add add data service to register links
* Renames, refactor, use constants
* Renames, refactor, use constants
* Update tests and mocks
* Embeddable
* Update hook to update upon time udpate
* Add filter support to query
* Refactor filter utilities
* Add filter support for embeddable
* Fix saved search data undefined
* Prototype aggregated view/document view switcher
* Prototype flyout
* Prototype save document view option in storage
* Fix filter and query conflict with saved search
* Minor styling edits
* [ML] Initial embed
* [ML] Initial embed props
* Add embeddable 1
* Add visible fields
* Embeddable 2
* Add filter support to query
* Refactor filter utilities
* Add filter support for embeddable
* Fix saved search data undefined
* Prototype aggregated view/document view switcher
* Prototype flyout
* Prototype save document view option in storage
* Fix filter and query conflict with saved search
* Minor styling edits
* Fix missing code after conflicts
* Remove dv locator and flyout
* Make types happy
* Fix types
* Rename toggle option
* Resolve conflicts
* [ML] Reduce size of chart
* [ML] Unbold name, switch icons of show distributions
* [ML] Make size consistent
* [ML] Make page size 25
* [ML] Switch to arrow right and down
* [ML] Make legend font smaller
* [ML] Add user setting
* [ML] Add show preview by default setting
* [ML] Match icon
* Add panels around the subcontent
* Add preference for aggregated vs doc
* Fix types
* Fix types, add constants for adv settings
* Change to data view type
* Temp fix for Kibana/EUI table overflow issue
* Modify line height so text is not cut off, modify widths for varying screen sizes
* Different width padders for different screens
* Fix CI
* Merge latest, move button to the right
* Fix width for bar charts previews
* Fix toggle buttons, fix maps
* Delete unused file
* Fix boolean styling
* Change to enum, discover mode
* Hide field stats
* Hide field stats
* Persist show mini preview/distribution settings
* Remove window size, use size observer instead
* Default to document view
* Remove bold, switch icon
* Set fixed width for top values, reduce font size in table
* Fix custom url tests
* Update width styling for panels
* Fix missing flag for Discover sidebar, jest tests
* Fix max width
* Workaround for sorting
* Fix import
* Fix styling
* Make height uniform, center alignment, fix map and keyword map not same size
Move styling
* Revert "Make height uniform, center alignment, fix map and keyword map not same size"
This reverts commit 8fc42e2f
* Revert "Make height uniform, center alignment, fix map and keyword map not same size"
This reverts commit 8fc42e2f
* Uniform height, left aligned, flex grid
* Switch top values to have labels
* Center content
* Replace fixed widths with percentage
* Fix table missing field types
* Add dashboard embeddable and filter support
* Fix file data viz styling and tests, lean up imports, remove hard coded pixels
* Add search panel/kql filter bar
* Temporarily fix scrolling
* New kql filters for data visualizer
* Set map height so it will fit the sampler shard size text
* Use eui progress labels
* Fix spacer
* Add beta badge
* Temporarily fix scrolling
* Fix grow for Top Values for
* [ML] Update functional tests to reflect new arrow icons
* [ML] Add filter buttons and KQL bars
* [ML] Update filter bar onChange behavior
* [ML] Update top values filter onChange behavior
* [ML] Update search filters when opening saved search
* [ML] Clean up
* [ML] Remove fit content for height
* [ML] Fix boolean legend
* [ML] Fix header section when browser width is small to large and when index pattern title is too large
* [ML] Hide expander icon when dimension is xs or s & css fixes
* [ML] Delete embeddables because they are not use
* [ML] Rename view mode, refactor to separate hook, add error prompt if can't show, rename wrapper, clean up & fix tests
* [ML] Make doc count 0 for empty fields, update t/f test
* [ML] Add unit testing for search utils
* Fix missing unsubscribe for embeddable output
* Remove redundant onAddFilter for this PR, fix width
* Rename Field Stats to Field stats to match convention
* [ML] Fix expand all/collapse all behavior to override individual setting
* [ML] Fix functional tests should be 0/0%
* [ML] Fix docs content spacing, rename classnames, add filters to Discover, lens, and maps
* [ML] Fix doc count for fields that exists but have no stats
* [ML] Fix icon styling to match Discover but have text/keyword/histogram
* [ML] Fix doc count for fields that exists but have no stats
* [ML] Rename classnames to BEM style
* Resolve latest changes
* Add in place ss
* Refactor helper functions
* Refactor helper functions
* Add error log
* Migrate overall stats to data's search
* Better handle errors
* Fix url so restore session brings back correct view
* Add progress bar
* [ML] Add tests for data viz in Discover
* [ML] Change to combinelatest
* Update tests & dashboard behavior to reflect new advanced settings
* Update telemetry
* Remove workaround after eui bump fix
* Remove dataloader
* Snapshot
* Migrate search to client side
* Consolidate types
* Change back to forkjoin instead of combinelatest for overallstats
* Fix missing bool clause
* Add login
* Fix saved search attributes broken with latest changes
* Update tests
* Fix import
* Match the no results found
* Reset field stats so it reloads when query is refreshed
* Reset field stats so it reloads when query is refreshed
* Add doc stats
* Merge to use hook completely
* Merge to use hook completely
* Fix doc chart doesn't show up when page is first mounted
* Fix Discover auto refresh previously didn't update
* Fix query util to return search source's results right away. Fix texts.
* Refactor documentStats
* Fix doc stats not showing upon page mount
* Fix types
* Delete old files
* Update tests & i18n
* Fix examples, tests
* Remove old files & routes
* Add telemetry, clean up, rename components for clarity
* Fix size of callout message
* Fix texts field
* Consolidate field type
* Consolidate field type, add count to top values
* Clean up
* Update tests
* Remove progress on embedadble
* Update snapshot
* Clean up, consolidate searchOptions
* Fix new es client types
* Fix types
* Fix loading state in Discover
* Remove unused services, Change switchMap to map, mergeMap -> switchMap, update types
* Fix missing filters
* Fix message of table to show searching instead of no items found
* Fix dashboard saved search source persisting time range
* [ML] Fix table message state
* [ML] Fix to not fetch field stats if cardinality is 0
* [ML] Fix locator missing view mode
* [ML] Quit right away if field doesn't exist in docs
* [ML] Change to use batch and only retry with individual field if failed
* [ML] Batch requests for speed and retry failures for resiliency
* No need to fetch field stats if overall stats haven't completed
* Wait on overallStats to complete
* Fix types after merge
* Fix payload size too big 413, num of requests
* Update field icon to using kbn/react-field package
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
* [ML] api integration tests for get trained models endpoint
* [ML] delete ingest pipelines after tests execution
* [ML] deleteIngestPipeline method
* [ML] test for unauthorized user
* [ML] tests for model stats
* [ML] delete trained model tests
* [ML] fix typo
* [ML] fix expect package path
* [ML] get model pipelines tests
* [ML] test for aliases
* [ML] add tests for a 404 response
* [ML] fix typo
* [ML] fix typo
* [ML] Adds API integration tests for data viz and fields endpoints
* [ML] Fix review comments and errors from settings endpoints
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
This PR changes the way how test resources like indices and saved objects are used in ML and Transform functional tests. No actual test logic is changed.
This PR runs all functional ML and transform tests (except existing security and feature controls tests) as a poweruser instead of the default superuser.
