Commit graph

5017 commits

Author SHA1 Message Date
Matthew Kime
1e718a5572
[data views] Make data view saved objects share capable (#114408) 2021-10-25 17:10:16 +01:00
Tiago Costa
e59f8acf9a
skip flaky suite (#116078) 2021-10-25 16:25:44 +01:00
Felix Stürmer
125c569944
[RAC] [Observability] Enable the observability alerting and cases features (#115785)
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-10-25 15:19:59 +02:00
Tiago Costa
35aab9e164
skip flaky suite (#114002) 2021-10-25 13:59:07 +01:00
Tiago Costa
61ea89ff7d
skip flaky suite (#113080) 2021-10-25 13:54:13 +01:00
Marco Liberati
cf2a3f5808
[Lens] Add value labels to Heatmap (#106406)
*  Add label values menu

*  Enable value labels for Heatmap

* 🔥 Remove removed translations

* 🏷️ Fix type issue

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-10-25 14:29:38 +02:00
Walter Rafelsberger
ed99e2466a
[ML] Fix legend text colors for Vega based charts in dark mode. (#115911)
Fixes the legend text colors for Vega based charts in dark mode.
2021-10-25 10:50:35 +01:00
Christos Nasikas
4d3644030a
[Connectors] Check connector's responses (#115797)
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-10-25 10:34:36 +03:00
Dario Gieselaar
110a8418f9
[APM] Add live mode to synthtrace (#115988) 2021-10-23 23:54:21 +02:00
Paul Tavares
4b0ae9633c
[Security Solution][Endpoint] un-skip permissions FTR tests for endpoint (#115962)
* unskip test suite and skip the Test for Host details - found bug
2021-10-21 14:57:30 -04:00
Marta Bondyra
e3aba08ea9
[Lens] Fix editor blowing up when working on non-exisiting data view (#114816)
* correct styles for config panel (if data view is unavailable, the margins are still ok)

* temp

* fix data views bugs

* add test

* integrate feedback

* Update datapanel.tsx

* Update x-pack/plugins/lens/public/indexpattern_datasource/loader.ts

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-10-21 19:43:30 +02:00
Quynh Nguyen
6600f1ad78
[ML] Add Index data visualizer grid embeddable as extra view within Discover (#107184)
* [ML] Initial embed

* [ML] Initial embed props

* [ML] Add top nav link to data viz

* Add visible fields

* Add add data service to register links

* Renames, refactor, use constants

* Renames, refactor, use constants

* Update tests and mocks

* Embeddable

* Update hook to update upon time udpate

* Add filter support to query

* Refactor filter utilities

* Add filter support for embeddable

* Fix saved search data undefined

* Prototype aggregated view/document view switcher

* Prototype flyout

* Prototype save document view option in storage

* Fix filter and query conflict with saved search

* Minor styling edits

* [ML] Initial embed

* [ML] Initial embed props

* Add embeddable 1

* Add visible fields

* Embeddable 2

* Add filter support to query

* Refactor filter utilities

* Add filter support for embeddable

* Fix saved search data undefined

* Prototype aggregated view/document view switcher

* Prototype flyout

* Prototype save document view option in storage

* Fix filter and query conflict with saved search

* Minor styling edits

* Fix missing code after conflicts

* Remove dv locator and flyout

* Make types happy

* Fix types

* Rename toggle option

* Resolve conflicts

* [ML] Reduce size of chart

* [ML] Unbold name, switch icons of show distributions

* [ML] Make size consistent

* [ML] Make page size 25

* [ML] Switch to arrow right and down

* [ML] Make legend font smaller

* [ML] Add user setting

* [ML] Add show preview by default setting

* [ML] Match icon

* Add panels around the subcontent

* Add preference for aggregated vs doc

* Fix types

* Fix types, add constants for adv settings

* Change to data view type

* Temp fix for Kibana/EUI table overflow issue

* Modify line height so text is not cut off, modify widths for varying screen sizes

* Different width padders for different screens

* Fix CI

* Merge latest, move button to the right

* Fix width for bar charts previews

* Fix toggle buttons, fix maps

* Delete unused file

* Fix boolean styling

* Change to enum, discover mode

* Hide field stats

* Hide field stats

* Persist show mini preview/distribution settings

* Remove window size, use size observer instead

* Default to document view

* Remove bold, switch icon

* Set fixed width for top values, reduce font size in table

* Fix custom url tests

* Update width styling for panels

* Fix missing flag for Discover sidebar, jest tests

* Fix max width

* Workaround for sorting

* Fix import

* Fix styling

* Make height uniform, center alignment, fix map and keyword map not same size

Move styling

* Revert "Make height uniform, center alignment, fix map and keyword map not same size"

This reverts commit 8fc42e2f

* Revert "Make height uniform, center alignment, fix map and keyword map not same size"

This reverts commit 8fc42e2f

* Uniform height, left aligned, flex grid

* Switch top values to have labels

* Center content

* Replace fixed widths with percentage

* Fix table missing field types

* Add dashboard embeddable and filter support

* Fix file data viz styling and tests, lean up imports, remove hard coded pixels

* Add search panel/kql filter bar

* Temporarily fix scrolling

* New kql filters for data visualizer

* Set map height so it will fit the sampler shard size text

* Use eui progress labels

* Fix spacer

* Add beta badge

* Temporarily fix scrolling

* Fix grow for Top Values for

* [ML] Update functional tests to reflect new arrow icons

* [ML] Add filter buttons and KQL bars

* [ML] Update filter bar onChange behavior

* [ML] Update top values filter onChange behavior

* [ML] Update search filters when opening saved search

* [ML] Clean up

* [ML] Remove fit content for height

* [ML] Fix boolean legend

* [ML] Fix header section when browser width is small to large and when index pattern title is too large

* [ML] Hide expander icon when dimension is xs or s & css fixes

* [ML] Delete embeddables because they are not use

* [ML] Rename view mode, refactor to separate hook, add error prompt if can't show, rename wrapper, clean up & fix tests

* [ML] Make doc count 0 for empty fields, update t/f test

* [ML] Add unit testing for search utils

* Fix missing unsubscribe for embeddable output

* Remove redundant onAddFilter for this PR, fix width

* Rename Field Stats to Field stats to match convention

* [ML] Fix expand all/collapse all behavior to override individual setting

* [ML] Fix functional tests should be 0/0%

* [ML] Fix docs content spacing, rename classnames, add filters to Discover, lens, and maps

* [ML] Fix doc count for fields that exists but have no stats

* [ML] Fix icon styling to match Discover but have text/keyword/histogram

* [ML] Fix doc count for fields that exists but have no stats

* [ML] Rename classnames to BEM style

* Resolve latest changes

* [ML] Add tests for data viz in Discover

* Update tests & dashboard behavior to reflect new advanced settings

* Update telemetry

* Remove workaround after eui bump fix

* Fix missing bool clause

* Add login

* Fix saved search attributes broken with latest changes

* Update tests

* Fix import

* Match the no results found

* Fix query util to return search source's results right away. Fix texts.

* Rename old test suits to farequoteDataViewTestData

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-10-21 10:32:21 -07:00
Bhavya RM
8bee1b8f41
unskip kibana overview test from xpack and add the missing painless labs test to config.ts (#115240) 2021-10-21 13:11:18 -04:00
Kevin Logan
c53004fe06
[Security Solution] Fix metadata tests with updated timestamps (#115591) 2021-10-21 13:08:06 -04:00
Robert Oskamp
729481ed59
[ML] Functional tests - stabilize categorization examples endpoint test (#115910)
This PR stabilizes the categorization example endpoint tests by using a different esArchive.
2021-10-21 17:11:24 +02:00
Jean-Louis Leysens
8b66ef161d
[Reporting] Baseline capture tests (#113910)
* added page to reporting example app that contains the capture tests

* first version of PNG capture for test A

* added types file to common

* added data-shared-item attr to image, also added capture menu items

* fix image CSS by providing a fixed width and height

* explicitly add layout for print, does not seem to do anything though?

* added magic numbers of image sizes

* added reporting examples test folder

* first version of capture test for generating and comparing PNGs

* added PNG service and PNG baseline fixture

* added pdf-to-img dev dependency

* refactor compare_pngs to accept a buffer

* added comment to interface

* png service -> compare images service

* export image compare service

* added test for pdf export

* clean up log

* minor fixes and added pdf print optimized test

* added pdf and pdf print fixtures

* refactor lib function name

* Update difference thresholds

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-10-21 14:59:07 +02:00
Tiago Costa
f76e5df353
skip flaky suite (#115320) 2021-10-21 12:57:53 +01:00
Robert Oskamp
d01ba7d685
[ML] Functional tests - re-activate a11y suite (#115900)
This PR re-activates the ML accessibility test suite.
2021-10-21 13:55:28 +02:00
Tiago Costa
f2c35a0115
skip flaky suite (#115883) 2021-10-21 12:55:00 +01:00
Alejandro Fernández Gómez
941a6c9bb9
[RAC][Observability] Use no data screen for the alerts and cases pages (#115178)
Co-authored-by: Chris Cowan <chris@chriscowan.us>
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-10-21 12:54:07 +02:00
Matthew Kime
d2dea6816c
[data view mgmt] change urls from indexPatterns to dataViews (#114912)
* index pattern management to data view url changes
2021-10-21 05:42:13 -05:00
Kerry Gallagher
d18e7c9158
[Observability] [Alerts] Regenerate archive data and amend tests (#115603)
* Regenerate archive data and amend test assertions
2021-10-21 11:07:43 +01:00
Christos Nasikas
43e0043fcb
[Connectors][ServiceNow] Default isLegacy to true for API consumers (#115367) 2021-10-21 10:41:56 +01:00
Kevin Lacabane
647ca9a82b
Fix nodedetail flaky test (#115612)
* add test-subj to page loading component

* wait for page to load before navigating to node

* enable node_detail functional tests

* a different approach

* bump timeouts

* Revert "add test-subj to page loading component"

This reverts commit 1840cdf7b8.

* remove unused method

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-10-21 10:46:20 +02:00
Milton Hultgren
331e76b96d
[Observability] Make Alerts page use shared Kibana time range (#115192)
* [Observability] Make Alerts page respect timefilter service range (#111348)

* [Observability] Add useHashQuery option in UrlStateStorage

* Remove unused

* Add test for createKbnUrlStateStorage change

* Add time range test

* Add code comments

* Clean up tests

* Extend createKbnUrlStateStorage tests

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-10-21 09:17:05 +02:00
Matthew Kime
64f1dddcb0
[feature branch] index pattern => data view for user facing content (#109821)
* [index pattern management] index pattern => data view for user facing content (#109577)
2021-10-20 18:53:39 -05:00
Frank Hassanabad
9ca48d05f3
Adds one time conflict retry and cleans up the exception lists to use the REST API (#115848)
## Summary

Improves FTR/e2e conflict retries with exception lists and security rules.

Fixes:
https://github.com/elastic/kibana/issues/115734
https://github.com/elastic/kibana/issues/115769
https://github.com/elastic/kibana/issues/115715
https://github.com/elastic/kibana/issues/115702
https://github.com/elastic/kibana/issues/115701

This past week we have been seeing increasing flake across tests involving `exception_lists` involving a `409 conflict` on our tests. Looking at each of the tests above and the flake it looks like we were calling Elasticsearch directly within the `.kibana` index to delete the exception list and list items as a shortcut:

```
export const deleteAllExceptions = async (es: KibanaClient): Promise<void> => {
  return countDownES(async () => {
    return es.deleteByQuery({
      index: '.kibana',
      q: 'type:exception-list or type:exception-list-agnostic',
      wait_for_completion: true,
      refresh: true,
      body: {},
    });
  }, 'deleteAllExceptions');
};
```

Although I think we did everything correctly `wait_for_completion: true` and  `refresh: true` within the tests there might be a slight race condition where the delete by query does not immediately happen for us. Since we should prefer to use direct REST API's where we can instead of calling into `.kibana` I changed this to using the exception list API:

```
export const deleteAllExceptions = async (
  supertest: SuperTest.SuperTest<SuperTest.Test>
): Promise<void> => {
  await countDownTest(
    async () => {
      const { body } = await supertest
        .get(`${EXCEPTION_LIST_URL}/_find?per_page=9999`)
        .set('kbn-xsrf', 'true')
        .send();

      const ids: string[] = body.data.map((exception: ExceptionList) => exception.id);
      for await (const id of ids) {
        await supertest.delete(`${EXCEPTION_LIST_URL}?id=${id}`).set('kbn-xsrf', 'true').send();
      }
      const { body: finalCheck } = await supertest
        .get(`${EXCEPTION_LIST_URL}/_find`)
        .set('kbn-xsrf', 'true')
        .send();
      return finalCheck.data.length === 0;
    },
    'deleteAllExceptions',
    50,
    1000
  );
};
```

The additional final check above should ensure it sees that the data has been deleted before returning. Otherwise it will loop around again and keep trying.

I also improve both the `createRules` and `createExceptionList` by introducing a one-time, "detect if in conflict" and then "remove if in conflict" within those tests. This should help safe guard against flake if the above does not fix it. I also added more logging statements in case we do encounter this again on the CI system we can further trouble shoot it and add additional retry logic/fix logic.

A good side effect is if now you kill your tests half way through and restart them, the additional "detect if conflict" will recover your test for you as a developer. So 👍 that is an added benefit.

Example error message you would get (but not test failure) if you remove one of the cleanup sections in the `afterEach` or if you kill a test half way through and then restart it as an engineer:

```
└-: "is" operator
             └-> "before all" hook for "should find all the text from the data set when no exceptions are set on the rule"
             └-> should find all the text from the data set when no exceptions are set on the rule
               └-> "before each" hook: global before each for "should find all the text from the data set when no exceptions are set on the rule"
               └-> "before each" hook for "should find all the text from the data set when no exceptions are set on the rule"
When creating a rule found an unexpected conflict (409), will attempt a cleanup and one time re-try. This usually indicates a bad cleanup or race condition within the tests: {"message":"rule_id: \"rule-1\" already exists","status_code":409}
               └- ✓ pass  (7.9s)
```

### Checklist

- [x] [Unit or functional tests](https://www.elastic.co/guide/en/kibana/master/development-tests.html) were updated or added to match the most common scenarios
2021-10-20 16:25:33 -06:00
Tyler Smalley
9a00e98b7c skip flaky suite (#115859) 2021-10-20 14:54:45 -07:00
Rashmi Kulkarni
e37c25991e
un-skip maps/feature_controls/maps_spaces.ts functional test (#113656) 2021-10-20 14:20:23 -07:00
Tiago Costa
f40618c707
skip failing es promototion suites (#115849) 2021-10-20 20:51:49 +01:00
Kyle Pollich
6d4cfc5e39
[Fleet] Add support for "Edit Package Policy" extensions using latest version of a package (#114914)
* Add support for extensions using latest version of a package and forcing upgrade state for edit policy view

* Fix isUpgrade flag on integrations UI version of edit page

* Treat non-validation errors as general failures in server and UI

* Fix tests + don't call upgrade API when saving

* fix i18n

* Fix default name always appearing when editing package policies via extension UI

* Opt security solution plugin out of new extension option

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-10-20 14:35:45 -04:00
Ahmad Bamieh
00cc5fef8e
[Telemetry] Switch to v3 endpoint (#113525) 2021-10-20 12:26:21 -04:00
Chris Cowan
31fa0cb13b
[Metrics UI] Add track_total_hits to Metric Threshold query to support alerts with over 10K documents (#115465)
* [Metrics UI] Add track_total_hits to Metric Threshold query

* Adding tests

* Making the esArchive smaller
2021-10-20 10:19:44 -06:00
Ece Özalp
b12e21d9aa
[Security Solution][CTI] Rule Preview backend update (introduces /preview endpoint) (#112441)
Co-authored-by: Davis Plumlee <davis.plumlee@elastic.co>
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-10-20 12:06:50 -04:00
Luke Elmers
a7fff86390
[saved objects] Remove migrations enableV2 config. (#115655) 2021-10-20 09:17:52 -06:00
Bryan Clement
7e593a05a2
[Osquery] Cypress automation for osquery manager integration (#108759) 2021-10-20 16:09:08 +02:00
Robert Oskamp
f69fa6a8a2
[ML] Functional tests - adjust test retries and waiting conditions (#115592)
This PR fixes a few test stability issues, mostly by adding/adjusting retries.

* Stabilize data viz full time range selection
* Stabilize DFA wizard source data loading
* Stabilize feature importance service methods
* Stabilize DFA table row existence assertion
* Stabilize dashboard embeddable service methods
2021-10-20 11:25:46 +02:00
Robert Oskamp
22e4172781
[ML] Functional tests - re-enable transform runtime mappings suite (#115547)
This PR stabilizes and re-enables the transform runtime mappings tests.
2021-10-20 11:23:51 +02:00
Thom Heymann
6e7dfcd99a
Fix maps font path (#115453)
* fixed font path

* fix functional tests

* fix directory issue

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-10-20 10:22:04 +01:00
Yara Tercero
6a2b7fe3d3
[Security Solution][Platform] - Export exceptions with rule (#115144)
### Summary

Introduces exports of exception lists with rules. Import of exception lists not yet supported.
2021-10-20 01:17:08 -04:00
Frank Hassanabad
a01165ab30
[Security Solutions] Fixes 11 different flakey FTR/e2e tests and scenarios (#115688)
## Summary

Fixes flakes across tests that have either been skipped or have been a source of flake in the categories of:
* Sorting fixes because Elasticsearch can return hits/arrays back in different orders
* Flat array fixes because Elasticsearch can sometimes return `[]` or `[[]]` in-deterministically in some cases 🤷 , so we just flatten the array out completely and test for `[]` within those tests.
* `waitForSignalsToBePresent` was missing in a test and sometimes we would get an empty array response which would fail CI.

Also I audited other tests for `[[]]` and `waitForSignalsToBePresent` and fixed them where they were present or if the `waitForSignalsToBePresent` count was incorrect. This should give us more stability when the CI is under pressure.

Sorting fixes:
https://github.com/elastic/kibana/issues/115554
https://github.com/elastic/kibana/issues/115321
https://github.com/elastic/kibana/issues/115319
https://github.com/elastic/kibana/issues/114581


Flat array fixes:
https://github.com/elastic/kibana/issues/89052
https://github.com/elastic/kibana/issues/115315
https://github.com/elastic/kibana/issues/115308
https://github.com/elastic/kibana/issues/115304
https://github.com/elastic/kibana/issues/115313
https://github.com/elastic/kibana/issues/113418

Missing additional check for "waitForSignalsToBePresent" or incorrect number of signals to wait for fixes:
https://github.com/elastic/kibana/issues/115310


### Checklist

- [x] [Unit or functional tests](https://www.elastic.co/guide/en/kibana/master/development-tests.html) were updated or added to match the most common scenarios
2021-10-20 00:42:35 -04:00
Tyler Smalley
473cabcef5 skip flaky suite (#115666) 2021-10-19 21:37:50 -07:00
Marshall Main
ba20ea1630
[Security Solution] Improve rule statuses if user has no permissions to source index (#115114)
* Prevent error in field_caps from silencing privilege errors

* Fix threshold bug and fix privileges in new executor

* Fix unit tests

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-10-19 22:40:26 -04:00
Tyler Smalley
1d46541a98 skip flaky suite (#115614) 2021-10-19 11:50:23 -07:00
Walter Rafelsberger
975beb125a
[ML] APM Correlations: Log log chart enhancements. (#113039)
- By clicking on a row in the analysis tables, the row gets selected/pinned as the one highlighted in the chart, allowing the user to investigate this particular result via hovering in the chart.
- A subtitle is added to the charts to clarify the chart type "Log-log plot for latency (x) by transactions (y) with overlapping bands" and lists the areas. Allows the user to see the full name of the highlighted entity because it could be cut off in the chart's native legend for longer field/value combinations.
- The area palette has been tweaked for higher contrasts, the error area color now matched the orange used in other charts for errors/failed transactions.
- Some visual tweaks like adding the non-transparent upper line for the areas to make sure there's a color in the chart itself that matches the legend colors:
- The trace samples tab now also shows an area with all failed transactions.
2021-10-19 13:59:01 -04:00
Christos Nasikas
20b11c9f43
[Cases][Connectors] ServiceNow ITOM: MVP (#114125)
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-10-19 12:39:51 -04:00
Constance
498050e05b
Upgrade EUI to v39.1.1 (#114732)
* Upversion to EUI 39.1.0

* Update i18n_eui_mapping tokens

@see https://github.com/elastic/eui/blob/master/i18ntokens_changelog.json

* Merge refractor in yarn.lock

* Fix functional table filter selector

- Popover ID was removed in recent EUI a11y fix, so we're using child-position selection to target the Tags filter now

* Update snaphots

* Upgrade to 39.1.1 for extra bugfixes

* Update i18n mappings

* Fix i18n snapshot

* Attempt to harden flaky Security Cypress test

* More combobox entry hardening

- Got a flake on clicking the combobox dropdown on run 17/20 locally

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-10-19 09:15:38 -07:00
Dima Arnautov
2aaa515bbc
[Transform] Add alerting rules management to Transform UI (#115363)
* transform alert flyout

* fetch alerting rules

* show alerting rules indicators

* filter continuous transforms

* add alert rules to the expanded row

* edit alert rule from the list

* fix ts issues

* fix types

* update texts

* refactor using context, wip create alert from the list

* update unit test

* fix ts issue

* privilege check
2021-10-19 17:15:52 +02:00
James Gowdy
92e1cd25b7
[ML] Adding ability to change data view in advanced job wizard (#115191)
* [ML] Adding ability to change data view in advanced job wizard

* updating translation ids

* type and text changes

* code clean up

* route id change

* text changes

* text change

* changing data view to index pattern

* adding api tests

* text updates

* removing first step

* renaming temp variable

* adding permission checks

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-10-19 15:51:30 +01:00
Joe Portner
e4fb118fee
Change deleteByNamespace to include legacy URL aliases (#115459) 2021-10-19 10:44:15 -04:00