Commit graph

422 commits

Author SHA1 Message Date
Dzmitry Lemechko
852299b535
[performance] add APM data set extraction pipeline (#147177)
## Summary

Part of #140828

PR for run yml file
[elastic/kibana-buildkite/pull/67](https://github.com/elastic/kibana-buildkite/pull/67)

This PR moves data set extraction step in separate pipeline, still
reporting KIbana scalability and ES Rally output in Kibana-related
bucket.

Reporting ES Rally data to required bucket will be added in the
follow-up PR.
2022-12-07 19:02:15 +01:00
Stratoula Kalafateli
405eb89f35
[Vislib] Removes the old implementation of the pie (#146990)
## Summary

Closes https://github.com/elastic/kibana/issues/111246

Removes the implementation of the vislib pie. Specifically:

- Removes the `visualization:visualize:legacyPieChartsLibrary` advanced
setting which was used as a fallback to vislib pie,
- Cleanups the vislib code from the pie
2022-12-07 14:14:47 +02:00
Dzmitry Lemechko
9f7db8f615
[scalability testing] typescript runner (#147002)
## Summary

Closes #146546

This PR replaces bash script with node-based runner script.

Script can take relative path to directory with scalability journey
files or relative path to individual journey json file.

`node scripts/run_scalability.js --journey-config-path
scalability_traces/server`

`node scripts/run_scalability.js --journey-config-path
scalability_traces/server/api.core.capabilities.json`

### Checklist

Delete any items that are not applicable to this PR.

- [ ] Any text added follows [EUI's writing
guidelines](https://elastic.github.io/eui/#/guidelines/writing), uses
sentence case text and includes [i18n
support](https://github.com/elastic/kibana/blob/main/packages/kbn-i18n/README.md)
- [ ]
[Documentation](https://www.elastic.co/guide/en/kibana/master/development-documentation.html)
was added for features that require explanation or tutorials
- [ ] [Unit or functional
tests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)
were updated or added to match the most common scenarios
- [ ] Any UI touched in this PR is usable by keyboard only (learn more
about [keyboard accessibility](https://webaim.org/techniques/keyboard/))
- [ ] Any UI touched in this PR does not create any new axe failures
(run axe in browser:
[FF](https://addons.mozilla.org/en-US/firefox/addon/axe-devtools/),
[Chrome](https://chrome.google.com/webstore/detail/axe-web-accessibility-tes/lhdoppojpmngadmnindnejefpokejbdd?hl=en-US))
- [ ] If a plugin configuration key changed, check if it needs to be
allowlisted in the cloud and added to the [docker
list](https://github.com/elastic/kibana/blob/main/src/dev/build/tasks/os_packages/docker_generator/resources/base/bin/kibana-docker)
- [ ] This renders correctly on smaller devices using a responsive
layout. (You can test this [in your
browser](https://www.browserstack.com/guide/responsive-testing-on-local-server))
- [ ] This was checked for [cross-browser
compatibility](https://www.elastic.co/support/matrix#matrix_browsers)


### Risk Matrix

Delete this section if it is not applicable to this PR.

Before closing this PR, invite QA, stakeholders, and other developers to
identify risks that should be tested prior to the change/feature
release.

When forming the risk matrix, consider some of the following examples
and how they may potentially impact the change:

| Risk | Probability | Severity | Mitigation/Notes |

|---------------------------|-------------|----------|-------------------------|
| Multiple Spaces—unexpected behavior in non-default Kibana Space.
| Low | High | Integration tests will verify that all features are still
supported in non-default Kibana Space and when user switches between
spaces. |
| Multiple nodes—Elasticsearch polling might have race conditions
when multiple Kibana nodes are polling for the same tasks. | High | Low
| Tasks are idempotent, so executing them multiple times will not result
in logical error, but will degrade performance. To test for this case we
add plenty of unit tests around this logic and document manual testing
procedure. |
| Code should gracefully handle cases when feature X or plugin Y are
disabled. | Medium | High | Unit tests will verify that any feature flag
or plugin combination still results in our service operational. |
| [See more potential risk
examples](https://github.com/elastic/kibana/blob/main/RISK_MATRIX.mdx) |


### For maintainers

- [ ] This was checked for breaking API changes and was [labeled
appropriately](https://www.elastic.co/guide/en/kibana/master/contributing.html#kibana-release-notes-process)
2022-12-06 22:21:52 +01:00
Xavier Mouligneau
4bcb4c6b4f
[RAM] Bring back API integration (#146930)
Bring back API integration
2022-12-06 15:09:20 -05:00
Dmitrii Shevchenko
3e499922ff
[Security Solution] Remove detection rules distributed via the file system (#143839) 2022-12-06 16:12:52 +01:00
Spencer
c107f8a73a
[jest/ci] disable console methods (#146910)
Removes all the noise from poorly written React tests and includes a
warning to explain the situation to folks

Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
2022-12-02 15:28:55 -07:00
Ahmad Bamieh
1323fd8de6
[i18n] Fix ja-JP locale causing FATAL error when starting kibana (#146704)
Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
Closes https://github.com/elastic/kibana/issues/146693
2022-11-30 21:28:28 +03:00
Gloria Hornero
2cb675d814
[Security Solution] Adding security solution packages as a dependency (#146561) 2022-11-30 15:17:32 +01:00
Jonathan Budzenski
ab2f1fe84a
[ci] Shorten timeout for jest and ftr steps (#146636)
We're seeing sporadic image outages today causing test steps to reach
their max timeout. Currently we displays warnings on configurations
taking >40? minutes. This decreases the error timeout for jest and ftr
configurations to 60 minutes.


https://buildkite.com/elastic/kibana-on-merge/builds/24321#0184c4b6-ae6c-4777-a637-20d34feba777
https://buildkite.com/elastic/kibana-on-merge/builds/24279#0184c3d0-5b12-4c8b-9e8c-6c7b67638661

I'll follow up with a separate issue for better error handling during
test setup.
2022-11-29 17:26:07 -06:00
Shahzad
d136668854
[Synthetics] Deprecate adding synthetics integrations from fleet (#146369)
Co-authored-by: florent-leborgne <florent.leborgne@elastic.co>
Fixes https://github.com/elastic/kibana/issues/137501
2022-11-29 21:29:26 +01:00
Liza Katz
783ea146a7
Performance runner in js (#146129)
## Summary

Rewrite the performance journey runner using TypeScript, to avoid
dangling ES\node processes during test execution.

Results are stable with this runner, as verified on CI 


![image](https://user-images.githubusercontent.com/3016806/204506155-61c5807b-fad5-40bf-8284-a82693cd4c2a.png)

Co-authored-by: Spencer <email@spalger.com>
Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
2022-11-29 19:43:35 +02:00
Jean-Louis Leysens
5a86b583df
[Files] Move <FileUpload /> and <FilePicker /> 👉🏻 packages/shared-ux/file (#146284)
## Summary

This is a refactor:

* Move `FilesContext`, `FilePicker` and `UploadFile` components to
`packages/shared-ux/file` as packages
* Renamed `UploadFile` to `FileUpload` for more consistency
* Also created `packages/shared-ux/file/types` and added
`useBehaviourSubject` to `packages/shared-ux/file/util` (we can consider
moving this elsewhere since that function is not necessarily tied to the
files domain).
* Removed the storybook config from `files` public plugin since there
are no more components there

## How to test

👉🏻 `yarn storybook shared_ux` to see the components in a lab environment

OR

👉🏻 `yarn start --run-examples` then "Developer examples" > "Files
example" to see the components being used in Kibana

Look out for any regressions: for example, in the `FileImage` component
importing `import bh from 'blurhash'` caused a regression because
blurhash does not expose a default export. This was fixed by doing:
`import * as bh from 'blurhash`.

## Notes

* With this change, we needed to move `FilesClient` interface to
packages since it is used by the components. However, we also wanted to
keep `FilesClient` interface as it is currently exported from `files`
plugin because it exposes methods that only the server of `files` plugin
should know about (e.g., the metrics endpoint). I created the
`BaseFilesClient` in the packages directory that is extended in the
`files` plugin as needed. This is a snapshot of the types as they are
provided from the server implementation and will need to be
updated/maintained by hand from here on out.
* With `BaseFilesClient` in `packages`, we lost the type check between
`files` server endpoints and the client methods. To re-establish this
link the `CreateRouteDefinition` type helper got a parameter where the
client method can be passed in to do checks that the server inputs
(query, param and body) as well as outputs (the responses) match what
the client expects using the `X extends Y ? X : unknown` capability of
TS. See this in action in, for example
`src/plugins/files/server/routes/find.ts`. DX will be: if these ever get
out of sync, the server values for `query`, `param` or `body` will map
to `unknown` causing a type issue when trying to use these values. This
can only be fixed by bringing the `FilesClient` types in sync with the
server types.
* Server endpoints that should match expected `FilesClient`
inputs/outputs should use the `CreateRouteDefinition` type helper, but
if the endpoint does not need to map to a client method we can always
skip using `CreateRouteDefinition`.

Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
2022-11-29 08:48:23 +01:00
Jonathan Budzenski
5f342636d2
[cft] Support persisting deployments (#144370)
Adds support for a label `ci:cloud-persist-deployment`, that will
prevent deployments from shutting down until the label is removed.

This also fixes a bug in the conditional checking for whether the cloud
deployment label was removed. If `ci:cloud-deploy` is removed from a PR,
the deployment should now shutdown in the next hour instead of after
48h.

It's easiest to test this after merging. I can alternatively modify the
pipeline to run on a branch, but either way I'll end up pushing commits
and this is fairly straight forward and it breaking is low risk. Either
way works for me.

Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
Co-authored-by: Tyler Smalley <tylersmalley@gmail.com>
2022-11-28 11:39:10 -07:00
Or Ouziel
b9ffc29cd3
[Cloud Posture] test latest findings table sort (#144668) 2022-11-28 11:46:37 +02:00
Jonathan Budzenski
64bae2ea09
skip src/core/server/integration_tests/ui_settings/jest.integration.config.js (#145646)
This suite has become flaky:

https://buildkite.com/elastic/kibana-on-merge/builds/23746#01848784-7e14-4800-b63a-bfc5905864d7/3656-4619
https://buildkite.com/elastic/kibana-on-merge/builds/23745#01848782-d6ff-42f5-a111-6f2608db2c47/2443-3188
2022-11-17 18:04:11 -06:00
Spencer
61af35c271
[docs] add "docs" label to daily docs build PRs (#145421)
As requested by the QA team, these PRs should be labeled with "docs" to
help filter them out when reviewing PRs that are going into a specific
version.
2022-11-16 11:38:29 -07:00
Tiago Costa
105e54fe96
[TriggersActionsUi] disable jest config in CI (#145186)
This PR disables the jest config on CI for `triggers_actions_ui` plugin
as it has been failing regularly during the entire day.

We are not sure about what is the problem but when running this test
suite the CI is logging `console.error` multiple times across many test
files warning around tests not being properly wrapped or using
unsupported syntax. Those should be fixed by the owning teams and I've
opened an issue for that at
https://github.com/elastic/kibana/issues/145188
2022-11-14 15:03:04 -07:00
Luke Gmys
f1be6057c8
[TIP] Run e2e pipeline on CI (#144776)
## Summary

Last week, our team has dicovered that e2e tests are not executed on CI,
this PR is an attempt to fix that.

Threat intel pipeline should be run whenever the `threat_intelligence`
plugin source or related tests config has changed.
2022-11-09 12:51:09 +01:00
Jonathan Budzenski
62c62c3c2c
[ci] Set elasticsearch snapshot build timeout (#144831)
We had a few stalled builds that timed out after 1d. Successful builds
typically take 15m-18m. This sets the timeout 30 minutes.
2022-11-08 12:07:37 -06:00
Spencer
e30ff8dfa1
always require ci on codeowners changes (#144728)
Fixes https://github.com/elastic/kibana/issues/144714
2022-11-07 10:41:00 -07:00
Thomas Watson
2e495074fd
Return session error message to client (#139811) 2022-11-07 13:35:47 +01:00
Tiago Costa
3dd5c5388e
chore(NA): update ci step name to Check Public API Docs (#144573)
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2022-11-04 02:27:23 +00:00
Dzmitry Lemechko
1505c0688d
attach-screenshots-from-journey-steps (#144447) 2022-11-03 16:17:55 +01:00
Dzmitry Lemechko
404d08f600
add gauge and saved search journeys (#144311)
Co-authored-by: Liza Katz <liza.katz@elastic.co>
2022-11-02 16:56:54 +02:00
Jonathan Budzenski
cf7d6cc6de
Remove buildbuddy cache (#144356)
* Remove buildbuddy cache

* Update .buildkite/scripts/steps/on_merge_ts_refs_api_docs.sh

* Update .buildkite/scripts/common/setup_bazel.sh
2022-11-01 15:23:24 -07:00
Spencer
af1230b7c4
[ci] remove github-checks-reporter (#144193) 2022-10-28 16:21:02 -05:00
spalger
fe2480d96d
[ts] ts refs cache was removed, remove capture task 2022-10-28 14:27:18 -05:00
spalger
e5d186a6f0
[ts] stop building @types packages in bootstrap 2022-10-28 14:03:55 -05:00
Yaroslav Kuznietsov
608a67ad45
[Lens][TSVB] Navigate to lens functional tests speed improvement. (#144043)
* Gauge functional tests fixed and speeded up.

* Metric functional tests fixed.

* Fixed timeseries tests.

* Fixed tests of topN.

* Added small fixes for dashboard.

* Fixed all tests.

* Splitted up open_in_lens functional tests.

* Fixed more tests.

* Fixed heatmap.

* Added more fixes for tests performance.

* Fixed mistake.

* Removed timeouts.

* Fixed createColorRule.

* Fixed getRhythmChartLegendValue.
2022-10-28 19:28:25 +03:00
Dzmitry Lemechko
ba227dcef5
[x-pack/performance] use es/kbn archives with sample data, load dashboard w/out map (#144100)
* [x-pack/performance] use es archives with sample data, load dashboards w/out map

* wait for chrome
map only test

* fix selector

* fix

* [journeys] open dashboard from dashboards list page

* remove waitForChrome

* fix waiting for map

* [CI] Auto-commit changed files from 'node scripts/eslint --no-cache --fix'

Co-authored-by: lizozom <liza.katz@elastic.co>
Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
2022-10-28 15:46:41 +02:00
Marshall Main
21c7f5e074
[Security Solution][Alerts] Refactor rule execution logic integration tests (#142679)
* Separate rule execution logic tests and move bulk of the tests to preview for speed

* Remove bad dependency

* Update unit test snapshot

* Fix flaky test

* Fix another flaky test

* Fix more imports

* Remove superfluous return type
2022-10-24 14:56:36 -07:00
Spencer
1994a162de
[lens] move open_in_lens out of ftr group3 (#143666) 2022-10-19 14:26:25 -07:00
Spencer
fcea2e7d4d
[ci/longFtrGroup] reduce annotation to warning, tell people not to worry (#143678) 2022-10-19 13:22:54 -07:00
Stratoula Kalafateli
9656163820
Language documentation popover package (#143429)
* Language documentation popover package

* Add readme

* [CI] Auto-commit changed files from 'node scripts/generate packages_build_manifest'

* [CI] Auto-commit changed files from 'node scripts/generate codeowners'

* Move the entire popover into the package, add stories

Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
2022-10-19 08:53:50 +03:00
Christos Nasikas
c5f6670d4e
[Cases] Backlink to cases in external services (#143174)
* Add backlink to cases

* Improve code

* Improve tests and add i18n

* Add alerts url

* Fix i18n

* PR feedback
2022-10-14 01:24:02 -07:00
Jonathan Budzenski
30e482bc8e
Re-enable Bazel cache on CI (#142975)
* Re-enable Bazel cache on CI

* remove exit test
2022-10-10 08:19:36 -05:00
Jonathan Budzenski
4997fdf5d5
Disable bazel cache on CI (#142873) 2022-10-06 10:18:22 -05:00
Tyler Smalley
47354fa7d3
[CI] Use 4 parallel ESLint jobs (#142787) 2022-10-05 14:59:46 -05:00
Jonathan Budzenski
63aee48127
[artifacts] Pass dependency manifest to release-manager CLI (#142408)
This passes the beats manifest used to download metricbeat and filebeat
for our cloud image to the release-manager CLI. This will be used to
validate that the bundled versions we use match the released versions.
2022-10-05 13:08:30 -05:00
Jonathan Budzenski
f1f2107584
[ci/cloud-deploy] Remove CI success requirement (#141965)
This removes the success requirement in the cloud deployment step for
pull requests.

Creating a cloud deployment from a pull request is optional and not
providing test coverage.  Failures are typically upstream and not
something that can be fixed from the Kibana repository.
2022-10-05 11:43:15 -05:00
Jonathan Budzenski
77eb8029c8
[artifacts] Reuse Cloud image for tests (#141828)
* [artifacts] Reuse Cloud image for tests

In https://github.com/elastic/kibana/pull/141657 we turned on Cloud
image builds in Kibana CI.  This updates the Cloud deployment test suite
to reuse the same image build.

* update comment
2022-10-04 12:48:45 -07:00
Giorgos Bamparopoulos
4a74dd383c
[APM] Record e2e tests to Cypress dashboard and enable screenshots, videos and test retries (#142398)
* Record e2e tests to Cypress dashboard and enable screenshots and videos

* Delete videos that have no failures or retries

* Set browser witdh and height for tests

* Fix flaky test for storage explorer

* Remove cypress plugin file

* Fix typo in spec name

* Enable test retries

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2022-10-04 20:01:39 +01:00
Alejandro Fernández Haro
74f30dcf8e
Move Cloud Integrations out of the cloud plugin (#141103)
Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
2022-10-04 12:25:25 +02:00
Jonathan Budzenski
7274c27218
[ci/build] Add label for building example plugins (#139720)
* [ci/build] Add label for building example plugins

* update snapshots

* remove plugins before tests

* fix

* fix again

* fix formatting
2022-09-29 14:18:19 -07:00
Ying Mao
16ca2d2895
[Event Log] Adding event log schema check to CI checks (#142104)
* Adding event log check to CI check.

* Adding event log check to CI check.

* Can I check out ECS

* Checking out specific ECS branch

* Checking out specific ECS branch

* Custom error message

* Reverting event log mapping test changes

* Pinning to 1.8

* Update .buildkite/scripts/steps/checks/event_log.sh

Co-authored-by: Jonathan Budzenski <jon@budzenski.me>

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
Co-authored-by: Jonathan Budzenski <jon@budzenski.me>
2022-09-29 07:53:50 -04:00
Maryam Saeidi
3f9687e3f0
[Actionable observability] Alert summary widget new design (#141236)
* Implement new alert summary widget design and remove chart

* Fix padding issue

* Remove unused translation

* Fix type and test errors

* Fix types and remove extra aggs logic

* Add triggers_actions_ui to storybook list

* Fix small alignment issue by removing extra EuiFlexGroup

* Fix UI issue for small mobile

* Update spacing

Co-authored-by: Kevin Delemme <kdelemme@gmail.com>

Co-authored-by: Kevin Delemme <kdelemme@gmail.com>
Co-authored-by: Xavier Mouligneau <xavier.mouligneau@elastic.co>
2022-09-29 12:22:58 +02:00
Spencer
249b596465
[journeys] restart ES for each journey, fix flakiness (#141530) 2022-09-26 08:56:31 -07:00
Spencer
65d3ade20d
[watcher] disable jest config in CI, it's regularly failing (#141677) 2022-09-23 10:50:47 -07:00
Jonathan Budzenski
f100343f41
[artifacts] Publish cloud artifacts (#141657)
* [artifacts] Publish cloud artifacts

This moves moves Cloud image publishing to Kibana CI

* fix build args

* rm comment
2022-09-23 11:53:57 -05:00
Dzmitry Lemechko
44ae5f7150
[scalability testing] fix path to config file (#141663) 2022-09-23 18:41:15 +02:00