Commit graph

335 commits

Author SHA1 Message Date
Spencer
9871111cf6
[bazel] validate packages/BUILD.bazel in CI (#127241) 2022-03-14 21:34:28 -05:00
Spencer
62f8e58f11
[bk/flaky] fix env var for reusing artifacts (#127503) 2022-03-10 13:39:32 -07:00
Michael Olorunnisola
2dc753b262
[Security Solution][CI Stats] - Add cypress tests to flaky test runner (#127293) 2022-03-10 12:24:21 -05:00
Jonathan Budzenski
1b50cfb087
[demo env] Skip docker cloud build (#127459) 2022-03-10 09:03:17 -07:00
Jonathan Budzenski
ab109db73f
[package testing] Update networking profile to account for virtualbox update (#127298)
With a recent virtualbox update, we're getting failures in CI with:

> The IP address configured for the host-only network is not within the
> allowed ranges. Please update the address used to be within the allowed
> ranges and run the command again.

This updates the IP range used to be compatible.
2022-03-09 11:47:11 -06:00
Baturalp Gurdin
ee369db141
ci: discard configuration step and parallelism for performance test pipeline (#127288)
- Removes user input and env var for performance test iterations
- Changes performance test execution queue
- Removes parallelism, queue mechanisms
- Removes dynamic creation of performance sub-steps

Co-authored-by: Spencer <spencer@elastic.co>
2022-03-09 09:36:37 -07:00
Baturalp Gurdin
2e6d6c8954
add new cluster id (#127265)
* add new cluster id to single user performance tests

* refactor: remove duplicate login journey
2022-03-09 15:09:57 +01:00
Tyler Smalley
8c075c50d5
Increase timeout for Jest integration tests (#127220)
Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>
2022-03-08 15:29:34 -08:00
Baturalp Gurdin
2bb237fc4f
Add Playwright Service and New User Journeys for Performance tests (#124259)
add playwright service and single-user journeys for performance tests

-  Modifies @kbn/test package to call Playwright Service without constructor
- Adds Playwright service to performance tests
- Adds following performance user journeys:
  - Ecommerce Dashboard
  - Flights Dashboard & edit visualization
  - Weblogs Dashboard
  - Promotion Tracking Dashboard

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2022-03-08 19:56:00 +01:00
Brian Seeders
9b79234be9
Revert "[ci] Configure hourly pipeline for a small spot instance trial (#126824)"
This reverts commit 891b6cd83b.
2022-03-07 16:40:20 -05:00
Brian Seeders
2c7fe22a39
Revert "[CI] Expand spot instance trial a bit (#126928)"
This reverts commit 79935f3341.
2022-03-07 16:40:07 -05:00
Emilio Alvarez Piñeiro
0b876fe350
Add Synthetics flaky test runner pipeline config (#126602)
* Add flaky test runner pipeline config

* Add default value to grep expression if not set

* Add kibana build id override

* Add concurreny option (limited)
2022-03-04 17:51:07 +01:00
Brian Seeders
79935f3341
[CI] Expand spot instance trial a bit (#126928) 2022-03-04 11:19:22 -05:00
Brian Seeders
891b6cd83b
[ci] Configure hourly pipeline for a small spot instance trial (#126824) 2022-03-03 12:16:38 -05:00
Brian Seeders
c365e60819
[ci] Ensure every kibana pipeline has a non-default queue defined (#126641) 2022-03-02 10:56:03 -05:00
Jonathan Budzenski
db116e0568
[cloud deploy] Enable stack monitoring (#126278) 2022-02-23 14:46:39 -06:00
Jonathan Budzenski
f0cfbca673
[cft] Enable enterprise search, integrations server, and ml (#125847)
* wip

* cleanup

* fix syntax

* update all versions

* newline
2022-02-23 14:24:58 -06:00
Jonathan Budzenski
854e8a6b61
Remove ts refs build from bootstrap (#126005)
* Revert "Revert "Remove ts refs build from bootstrap (#125314)""

This reverts commit 8757e965fc.

* build ts refs cache if enabled
2022-02-17 16:58:53 -07:00
Tyler Smalley
e9d82d104b
Updates to Jest configuration (#125727) 2022-02-15 19:06:13 -07:00
Jonathan Budzenski
16f3eb352c
[ci] Verify docker contexts (#122897)
* [ci] Verify docker contexts

* bootstrap

* debug

* mkdir target

* change subdomain if snapshot

* move to separate pipeline

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2022-02-15 13:46:42 -06:00
Jonathan Budzenski
292c25d947
[cft] Generate update plan based on current configuration (#125317)
When a Cloud deployment is updated, we're reusing the original creation
template.  In cases where settings are manually overridden. these changes will be
lost when a deployment is updated.  Instead of using the base template,
this queries the cloud API for an update payload as a base.

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2022-02-15 13:35:33 -06:00
Clint Andrew Hall
21cef490f3
[kibana_react] Enable Storybook for all of kibana_react (#125589)
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2022-02-15 09:25:20 -06:00
Brian Seeders
31c44389a1
[ci] Retry failed steps in on-merge pipeline (#125550) 2022-02-14 12:16:32 -07:00
Tyler Smalley
435b772786
[ci] Splits Jest integration tests (#125454) 2022-02-14 17:12:42 +01:00
Jonathan Budzenski
9a63bb8130
[ci] Fix state check for purge cloud deployments (#124985)
Pull request state from GitHub returns 'OPEN' if a pull request is open.
This updates the capitalization when branching from state
2022-02-08 10:31:28 -06:00
Jonathan Budzenski
eb5ab3e23e
[cloud first testing] Purge vault when deployment is removed (#124761)
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2022-02-07 16:51:00 -06:00
Dzmitry Lemechko
f121c545cf
Collect code coverage for server side (#124277)
* [code coverage] collect coverage on server side

* fix script

* copy server coverage to functional

* [code coverage] run all e2e and api tests

* enable all configs for coverage, fix reportDir

* [code coverage] use KIBANA_DIR var

* create target/kibana-coverage/functional if not exist

* remove empty lines and unused code

* adjust include/exclude filters

* exclude more test-related paths

* Update functional nyc config

* Update server nyc config

* exclude more dirs

* exclude stub/
2022-02-07 17:17:48 +01:00
Jonathan Budzenski
f046541315
[cloud-first-testing] Automated deployments (#122102)
* [ci/cloud] Deploy docker image to cloud

* add git commit

* fix template path

* Split cloud build and deploy into separate step

* Remove file

* update field

* Add bootstrap

* WIP purge old cloud deployments

* Fix variable reference

* rm apm

* update path

* fix apm edit

* s/kibana/elasticsearch

* Fix purge bug, remove commit hash from deployment name, track deployment, grab logs and credentials from output

* Use n2-2 agent for cloud build/deploy, fix output flag

* Fix file path

* Use a tmp file for deployment json

* update if kibana exists

* Fix syntax error and skip build for now

* Don't skip build

* grab endpoints

* cleanup

* vault write

* redirect stderr

* refresh vault token

* fix id

* fix annotation

* cleanup

* Update .buildkite/scripts/steps/cloud/build_and_deploy.sh

Co-authored-by: Tyler Smalley <tylersmalley@gmail.com>

Co-authored-by: Brian Seeders <brian.seeders@elastic.co>
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
Co-authored-by: Tyler Smalley <tylersmalley@gmail.com>
2022-02-02 15:52:51 -06:00
Dominique Clarke
782f396822
[Uptime] overwrite SYNTHETICS_REMOTE_KIBANA_URL if defined in environment (#124183) 2022-02-01 13:30:30 -05:00
Clint Andrew Hall
940c4e2833
[cloud] Create IFRAME chat component; add to Unified Integrations (#123772)
* [cloud] Create IFRAME chat component; add to Unified Integrations

* Provide chat user data from endpoint

* Apply suggestions from code review

Co-authored-by: Luke Elmers <lukeelmers@gmail.com>

* Addressing feedback

* Addressing feedback

* Fixing package.json

* Addressing feedback

* Wrap chat config in an observable

* Add tests

* Add integration tests, docs

Co-authored-by: Sergei Poluektov <sergei.poluektov@elastic.co>
Co-authored-by: Luke Elmers <lukeelmers@gmail.com>
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2022-01-31 08:07:04 -06:00
Dominique Clarke
f197095f0b
[Uptime] Add UI Monitor Management and Synthetics Service e2e tests (#123410)
* add synthetics pipeline script

* remove artifacts step

* Revert "remove artifacts step"

This reverts commit ba751bca84.

* update pre_command and environment variables

* update grep

* update precommand and login

* update timeout

* adjust journey reusability

* adjust monitor breadcrumb journey

* adjust grep

* add logs

* update login username and password

* Update x-pack/plugins/uptime/e2e/page_objects/login.tsx

* Update .buildkite/scripts/steps/functional/synthetics.sh

* Update x-pack/plugins/uptime/scripts/e2e.js

* adjust grep

* update tests

* adjust script

* adjust journey names

* adjust grep

* increase timeout

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2022-01-26 13:54:51 -05:00
Brian Seeders
eef0285933
Skip PR builds in Buildkite for 7.11, 7.12 2022-01-26 11:49:19 -05:00
Tyler Smalley
a80acbb871
Resolves errors preventing ES snapshot promotion (#123649) 2022-01-26 10:11:36 -06:00
Jonathan Budzenski
54500ff091
[ci] Build and publish webpack bundle reports (#123659)
* [ci] Build and publish webpack bundle reports

* newline

* indent

* fix directory name

* fixes

* cleanup

* uncomment build plugins
2022-01-25 16:25:14 -06:00
Dzmitry Lemechko
0c6edb492b
[code coverage] create pipeline on Buildkite (#120364)
* [code coverage] buildkite pipeline

* [code coverage] move scripts to reporting folder

* [code coverage] increase retry count & request timeout, remove test logic

* use DISABLE_FAILED_TEST_REPORTER to ignore missing test results

* fix

* [ingestion] use legacy http driver

* print index page before upload

* Update packages/kbn-test/src/failed_tests_reporter/run_failed_tests_reporter_cli.ts

Co-authored-by: Brian Seeders <brian.seeders@elastic.co>

* remove step var

* change var to DISABLE_MISSING_TEST_REPORT_ERRORS

Co-authored-by: Brian Seeders <brian.seeders@elastic.co>
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2022-01-25 11:25:49 +01:00
Dominique Clarke
5789546067
[Uptime] UI Monitor Management/Synthetics Service e2e tests - add environment variables for service (#122552)
* add environment variables for service

* add SYNTHETICS_SERVICE_MANIFEST and basic tests

* Update x-pack/plugins/uptime/e2e/playwright_run.ts

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2022-01-18 15:53:10 -05:00
Brian Seeders
7a70f857f3
[package-testing] Fix docker testing (#123249) 2022-01-18 13:03:24 -05:00
Baturalp Gurdin
eeb5efcc62
Performance Tests for Login and Home Pages by using Playwright (#119681)
add performance tests for Login and Home pages

- [x] Rename and reduce the number of environment variables for performance test CI job
  - [x] ITERATION_COUNT_ENV =>  PERF_TEST_COUNT
  - [x] DISABLE_CACHE, TEST_RUNNER, TEST_THROTTLE_NETWORK removed
- [x] Use c2-16 queue for performance tests
- [x] Run performance tests by running ES and Kibana separately
- [x] Add warmup phase to performance tests (Not reported to APM). APM Label: PERF_TEST_PHASE
- [x] Add playwright dependency
- [x] Throttle network speed ( downloadThroughput: 750.000 B/s, uploadThroughput: 750.000 B/s, latency: 100 ms )
- [x] Disable cache by using - page.route (‘**’, ….)
- [x] Login and Home pages performance tests.
2022-01-18 14:00:06 +03:00
Brian Seeders
20d051fda4
[CI] Move REPORT_FAILED_TESTS_TO_GITHUB from repo yaml to pipeline definition (#122851) 2022-01-12 12:48:24 -05:00
Jonathan Budzenski
0493f00d7f
[ci/package-testing] Skip ubi and cloud build, update artifact glob (#122614) 2022-01-11 20:17:38 -06:00
Tomasz Ciecierski
75aadc6081
[Osquery] Add more e2e tests (#121487) 2022-01-11 13:50:56 +01:00
Clint Andrew Hall
b8e9b88403
[storybook] Enable Shared UX Storybook build in CI (#122598) 2022-01-10 15:35:16 -07:00
Brian Seeders
e4a52b6144
[buildkite] Migrate package-testing pipeline from Jenkins (#122450) 2022-01-10 16:45:40 -05:00
Brian Seeders
b67fec0ed3
[CI] Try to prevent npm/yarn problems from causing an agent to fail all future jobs (#122358) 2022-01-05 12:59:24 -06:00
Brian Seeders
f7934116c7
[ftsr] Fix flaky test suite runner jon when using buildkite UI (#122296) 2022-01-04 21:15:11 -05:00
Brian Seeders
dea1b3272d
[ci] Re-generate yarn.lock for buildkite deps to bump library version (#122055) 2021-12-27 16:24:04 -07:00
Spencer
5a9bd20b27
[ci/flaky] support triggering with config via the env (#122041) 2021-12-27 13:29:26 -07:00
Brian Seeders
1a39d78f54
Don't skip os packages (#121568) 2021-12-17 14:47:05 -07:00
Jonathan Budzenski
ca98cc682c
[build/docker] Replace CentOS base image with Ubuntu (#118928)
* [build/docker] Replace CentOS base image with Ubuntu

* update snapshots

* cleanup

* DEBIAN_FRONTEND=noninteractive

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-12-17 12:46:33 -06:00
Jonathan Budzenski
9e8df3678a
Revert "[ci/flaky] support triggering a with config via the env (#121215)" (#121470)
This reverts commit 3f321d1f42.
2021-12-16 17:19:14 -06:00