Commit graph

139 commits

Author SHA1 Message Date
Kibana Machine
43fe3c62ce
adds lists plugin to security solution cypress tests execution (#116442) (#116494)
Co-authored-by: Gloria Hornero <snootchie.boochies@gmail.com>
2021-10-27 23:42:10 +01:00
Kibana Machine
8979cd3dbf
adds cases and timelines plugins to security solution cypress tests execution (#116245) (#116275)
Co-authored-by: Gloria Hornero <snootchie.boochies@gmail.com>
2021-10-26 15:36:47 +01:00
Kibana Machine
41c39deddd
Re-enable APM E2E tests and allow server to shut down cleanly on failure (#115450) (#116201)
* Re-enable APM E2E tests and allow server to shut down cleanly on failure

Calling `process.exit` in the test script made it so the FTR runner would not properly shut down the server, and cause other tests to fail because Kibana was left running on a port. Remove that and just throw
instead.

No changes were made to the tests, as I was unable to reproduce any failures locally. I'll try in CI and see if we can get anything to fail.

Fixes #115280.

Co-authored-by: Nathan L Smith <nathan.smith@elastic.co>
2021-10-25 22:37:42 +01:00
Brian Seeders
51fe34d2e2
Disable APM e2e tests 2021-10-15 17:36:48 -04:00
Kibana Machine
ec9140b7fa
Re-enable and fix APM E2E tests (#114831) (#115251)
* Re-enable previously disabled APM E2E tests.
* Round to the nearest second in `getComparisonTypes` to avoid cases where a millisecond difference can change which results get shown.
* Simplify error count alert tests to test the "happy path" (#79284 exists in order to expand to more tests for rule editing and creation.)
* Wait for alert list API request to complete before clicking "Create rule" button when running the test to create a rule from the Stack Management UI.

I ran the e2e tests 100 times locally with no failures so I'm confident the flakiness has been addressed.

Fixes #114419.
Fixes #109205.

Co-authored-by: Nathan L Smith <nathan.smith@elastic.co>
2021-10-15 16:58:42 -04:00
Tim Sullivan
c574769a22
[Reporting] Functional test structure & improvements (#114298) (#115021)
* [Reporting] Functional test structure & improvements

* show the error of the report generation failure in the test failure

* update snapshot

* remove import to non-existent functional app test

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-10-14 13:09:13 -04:00
Nathan L Smith
dd83d167d6
[APM] Disabling apm e2e test (#114544) (#114643) 2021-10-12 10:43:11 -04:00
Kibana Machine
8736e2571c
Bump hapi to a version with aborted request fix (#114414) (#114434)
* bump hapi to a version with aborted request fix

* enable apm functional tests

Co-authored-by: Mikhail Shustov <restrry@gmail.com>
2021-10-11 16:57:27 +00:00
Cauê Marcondes
88ded09bfa
[APM] Disabling apm e2e test (#113618) (#113787)
# Conflicts:
#	vars/tasks.groovy
2021-10-04 18:02:54 -04:00
Kibana Machine
98d7a37c73
[7.x] [Uptime] Run Sample uptime tests using @elastic/synthetics (#112128) (#113531)
* [Uptime] Run Sample uptime tests using @elastic/synthetics (#112128)

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>

* update test according to 7.x

* revert

Co-authored-by: Shahzad <shahzad.muhammad@elastic.co>
Co-authored-by: shahzad31 <shahzad31comp@gmail.com>
2021-10-04 16:28:53 +00:00
Brian Seeders
7a29c43dc1
[Buildkite] Hourly CI / tracked branch pipeline (#111785) (#112444)
# Conflicts:
#	test/functional/apps/bundles/index.js
#	vars/kibanaCoverage.groovy
2021-09-16 14:32:35 -04:00
Kibana Machine
c2f054f7a6
[ci] bump Jenkins worker memory and es JVM size (#111760) (#111787)
Co-authored-by: spalger <spalger@users.noreply.github.com>

Co-authored-by: Spencer <email@spalger.com>
Co-authored-by: spalger <spalger@users.noreply.github.com>
2021-09-09 20:39:43 +00:00
Kibana Machine
b2405e411a
[SavedObjects] Integration tests for unsupported product 404 responses (#109755) (#110552)
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>

Co-authored-by: Christiane (Tina) Heiligers <christiane.heiligers@elastic.co>
2021-08-30 23:03:12 -04:00
Kibana Machine
c0badda756
[buildkite] Move some functionality to a shared library (#102228) (#110071)
Co-authored-by: Brian Seeders <brian.seeders@elastic.co>
2021-08-25 16:53:10 +00:00
Spencer
b3a714db5d
[perf-testing] send detailed APM data from report generation (#107592) (#108257)
Co-authored-by: spalger <spalger@users.noreply.github.com>
# Conflicts:
#	x-pack/scripts/functional_tests.js
2021-08-11 17:12:00 -04:00
Kibana Machine
a4ee786ca8
[7.x] [APM] Add new ftr_e2e to kibana CI and remove current e2e tests. (#107593) (#108138)
* [APM] Add new ftr_e2e to kibana CI and remove current e2e tests. (#107593)

* fix newly introduced type error (#107593)

(cherry picked from commit 65a5cb1476)

Co-authored-by: Cauê Marcondes <55978943+cauemarcondes@users.noreply.github.com>
Co-authored-by: spalger <spalger@users.noreply.github.com>
2021-08-11 08:05:08 +00:00
Luke Elmers
6f31a759f4
[migrations v2] Integration test for multi-node cluster. (#100957) (#103559)
# Conflicts:
#	packages/kbn-test/src/es/test_es_cluster.ts
2021-06-28 18:34:31 -04:00
Tyler Smalley
6977be0140
Revert "Revert: [7.x] [FTR][CI] Use default distribution for all tests (#102019) (#102580)
* Revert "Revert: [7.x] [FTR][CI] Use default distribution for all tests (#102019)"

This reverts commit c272bdbc25.

* [FTR] Stabilize SSLP functional tests (#102553)

* Removes spaces check, since spaces should always be available
* Disables Monitoring, SecuritySolutions, and Reporting in SSPL tests
until #102552 is completed

Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-06-21 03:28:12 -04:00
Tyler Smalley
c272bdbc25
Revert: [7.x] [FTR][CI] Use default distribution for all tests (#102019)
* Revert "[FTR] Use importExport for saved_object/basic archive (#100244) (#102016)"

This reverts commit 9851b7bcfa.

* Revert "[7.x] [FTR][CI] Use default distribution for all tests (#94968) (#101118)"

This reverts commit 73225daa87.
2021-06-13 23:29:03 -07:00
Tyler Smalley
73225daa87
[7.x] [FTR][CI] Use default distribution for all tests (#94968) (#101118)
* [FTR][CI] Use default distribution for all tests (#94968)
* [FTR] Use importExport for saved_object/basic archive (#100244)

Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>
2021-06-12 09:53:10 -07:00
Kibana Machine
4f0781737c
[CI] For PRs, build TS refs before public api docs check (#100791) (#101128)
Co-authored-by: Brian Seeders <brian.seeders@elastic.co>
2021-06-01 23:20:47 -04:00
Tyler Smalley
52dd72e0a2 Revert "[7.x] [FTR][CI] Use default distribution for all tests (#94968) (#99980)"
This reverts commit be40e96806.
2021-05-28 17:21:51 -07:00
Tyler Smalley
be40e96806
[7.x] [FTR][CI] Use default distribution for all tests (#94968) (#99980)
* [FTR][CI] Use default distribution for all tests (#94968)

Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>

* Use default output

Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>

* [FTR] Use importExport for saved_object/basic archive

Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>

* Update suggestions tests

Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>

* Fix build

Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>

* More migrations to kbnArchiver

Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>
2021-05-28 15:25:52 -04:00
Kibana Machine
6b6c48dbcb
Automated package testing (#88900) (#100812)
Co-authored-by: Tyler Smalley <tylersmalley@me.com>
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>

Co-authored-by: Jonathan Budzenski <jon@budzenski.me>
Co-authored-by: Tyler Smalley <tylersmalley@me.com>
2021-05-27 20:33:04 +00:00
Kibana Machine
761dc11555
[CI] Don't do CI stats reporting/failures for feature branch PRs (#99668) (#99690)
Co-authored-by: Brian Seeders <brian.seeders@elastic.co>
2021-05-10 18:31:48 -04:00
Kibana Machine
2c08ac4bda
[CI] Always set checkoutInfo after git checkout (#99265) (#99296)
Co-authored-by: Brian Seeders <brian.seeders@elastic.co>
2021-05-04 21:16:31 -04:00
Brian Seeders
a82e2cbc59
[CI] Create a ciGroup just for tests that use Docker (#98535) (#99088)
# Conflicts:
#	test/scripts/jenkins_xpack_build_kibana.sh
2021-05-03 15:52:17 -04:00
Kibana Machine
d4b50fedf2
[CI] Use a new helper library for consistently cloning the repo (#98555) (#98630)
Co-authored-by: Brian Seeders <brian.seeders@elastic.co>
2021-04-28 13:12:41 -04:00
Kibana Machine
08c91529d0
Revert skips added while triaging ES OOMs (#97876) (#98067)
* Revert "skip flaky suite (#97382)"

This reverts commit e321f57f64.

* Revert "skip flaky suite (#97387)"

This reverts commit a89b756710.

* Revert "Skip test to try and stabilize master" (#97378)

This reverts commit 194355fdd3.

* upload heap dumps when they are created

Co-authored-by: spalger <spalger@users.noreply.github.com>
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>

Co-authored-by: Spencer <email@spalger.com>
Co-authored-by: spalger <spalger@users.noreply.github.com>
2021-04-22 16:53:49 -04:00
Kibana Machine
0e42317e60
Revert "Revert "[ci] skip building ts refs when not necessary (#95739)" (#95746)" (#95750) (#97493)
Co-authored-by: spalger <spalger@users.noreply.github.com>
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>

Co-authored-by: Spencer <email@spalger.com>
Co-authored-by: spalger <spalger@users.noreply.github.com>
2021-04-19 14:47:13 -04:00
Kibana Machine
58e4ee3a02
[ci] ship Jest unit test junit with runbld in jest worker (#97197) (#97342)
Co-authored-by: Brian Seeders <seeders@gmail.com>
Co-authored-by: spalger <spalger@users.noreply.github.com>

Co-authored-by: Spencer <email@spalger.com>
Co-authored-by: Brian Seeders <seeders@gmail.com>
Co-authored-by: spalger <spalger@users.noreply.github.com>
2021-04-19 16:54:08 +00:00
Stacey Gammon
0a2799d09d
Track API stats as part of ci (#95733) (#97306)
* Track stats and add extra output information

* Update api docs output

* Clean up id names

* update api docs

* Consolidate error messages and fix a bug

* Update docs

* Update get_declaration_nodes_for_plugin.ts

* Fix bug with removeBrokenLinks not being recursive

* Update docs

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
# Conflicts:
#	api_docs/data.json
#	api_docs/data_index_patterns.json
#	api_docs/data_search.json
#	api_docs/reporting.json
2021-04-15 16:47:21 -04:00
Kibana Machine
cfd530b75c
[CI] Don't retry steps after a build has been aborted or timed out (#96600) (#96651)
Co-authored-by: Brian Seeders <brian.seeders@elastic.co>
2021-04-08 19:40:18 -04:00
Kibana Machine
f78d202f30
pass script to bash to support scripts which aren't actually executable (#96198) (#96200)
Co-authored-by: spalger <spalger@users.noreply.github.com>

Co-authored-by: Spencer <email@spalger.com>
Co-authored-by: spalger <spalger@users.noreply.github.com>
2021-04-04 16:54:24 -04:00
spalger
ac0e25cfbe Revert "stop wrapping steps in runbld (#96195) (#96197)"
This reverts commit cda95da1c2.
2021-04-04 09:36:05 -07:00
Kibana Machine
cda95da1c2
stop wrapping steps in runbld (#96195) (#96197)
Co-authored-by: spalger <spalger@users.noreply.github.com>

Co-authored-by: Spencer <email@spalger.com>
Co-authored-by: spalger <spalger@users.noreply.github.com>
2021-04-04 09:18:14 -07:00
Kibana Machine
3d8702f87f
Revert "[ci] skip building ts refs when not necessary (#95739)" (#95746) (#95749)
This reverts commit e46a74f7

Co-authored-by: Pierre Gayvallet <pierre.gayvallet@gmail.com>
2021-03-30 02:04:11 -07:00
Kibana Machine
d79ef66ed9
[ci] skip building ts refs when not necessary (#95739) (#95740)
Co-authored-by: spalger <spalger@users.noreply.github.com>

Co-authored-by: Spencer <email@spalger.com>
Co-authored-by: spalger <spalger@users.noreply.github.com>
2021-03-30 02:53:57 -04:00
Kibana Machine
b34542b46a
[ci] disable api-docs step (#93975) (#93990)
Co-authored-by: spalger <spalger@users.noreply.github.com>

Co-authored-by: Spencer <email@spalger.com>
Co-authored-by: spalger <spalger@users.noreply.github.com>
2021-03-08 16:45:50 -05:00
Kibana Machine
447a04c704
[ci] separate checks done in bootstrap as individual tasks (#93329) (#93446)
(cherry picked from commit b790f4ca1761bc1fab7818318213833a9c7d092f)

Co-authored-by: spalger <spalger@users.noreply.github.com>

Co-authored-by: Spencer <email@spalger.com>
Co-authored-by: spalger <spalger@users.noreply.github.com>
2021-03-03 13:03:00 -05:00
Yara Tercero
fe84df1fa3
[ci] disable firefox scripts from security cypress job (#92483) (#92515)
Temporarily disabling security solution Firefox tests. Seem to be race conditions present in the Firefox run specifically causing flake.
# Conflicts:
#	.ci/Jenkinsfile_security_cypress
2021-02-23 17:38:25 -05:00
Kibana Machine
470d712a66
[CI] Convert ES Snapshots Verify job to use tasks (#92091) (#92460)
Co-authored-by: Brian Seeders <brian.seeders@elastic.co>
2021-02-23 18:55:24 +00:00
MadameSheema
e7e5c73aad
[Security Solution] Cypress tests executed on Firefox (#91524) (#92233)
* allows Cypress tests to be executed on Firefox

* fixes failing tests

* fixes issues

* fixes exceptions table failing test

* updates readme

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-02-22 14:01:11 -05:00
Kibana Machine
ab7cbad2f5
[CI] backportrc can skip CI (#91886) (#91968)
Co-authored-by: Brian Seeders <brian.seeders@elastic.co>
2021-02-18 23:12:13 -05:00
Kibana Machine
890ddce74f
[FTSR] Convert to tasks and add jest/api integration suites (#91770) (#91928)
Co-authored-by: Brian Seeders <brian.seeders@elastic.co>
2021-02-18 17:05:37 -05:00
Kibana Machine
854e833cf0
[CI] Build and publish storybooks (#87701) (#91917)
Co-authored-by: Brian Seeders <brian.seeders@elastic.co>
2021-02-18 16:26:10 -05:00
Kibana Machine
ee2e483382
[CI] Ping assignees on Github PR comments (#91871) (#91903)
Co-authored-by: Brian Seeders <brian.seeders@elastic.co>
2021-02-18 20:52:42 +00:00
Tyler Smalley
6502c8f8e0
[7.x] [CI] Combines Jest unit tests (#89948) (#90828)
* [CI] Combines Jest unit tests (#89948)

Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>
# Conflicts:
#	jest.config.oss.js
#	src/dev/code_coverage/shell_scripts/extract_archives.sh
#	test/scripts/jenkins_unit.sh
#	test/scripts/jenkins_xpack.sh
#	vars/kibanaCoverage.groovy
#	x-pack/jest.config.js

* Fix bad merge

Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>
2021-02-09 17:52:27 -05:00
Brian Seeders
2af05b14ca
[CI] Only delay ciGroup processes when using tasks (#90038) (#90093) 2021-02-02 20:23:41 -05:00
Brian Seeders
f3d24a5404
[CI] Remove TeamCity code (#90041) (#90095) 2021-02-02 20:23:18 -05:00