Commit graph

301 commits

Author SHA1 Message Date
Brian Seeders
1019295b09
[CI] Improve reliability of macos bazel cache jobs (#138554) 2022-08-10 13:11:59 -07:00
Jonathan Budzenski
436f0df9a4
[ci] Use more optimizer threads (#138320) 2022-08-10 12:04:44 -04:00
Jonathan Budzenski
e2401c97e4
[ci] Fix build argument labels (#138322)
* [ci] Fix build arguments

* without quotes
2022-08-10 09:02:17 -05:00
Brian Seeders
4f100c4ed0
[CI] Convert the remaining steps in primary pipelines to spot instances (#138168) 2022-08-09 16:16:39 -04:00
Jonathan Budzenski
b3a38c4137 Revert "[Lens] Move custom chart icons into lens package (#138101)"
This reverts commit d89b2cb903.
2022-08-09 09:30:44 -05:00
Alexey Antonov
d89b2cb903
[Lens] Move custom chart icons into lens package (#138101)
* [Lens] Move custom chart icons into lens package

Closes #135230

* add storybook

* fix merge conflicts

* [CI] Auto-commit changed files from 'node scripts/generate packages_build_manifest'

* clenaup

* add region_map icon into package

* fix styles

* Update README.md

* fix ci

* try to fix CI

* fix PR comments

* [CI] Auto-commit changed files from 'node scripts/eslint --no-cache --fix'

* RegionMap -> LensIconRegionMap

* lensIcons -> lens_icons

* move to x-pack packages

* [CI] Auto-commit changed files from 'node scripts/generate packages_build_manifest'

* move to x-pack/packages/lens/icons

* fix jest

Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
2022-08-09 17:15:12 +03:00
Jonathan Budzenski
723bd7bbea
[build] Move canvas runtime to core build, optionally skip step (#137683)
* [build] Move canvas runtime to core build, optionally skip step

- Moves the x-pack/build canvas runtime to src/dev/build.  The current
workflow is an artifact of the separate oss and default builds, which
were removed in 7.10.
- Adds a new flag `node scripts/build --skip-canvas-shareable-runtime`.
Currently the runtime takes ~3 minutes to build, and as far as I can
tell is untested in pull requests.  This should save us a few minutes
and CPU cycles, while preserving compatibility with upstream jobs.

* more flexible build args

* fix

* fix

* spacing

* trim spaces

* label

* Update .buildkite/scripts/build_kibana.sh

Co-authored-by: Spencer <email@spalger.com>

* remove preserve-symlinks

* fix ci stats plugin

Co-authored-by: Spencer <email@spalger.com>
2022-08-04 10:27:22 -05:00
Dzmitry Lemechko
007e6c5d98
[scalability testing] get ES queries for each single user performance journey (#137895)
* [kbn-performance-testing-dataset-extractor] fetch & save ES queries

* run apm extractor for all journeys

* fix array name

* cleanup ES query, update namings according review

* update naming
2022-08-03 14:46:39 +02:00
Brian Seeders
a74c3fab96
[CI] Enable kibana build reuse where possible (#136653) 2022-08-02 15:39:02 -04:00
Jonathan Budzenski
22b21645bb
[ci] Conditional storybook builds (#136219)
* [ci] Conditional storybook builds

This moves storybook builds to run conditionally, either if there's a
storybook change or the `ci:build-storybooks` label is set.

These builds don't seem to be providing test coverage, and may not be utilized
in scenarios such as automated backports or unrelated changes.

* test regex

* formatting

* Revert "test regex"

This reverts commit dcef465414.

* fix revert

* move to spot instance

* fix merge
2022-08-02 11:24:01 -05:00
Jonathan Budzenski
d279696bc7
[artifacts] Fix deployment termination on error (#137771)
* [artifacts] Fix deployment termination on error

* fix conditional
2022-08-02 11:00:19 -05:00
Jonathan Budzenski
943cde8f56
[cft] Exit 1 if purge error (#137733)
* [cft] Exit 1 if purge error

This triggers a job failure if the purge-cloud-deployments script
encounters an error.  I'm attempting to debug why an instance was stuck
online and hoping this will make future issues easier to spot.

* set exit code instead of exiting
2022-08-02 08:32:34 -05:00
Shahzad
8b0d873e1e
[Synthetics] Fix e2e (#137194)
* fix e2e

* update test
2022-07-26 17:40:07 -04:00
Dominique Clarke
679b7259eb
[Synthetics] Skip e2e tests (#137105)
* Update add_monitor_private_location.ts

* skip test

* Update x-pack/plugins/synthetics/e2e/journeys/private_locations/add_monitor_private_location.ts

* Apply suggestions from code review

* Apply suggestions from code review

* skip synthetics e2e tests tests

* Update vars/tasks.groovy

* Update vars/tasks.groovy

* skip test suite

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
Co-authored-by: Shahzad <shahzad.muhammad@elastic.co>
2022-07-26 11:09:36 -04:00
Tiago Costa
242c91a432
fix(NA): buildkite es_snapshot build job after es default branch rename to main (#137109) 2022-07-25 12:43:35 -07:00
Brian Seeders
20dec08bf1
[CI] Parallelize eslint to speed it up (#136972) 2022-07-22 16:23:17 -04:00
Dzmitry Lemechko
10cd177456
[kbn-performance-testing-dataset-extractor] update json structure, filter out static resources on ci (#136651)
* [kbn-performance-testing-dataset-extractor] update json structure, filter out static res on ci

* convert body to string

* update schema and ftr configs

* update extractor

* fix headers combining

* update json structure

* re-order fields for easy read
2022-07-21 10:42:36 +02:00
Jonathan Budzenski
1410bc4aa5
[cft] Add pipeline to shutdown deployment (#136659)
* [cft] Add pipeline to shutdown deployment

* 755

* save file
2022-07-20 10:22:25 -05:00
Spencer
4f817ad8a0
[kbn/pm] rewrite to avoid needing a build process (#136207)
* [kbn/pm] rewrite to avoid needing a build process

* uncomment timing reporting

* throw in a few missing comments

* Update README.md

* remove extra SomeDevLog interface from ci-stats-core

* remove non-stdio logging from bazel_runner, improve output formatting

* use private fields instead of just ts private props

* promote args to a positional arg

* optionally require the ci-stats-reporter after each command

* allow opt-ing out of vscode config management

* reduce to a single import

* add bit of docs regarding weird imports and package deps of kbn/pm

* clean extraDirs from Kibana's package.json file too

* tweak logging of run-in-packages to use --quiet and not just CI=true

* remove unlazy-loader

* add readme for @kbn/yarn-lock-validator

* convert @kbn/some-dev-logs docs to mdx

* remove missing navigation id and fix id in dev-cli-runner docs

* fix title of some-dev-logs docs page

* typo
2022-07-18 08:46:13 -07:00
Jonathan Budzenski
8acc1466f8
[ci] Conditonal webpack bundle reports (#136215)
* [ci] Conditonal webpack bundle reports

* fix

* spacing

* \n

* fix file path
2022-07-12 12:30:49 -05:00
Nicolas Chaulet
6200623042
[Fleet] Run install all packages in CI (#136035) 2022-07-08 18:49:46 -04:00
Jonathan Budzenski
87ac0fd2fe
[docker] Add ubi9 image (#135868)
* [docker] Add ubi9 image

* update artifacts tests

* cleanup

* fixes

* formatting
2022-07-08 12:02:59 -05:00
Baturalp Gurdin
7db0773a0d
fix es wait logic during the performance tests (#135660) 2022-07-07 05:18:44 -07:00
Spencer
9619311120
[ci] fix ftr script when called with parallelism (#135713)
* fix ftr script when called with parallelism

* Update ftr_configs.sh
2022-07-05 09:14:26 -05:00
Spencer
ed51e0fe0a
[testGroupRunOrder] allow defining a queue name for each ftr config (#135349) 2022-06-30 14:12:06 -07:00
Jonathan Budzenski
7fd3beee4e
[artifacts] Stabilize package testing (#134854)
* bump ansible logging verbosity

* upgrade base os

* update base images

* add specificity to docker image glob

* limit memory

* bump base vm memory

* more cpu

* decrease verbosity

* less downloads

* disable shared symlinks

* more logging

* bump concurrency to test stability

* add concurrency group

* revert

* parallelism

* Revert "parallelism"

This reverts commit 4cc00f7144.
2022-06-30 16:00:15 -05:00
Clint Andrew Hall
e564f1f5bc
[home] Create Sample Data Card package (#135472)
* [home] Create Sample Data Card package

* Fix issues found in CI

* Update packages/home/sample_data_cards/src/sample_data_card.component.tsx

Co-authored-by: Caroline Horn <549577+cchaos@users.noreply.github.com>

* Update packages/home/sample_data_cards/src/footer/remove_footer.tsx

Co-authored-by: Caroline Horn <549577+cchaos@users.noreply.github.com>

* Addressing review feedback

* Fix i18n, reduce dependencies

* Update docs and snaps; add tests

Co-authored-by: Caroline Horn <549577+cchaos@users.noreply.github.com>
2022-06-30 15:53:08 -05:00
Jonathan Budzenski
7f776252d9
[cft] Enable verbose logging (#134262)
* [cft] Enable verbose logging

* fix

* fix merge
2022-06-30 12:59:52 -05:00
Brian Seeders
82b5d8e120
[CI] Install global npm modules with a retry and failsafe (#135437) 2022-06-30 10:46:47 -04:00
Jonathan Budzenski
fa8b7c952a
[cft] Improve error handling (#134519)
* [cft] Write to vault as soon as deployment is ready

* cleanup

* add status logging

* quicker rebuilds

* log stderr

* login

* fix conditional

* disable self logging

* cleanup logging

* cleanup
2022-06-29 15:13:35 -05:00
Jonathan Budzenski
66b161a3e0
[ci] Support publishing a cloud image without deploying (#135044)
* [ci] Support publishing a cloud image without deploying

* auth
2022-06-29 10:12:02 -07:00
Julia Bardi
f320b3302a
[Fleet] add upload report to cypress tests (#135282)
* add upload report to cypress tests

* added missing cypress reporter

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2022-06-29 09:13:11 -05:00
Brian Seeders
0b0b68786a
[CI] Move kibana-buildkite-library into kibana (#134787) 2022-06-28 13:19:05 -04:00
Shahzad
d6f2dc1042
[Exploratory view] Add e2e tests (#135148)
Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
2022-06-28 13:31:12 +02:00
Dzmitry Lemechko
d86f977884
[performance] re-enable scalability dataset extraction step on CI (#134719)
* add scalability setup for login and promotion_tracking_dashboard journeys, re-enable step on ci

* update query to get single ftr transaction

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2022-06-24 16:18:41 +02:00
Spencer
61b5349d95
[SUPT] fix apm reporting (#135071) 2022-06-23 12:10:57 -07:00
Baturalp Gurdin
64771d921f
correct apm server url (#135054) 2022-06-23 10:03:31 -07:00
Tre
85dc5b3578
[QA][Code Coverage] Add meta data links ci runs. (#134731)
* [QA][Code Coverage] Add a link to discover pinned to the current build.

When personnel other than myself wish to visually verify code coverage,
this link will be available in the ci output.

* Drop single quotes.

* Add annotation per J Budz.

* Fixup text.

* Drop debug.
2022-06-23 16:00:48 +01:00
Baturalp Gurdin
e5d73a1169
ingest performance metrics to ci-stats (#134792) 2022-06-22 15:44:11 -07:00
Jonathan Budzenski
2010a56a35
[ci] Fix ci:build-* labels (#134862)
* debugging

* source utils

* remove debugging
2022-06-22 08:54:37 -05:00
Pierre Gayvallet
10a5f9ac83
Remove old doc generation system for core APIs (#134313)
* Remove old doc generation system for core APIs

* delete docs/development/core folder
2022-06-21 17:43:17 +02:00
Vitalii Dmyterko
746e259733
[Security Solution] fixes flaky-test-runner Cypress Security Solution tests (#134205)
## Summary

Fixes issue with security solution cypress flaky test runner

After introducing [dynamic split for cypress tests in Security Solution](https://github.com/elastic/kibana/pull/125986), there was discovered an issue with flaky test runner, which is using parallelism in slightly different manner: https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/697#_: tests were evenly split between N jobs, instead of repeating tests N times(as N jobs)

So, for flaky runner, I introducing a new ENV variable that would disable split for tests between parallel jobs and instead would run all test per each job.

Here is link to flaky runner build from this PR, which shows that all test runs per job
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/736
2022-06-16 09:29:17 +01:00
Brian Seeders
95d3090f1a
[es-snapshots] Disable caching on es snapshot manifests (#134525) 2022-06-15 14:24:27 -07:00
Brian Seeders
b32052e66a
[CI] Trigger pipeline deploy when versions.json changes (#134387) 2022-06-15 10:47:35 -04:00
Kibana Machine
0d2e8e62ab
[api-docs] 2022-06-14 Daily api_docs build (#134407) 2022-06-15 10:47:12 -04:00
Kibana Machine
0cb1087fb4
[api-docs] 2022-06-14 Daily api_docs build (#134389)
* [api-docs] Add pipeline to build api_docs daily

* Fix kibanamachine remote

* Add --repo

* Fix PR creation

* [api-docs] Daily api_docs build

Co-authored-by: Brian Seeders <brian.seeders@elastic.co>
2022-06-14 12:58:55 -07:00
Jonathan Budzenski
cde209b23a
[artifacts] Fallback to port 443 when testing cloud deployments (#134279)
* [artifacts] Fallback to port 443 when testing cloud deployments

The provided endpoint for ES from cloud no longer contains a port.  When
a port is not provided to the FTR, it defaults to 9220 causing a
connection timeout.  This sets the fallback to 443 instead.

* use process.env instead of interpolation
2022-06-13 15:11:30 -07:00
Tre
d92440e631
[QA][Code Coverage] Modularize Code Coverage (#133759)
Kinda sneaky...since we already mutate the jest portion of the
file system (target/kibana-coverage/jest)
by dumping "jest unit" & "jest integration" coverage
into the same "final" directory...go ahead an make "jest integration"
use the same ran file designator as "jest unit".
This saves me from having to add logic for this later on.
2022-06-13 15:40:59 +01:00
Jonathan Budzenski
3afe960302 [artifacts] fix download, partial revert of #134046 2022-06-10 08:12:39 -05:00
Jonathan Budzenski
fa4d1020fb
[artifacts] Remove docker cloud context verification (#134046)
This test was added as a verification step for daily releasable
artifacts.  We had originally planned on the release manager consuming
this context.  The expected workflow has changed now to us building and
publishing the docker image instead, which already has coverage in the
Build and Deploy to Cloud step.
2022-06-09 11:44:39 -05:00