Commit graph

593 commits

Author SHA1 Message Date
Mike Côté
284418dc0b
Create test configs for Kibana running dedicated processes (#136677)
* Create test configs for Kibana running dedicated processes

* Fix TS issues

* Fix tests relying on backend responses

* Only run dedicated task process on spaces_and_security suite group2

* Fix ftr_configs

* Use dedicated task runner by default

* fix typo

* Remove exclusive test suite

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2022-08-23 10:37:51 -04:00
Spencer
ab576bb6c1
add a timeout to buildkite artifact downloads (#139046) 2022-08-18 09:50:34 -07:00
Alexey Antonov
5f84d8e071
[Lens] Move custom chart icons into lens package (#138413)
* [Lens] Move custom chart icons into lens package (#138101)

* [Lens] Move custom chart icons into lens package

Closes #135230

* add storybook

* fix merge conflicts

* [CI] Auto-commit changed files from 'node scripts/generate packages_build_manifest'

* clenaup

* add region_map icon into package

* fix styles

* Update README.md

* fix ci

* try to fix CI

* fix PR comments

* [CI] Auto-commit changed files from 'node scripts/eslint --no-cache --fix'

* RegionMap -> LensIconRegionMap

* lensIcons -> lens_icons

* move to x-pack packages

* [CI] Auto-commit changed files from 'node scripts/generate packages_build_manifest'

* move to x-pack/packages/lens/icons

* fix jest

Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>

* fix CI

* use emotion lib

* remove lensAnnotationIconNoFill and lensAnnotationIconFill

* remove duplicated code

* cleanup

* [CI] Auto-commit changed files from 'node scripts/generate packages_build_manifest'

* cleanup

* renaming

* fix jest config

* remove extra icons

* move icons out of main chunk

Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
2022-08-17 13:24:18 +03:00
Brian Seeders
c9a30dc27f
[CI] Use region-specific buckets for ci-proxy-cache for speed and cost savings (#138675) 2022-08-15 08:26:45 -07:00
Brian Seeders
16a83ec7c3
[CI] Remove unused agent configuration (#138771) 2022-08-15 10:26:57 -04:00
Jonathan Budzenski
1c59a09965
[cft] Stabilize deployment creation (#136974)
After a deployment is created, a new Kibana plan is automatically added to update settings (to connect APM)
and restart Kibana.  Polling for a plan state isn't especially reliable because it flips
between empty and queued, and then empty again depending on how quickly setup is run in cloud.
We want to enable monitoring after the automatic plan has run, if not we get an error:
* deployments.resource_plan_state_error: Kibana resource [main-kibana] has a plan still pending, cancel that or wait for it to complete (settings.observability.plan)
This adds a sleep and retry to see if we can make this step more reliable
2022-08-11 14:16:17 -07:00
Jonathan Budzenski
946e094637
[cft] Add support for creating a new deployment (#138243)
* [cft] Add support for creating a new redeployment

- Adds a new label `ci:cloud-redeploy` that will always create a fresh deployment
- Deprecates `ci:deploy-cloud` in favor of namespacing `ci:cloud-deploy`

* booleans
2022-08-11 14:56:44 -05:00
Aleh Zasypkin
69e54be4b6
Switch to the new Get User Profile request and response signatures. Fix Bulk Get User Profiles API to properly serialize parameters on the browser side. (#138361) 2022-08-11 16:51:24 +02:00
Walter Rafelsberger
9a1a963ae3
[ML] Explain Log Rate Spikes: Basic functional tests. (#138387)
Adds first functional tests for Explain Log Rate Spikes. The test clicks the menu item, selects an index, clicks the "Use full data" button and asserts the page's elements.
2022-08-11 10:51:51 +02:00
Brian Seeders
1019295b09
[CI] Improve reliability of macos bazel cache jobs (#138554) 2022-08-10 13:11:59 -07:00
Jonathan Budzenski
436f0df9a4
[ci] Use more optimizer threads (#138320) 2022-08-10 12:04:44 -04:00
Jonathan Budzenski
e2401c97e4
[ci] Fix build argument labels (#138322)
* [ci] Fix build arguments

* without quotes
2022-08-10 09:02:17 -05:00
Brian Seeders
4f100c4ed0
[CI] Convert the remaining steps in primary pipelines to spot instances (#138168) 2022-08-09 16:16:39 -04:00
Jonathan Budzenski
b3a38c4137 Revert "[Lens] Move custom chart icons into lens package (#138101)"
This reverts commit d89b2cb903.
2022-08-09 09:30:44 -05:00
Alexey Antonov
d89b2cb903
[Lens] Move custom chart icons into lens package (#138101)
* [Lens] Move custom chart icons into lens package

Closes #135230

* add storybook

* fix merge conflicts

* [CI] Auto-commit changed files from 'node scripts/generate packages_build_manifest'

* clenaup

* add region_map icon into package

* fix styles

* Update README.md

* fix ci

* try to fix CI

* fix PR comments

* [CI] Auto-commit changed files from 'node scripts/eslint --no-cache --fix'

* RegionMap -> LensIconRegionMap

* lensIcons -> lens_icons

* move to x-pack packages

* [CI] Auto-commit changed files from 'node scripts/generate packages_build_manifest'

* move to x-pack/packages/lens/icons

* fix jest

Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
2022-08-09 17:15:12 +03:00
Spencer
92fb5dbafc
[ci] mark PR stats as usable for metrics (#138297) 2022-08-08 14:12:04 -07:00
Brian Seeders
f37d7e1f2c
[CI] Enable skippable commits and skippable build step for PRs (#138300) 2022-08-08 13:16:25 -04:00
Jonathan Budzenski
723bd7bbea
[build] Move canvas runtime to core build, optionally skip step (#137683)
* [build] Move canvas runtime to core build, optionally skip step

- Moves the x-pack/build canvas runtime to src/dev/build.  The current
workflow is an artifact of the separate oss and default builds, which
were removed in 7.10.
- Adds a new flag `node scripts/build --skip-canvas-shareable-runtime`.
Currently the runtime takes ~3 minutes to build, and as far as I can
tell is untested in pull requests.  This should save us a few minutes
and CPU cycles, while preserving compatibility with upstream jobs.

* more flexible build args

* fix

* fix

* spacing

* trim spaces

* label

* Update .buildkite/scripts/build_kibana.sh

Co-authored-by: Spencer <email@spalger.com>

* remove preserve-symlinks

* fix ci stats plugin

Co-authored-by: Spencer <email@spalger.com>
2022-08-04 10:27:22 -05:00
Dzmitry Lemechko
007e6c5d98
[scalability testing] get ES queries for each single user performance journey (#137895)
* [kbn-performance-testing-dataset-extractor] fetch & save ES queries

* run apm extractor for all journeys

* fix array name

* cleanup ES query, update namings according review

* update naming
2022-08-03 14:46:39 +02:00
Kurt
5f27051c31
Addressing post-merge feedback on PR #136899 for removing calls to cat APIs and adding functional tests (#137524)
* PR Feedback changes

* [CI] Auto-commit changed files from 'node scripts/precommit_hook.js --ref HEAD~1..HEAD --fix'

* Changing functional test to use es api instead of esArchiver

* [CI] Auto-commit changed files from 'node scripts/precommit_hook.js --ref HEAD~1..HEAD --fix'

* Removing unnecessary override

* adding retry

* Changing to use `filter_path` for the api client

Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
2022-08-03 07:34:44 -04:00
Brian Seeders
5b1e073e2f
Re-add kibana_build_reuse_label to PR config temporarily 2022-08-02 15:41:26 -04:00
Brian Seeders
a74c3fab96
[CI] Enable kibana build reuse where possible (#136653) 2022-08-02 15:39:02 -04:00
Jonathan Budzenski
22b21645bb
[ci] Conditional storybook builds (#136219)
* [ci] Conditional storybook builds

This moves storybook builds to run conditionally, either if there's a
storybook change or the `ci:build-storybooks` label is set.

These builds don't seem to be providing test coverage, and may not be utilized
in scenarios such as automated backports or unrelated changes.

* test regex

* formatting

* Revert "test regex"

This reverts commit dcef465414.

* fix revert

* move to spot instance

* fix merge
2022-08-02 11:24:01 -05:00
Jonathan Budzenski
d279696bc7
[artifacts] Fix deployment termination on error (#137771)
* [artifacts] Fix deployment termination on error

* fix conditional
2022-08-02 11:00:19 -05:00
Jonathan Budzenski
943cde8f56
[cft] Exit 1 if purge error (#137733)
* [cft] Exit 1 if purge error

This triggers a job failure if the purge-cloud-deployments script
encounters an error.  I'm attempting to debug why an instance was stuck
online and hoping this will make future issues easier to spot.

* set exit code instead of exiting
2022-08-02 08:32:34 -05:00
Spencer
742e040ae3
[ftr/discover] split up configs (#137629) 2022-08-01 06:48:17 -05:00
Kurt
5b1bca9abb
Replacing call to 'cat' API with 'indices' API (#136899)
* Replacing call to 'cat' API with 'indices' API

* Adding functional tests for Unsecured Cluster Alert

* [CI] Auto-commit changed files from 'node scripts/precommit_hook.js --ref HEAD~1..HEAD --fix'

* Changing the JUnit description

Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
2022-07-28 08:48:37 -04:00
Shahzad
8b0d873e1e
[Synthetics] Fix e2e (#137194)
* fix e2e

* update test
2022-07-26 17:40:07 -04:00
Bhavya RM
004cfbb227
Migrating test/new_visualize_flow/fixtures/es_archiver/kibana to kbnArchiver (#136768) 2022-07-26 11:59:25 -04:00
Dominique Clarke
679b7259eb
[Synthetics] Skip e2e tests (#137105)
* Update add_monitor_private_location.ts

* skip test

* Update x-pack/plugins/synthetics/e2e/journeys/private_locations/add_monitor_private_location.ts

* Apply suggestions from code review

* Apply suggestions from code review

* skip synthetics e2e tests tests

* Update vars/tasks.groovy

* Update vars/tasks.groovy

* skip test suite

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
Co-authored-by: Shahzad <shahzad.muhammad@elastic.co>
2022-07-26 11:09:36 -04:00
Spencer
0154f75445
[ci-stats] ship buildkiteJobId with metrics and support backfilling (#137123) 2022-07-25 22:24:57 -05:00
Tiago Costa
242c91a432
fix(NA): buildkite es_snapshot build job after es default branch rename to main (#137109) 2022-07-25 12:43:35 -07:00
Philippe Oberti
19aa51e5a8
[TIP] Add new Threat intelligence plugin (#136479)
* [TIP] Add Threat Intelligence plugin

- create Threat Intelligence plugin and integrate with Security Solution plugin
- setup jest unit tests, i18n, Cypress tests and  Storybook
- fetch Indicator of Compromise, and display in data-grid
- add flyout components to show IOCs details (table and JSON)
- add new threatIntelInt entry to kbn-doc-links package

https://github.com/elastic/security-team/issues/4329
https://github.com/elastic/security-team/issues/4138
https://github.com/elastic/security-team/issues/4241
https://github.com/elastic/security-team/issues/4242
https://github.com/elastic/security-team/issues/4244
https://github.com/elastic/security-team/issues/4245

Co-authored-by: lgmys <lgmys@pm.me>
Co-authored-by: Maxim Kholod <maxim.kholod@elastic.co>
Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
2022-07-25 19:27:05 +02:00
Brian Seeders
20dec08bf1
[CI] Parallelize eslint to speed it up (#136972) 2022-07-22 16:23:17 -04:00
Aleh Zasypkin
ac15ee4540
Introduce suggest user profile functionality. (#135063) 2022-07-21 02:18:21 -07:00
Dzmitry Lemechko
10cd177456
[kbn-performance-testing-dataset-extractor] update json structure, filter out static resources on ci (#136651)
* [kbn-performance-testing-dataset-extractor] update json structure, filter out static res on ci

* convert body to string

* update schema and ftr configs

* update extractor

* fix headers combining

* update json structure

* re-order fields for easy read
2022-07-21 10:42:36 +02:00
Jonathan Budzenski
1410bc4aa5
[cft] Add pipeline to shutdown deployment (#136659)
* [cft] Add pipeline to shutdown deployment

* 755

* save file
2022-07-20 10:22:25 -05:00
Brian Seeders
7f70f91e0c
[CI] Enable experimental PR kibana build re-use gated behind a label (#136577) 2022-07-19 11:17:06 -04:00
Dzmitry Lemechko
b72601c283
[performance] Re-enable apm extraction step (#136555)
* [kbn-performance-testing-dataset-extractor] add extra logging

* re-enable step
2022-07-19 09:35:54 +02:00
Spencer
4f817ad8a0
[kbn/pm] rewrite to avoid needing a build process (#136207)
* [kbn/pm] rewrite to avoid needing a build process

* uncomment timing reporting

* throw in a few missing comments

* Update README.md

* remove extra SomeDevLog interface from ci-stats-core

* remove non-stdio logging from bazel_runner, improve output formatting

* use private fields instead of just ts private props

* promote args to a positional arg

* optionally require the ci-stats-reporter after each command

* allow opt-ing out of vscode config management

* reduce to a single import

* add bit of docs regarding weird imports and package deps of kbn/pm

* clean extraDirs from Kibana's package.json file too

* tweak logging of run-in-packages to use --quiet and not just CI=true

* remove unlazy-loader

* add readme for @kbn/yarn-lock-validator

* convert @kbn/some-dev-logs docs to mdx

* remove missing navigation id and fix id in dev-cli-runner docs

* fix title of some-dev-logs docs page

* typo
2022-07-18 08:46:13 -07:00
Jonathan Budzenski
33b743c84e
Revert "Remove percy based visual regression tests (#136359)" (#136437)
* Revert "Remove percy based visual regression tests (#136359)"

This reverts commit a91aeb42ff.

* update codeowners
2022-07-14 14:53:12 -05:00
Jonathan Budzenski
a91aeb42ff
Remove percy based visual regression tests (#136359)
* Remove percy based visual regression tests

These have been disabled for ~3 years, the agent is deprecated, and our
snapshot environment is inactive.

* [CI] Auto-commit changed files from 'yarn kbn run build -i @kbn/pm'

* update codeowners

Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
2022-07-14 10:03:49 -07:00
Jonathan Budzenski
b5b735625c
[cft] Use spot instance (#135742)
* [cft] Use spot instance, increase cpu

* revert back to n2

* Update .buildkite/pipelines/pull_request/deploy_cloud.yml

Co-authored-by: Tyler Smalley <tylersmalley@gmail.com>

Co-authored-by: Tyler Smalley <tylersmalley@gmail.com>
2022-07-12 14:55:50 -05:00
Jonathan Budzenski
8acc1466f8
[ci] Conditonal webpack bundle reports (#136215)
* [ci] Conditonal webpack bundle reports

* fix

* spacing

* \n

* fix file path
2022-07-12 12:30:49 -05:00
Baturalp Gurdin
d83f802099
stop scalability step in performance pipeline (#136211)
Co-authored-by: Spencer <spencer@elastic.co>
2022-07-12 09:14:18 -07:00
Nicolas Chaulet
6200623042
[Fleet] Run install all packages in CI (#136035) 2022-07-08 18:49:46 -04:00
Jonathan Budzenski
87ac0fd2fe
[docker] Add ubi9 image (#135868)
* [docker] Add ubi9 image

* update artifacts tests

* cleanup

* fixes

* formatting
2022-07-08 12:02:59 -05:00
spalger
7731c414db [ci] build webpack bundle repotrs on a larger machine
We've seen OOMs on this recently, to prevent blocking more people we're just going to bump the instance size until we can narrow down the problem.
2022-07-08 08:44:00 -05:00
Spencer
75df3eaf74
[ci] prevent failures caused by excluding function configs (#135962) 2022-07-07 16:51:29 -07:00
Baturalp Gurdin
7db0773a0d
fix es wait logic during the performance tests (#135660) 2022-07-07 05:18:44 -07:00