Commit graph

18 commits

Author SHA1 Message Date
Brian Seeders
2f07217764
[7.4] Add PR comments to pipeline (#51504) (#52145) 2019-12-03 20:36:07 -05:00
Brian Seeders
ee4c509bc3
[7.4] Experimenting with delay in test startup (#51459) (#52012)
* Experimenting with delay in test startup

* Move firefox tests sooner becuase they take a long time to run

* Move functional test parallel process delay to a spot that should work better for flaky test runner
2019-12-02 17:33:54 -05:00
Brian Seeders
20aeaab3ad
Change pipeline timeout from 3 hours to 2 hours (#51098) (#51220) 2019-11-20 15:58:41 -05:00
Brian Seeders
4160f2601b
[7.4] Add labels to shell scripts in Jenkins (#49657) (#50796) 2019-11-15 14:47:46 -05:00
Brian Seeders
99ff78c3f8
Re-add pipeline for flaky test runner job (#48781) (#49907)
* Revert "Revert "Add pipeline for flaky test runner job (#46740)""

This reverts commit 7d96a13fad.

Also reconcile changes to Jenkinsfile since original revert happened

* Fix param parsing and add missed change

* Add missing variable
2019-11-15 11:56:12 -05:00
liza-mae
59b545e5f1
Enable visual tests (#47861) (#49805)
* Enable visual tests

* Uncomment visual tests jobs

* More testing - use dev token and only run visual tests

* Fix dev token

* Fix token again

* Skip infra tests

* Set style of table

* Try setting discover sample size

* Fix Jenkinsfile

* Remove login_page test from config (it skipped but failing)

* Remove line

* Prep to merge, revert token and update Jenkinsfile

* Try skipping at Security level, instead of removing from config
2019-10-31 09:52:13 -06:00
Brian Seeders
db18e2c600
[7.4] Add ability to use ram disk for jenkins workspace (#4774… (#48668)
* Add ability to use ram disk for jenkins workspace

* Re-combine ciGroup agents

* Address some PR feedback / questions

* Add --preserve-root
2019-10-21 15:05:59 -04:00
Spencer
9293ea9ff5
[7.4] refactor failed_tests_reporter to use TS, no octokit (#4… (#47632)
* refactor failed_tests_reporter to use TS, no octokit (#46993)

* refactor failed_tests_reporter to use TS, no octokit

* update renovate config

* ensure that all kbn-test files are in ts project

* fix some type errors

* add some more tests

* [kbn-test/githubapi] cleanup and document

* collect log messages as strings instead of message objects

* ensure issue is open when updating body

* improve readability of getKibanaIssues

* expose axios helpers from dev-utils

* fix request params for fetching github issues and validate locally

* include a README for failed_tests_reporter

* improve axios error helpers

# Conflicts:
#	package.json
#	packages/kbn-test/src/index.ts
#	packages/kbn-test/src/mocha/junit_report_generation.js
#	renovate.json5
#	src/dev/jest/junit_reporter.js
#	yarn.lock

* ensure all of kbn-test is in ts project
2019-10-09 09:47:19 -07:00
Spencer
8b6dd79c8e
[7.4] try running fewer jobs in parallel on the same worker (#… (#47418) 2019-10-05 21:58:26 -07:00
Brian Seeders
9a03c6ca5e
[7.4] Use different method of determining build status in pipe… (#46840)
* Switch method of determining build status for pipeline jobs to handle aborted builds better
2019-09-30 16:28:03 -04:00
Spencer
c572c01ebc
[7.4] Re-split ciGroups after pipeline rollout (#46375) (#46644)
* Re-split ciGroups after pipeline rollout

Revert "Revert "Revert "Revert "Revert "[ci] compress jobs for CI stab… (#45454)"

This reverts commit 9a109f2170.

Revert "set IS_PIPELINE_JOB in intake jobs (#45850)"

This reverts commit b1a01effa8.

* Split one of the slow test suites up to try to make overall CI faster

* Disable visualRegression groups, they are being handled in other work

* Revert "Split one of the slow test suites up to try to make overall CI faster"

This reverts commit 1213239545.

* Move some different xpack ciGroup8 suites around
2019-09-25 17:22:06 -07:00
Brian Seeders
7677f02390
[7.4] Run pipeline scripts with runbld (#45844) (#46021)
Change how runbld is invoked, and skip junit processing by default
2019-09-18 13:17:03 -04:00
Spencer
327a75502c
[7.4] set IS_PIPELINE_JOB in intake jobs (#45850) (#45921)
* set IS_PIPELINE_JOB in intake jobs

* firefox smoke doesn't get an initial build

* firefox smoke doesn't get an initial build (oss edition)

* re-enable all jobs
2019-09-17 14:42:39 -07:00
Brian Seeders
bbf2d72e7b
Fix a few issues related to sending emails in pipeline (#45470) (#45727) 2019-09-16 13:28:18 -04:00
Spencer
ead2468742
[7.4] Call failure reporter directly from Jenkinsfile (#45551) (#45669)
* Run failed_tests/cli once per node

* force failures for testing

* Revert "force failures for testing"

This reverts commit 3ddd9240fe.
2019-09-13 16:03:06 -07:00
Brian Seeders
6449088013
Don't set any job properties from the Jenkinsfile (#45522) 2019-09-12 10:35:16 -04:00
Spencer
77eb3d3c53 Revert "Revert "Revert "Revert "[ci] compress jobs for CI stab… (#45454)
* Revert "Revert "Revert "Revert "[ci] compress jobs for CI stability" (#44584)"""

This reverts commit 148b8c0f90.

* sync changes with Jenkinsfile

(cherry picked from commit 9a109f2170)
2019-09-11 15:28:34 -07:00
Brian Seeders
14b69dc6ea Jenkins pipeline with parallel cigroups (#45285)
* Pipeline

* WIP some work for parallelization with ciGroups

* Fix xpack kibana install dir, and add some debugging

* Attempt to quick fix a few tests

* Revert "Revert "Revert "[ci] compress jobs for CI stability" (#44584)""

This reverts commit 078ac2897f.

* Recombine test groups, and try runbld again

* Mostly cleanup, and fix failed_tests reporting to hopefully work for both pipeline and non-pipeline

* Fix typo in shell script

* Remove some debug code

* Add support for changing es transport.port during testing via TEST_ES_TRANSPORT_PORT

* Fix test that uses hard-coded es transport port and add it back in to parallel groups

* Disable checks reporter again for now

* Set env var for TEST_ES_TRANSPORT_PORT in pipeline

* Update Jenkinsfile for shorter testrunner labels

* Fix another hard-coded transport port

* Fix a new test with hard-coded URLs

* Jenkinsfile cleanup and fix one of the groups

* Fix double slash

* Testing vault credentials on jenkins server

* Add a non-existent credential

* Revert "Add a non-existent credential"

This reverts commit 0dc234c465a5483b1a994cb510a182fef766e9cc.

* Try github-checks-reporter again

* github-checks-reporter should only run for elastic/kibana, forks won't work

* Clean up some debug code

* Changing names around to try to make BlueOcean UI a little better

* Add more stages

* Make some changes to stage structure to mirror a nested example from CloudBees

* Handle TODOs, and some cleanup in Jenkinsfile

* Pass GIT_BRANCH when started without GHPRB, fix branch check

* Fix mailer problem and add code that ensures all tests are in cigroups back in

* Test adding worker/job name to junit report paths

* Remove some duplication from ci_setup scripts

* Fix unit test that uses junit path

* Don't reinstall node every time setup_env is run

* Fix yarn install logic

* Fix another unit test that uses junit output dir

* Download latest ES snapshot after kibana builds

* Make sure junit reports are always processed

* Add two failing tests for testing purposes

* Add support to Jenkinsfile for kibana build e-mails

* Remove some debug code for email sending

* Change JOB env handling in junit paths and move it to a sub-directory

* Revert "Add two failing tests for testing purposes"

This reverts commit 5715203e26922a93483feb0ebb8bb3fdcc3daf8c.

* Fix junit report path in test

* Don't send kibana emails on build abort

* Address PR feedback, formatting and use built-in url formatting library

* Fix path formatting for functional test

* Add email sending back in to Jenkinsfile

* Fix another unit test with path problem

(cherry picked from commit 27d23c4184)

# Conflicts:
#	src/dev/ci_setup/setup.sh
#	src/dev/failed_tests/cli.js
#	test/plugin_functional/test_suites/core_plugins/applications.js
#	test/scripts/jenkins_xpack_ci_group.sh
2019-09-11 12:23:57 -07:00