Commit graph

14 commits

Author SHA1 Message Date
Brad White
15a0b8e4cf
[CI / FIPS] Convert smoke tests to use FIPS agent (#186858)
## Summary

Closes elastic/kibana-operations#137

- Convert FIPS daily smoke test pipeline to use FIPS agents
  - This allows the smoke tests to run in parallel now
- Removes FIPS Vagrant box from package testing
- Adds verify FIPS enabled check to pipeline 

Pipeline run: https://buildkite.com/elastic/kibana-fips/builds/90
2024-06-26 12:55:51 -07:00
Brad White
324673c8d6
[ci / FIPS] Dynamic agent selection. Add FIPS agents (#183777)
## Summary

- Closes https://github.com/elastic/kibana-operations/issues/100
- Utilizes FIPS agent from elastic/ci-agent-images#686
- Adds dynamic agent selection during PR pipeline upload
- FIPS agents can be used with `FTR_ENABLE_FIPS_AGENT` env variable or
`ci:enable-fips-agent` label
- Removes agent image config from individual steps in favor of image
config for the whole pipeline.
- Steps can still override this config by adding `image`, `imageProject`
etc
- Adds a conditional assertion to `Check` CI step which validates that
FIPS is working properly


### Testing
- [Pipeline run using FIPS
agents](https://buildkite.com/elastic/kibana-pull-request/builds/215332)
  - Failures are expected and this possibly ran with flaky tests
2024-06-20 13:09:45 -07:00
Brad White
e53ff4411b
[FIPS / CI] Fix ES ML startup issues, UUID permissions, FTR tests status, OpenSSL target. Switch to Ubuntu (#182295)
Closes elastic/kibana-operations#96

[new pipeline run](https://buildkite.com/elastic/kibana-fips/builds/28)
[old pipeline run](https://buildkite.com/elastic/kibana-fips/builds/24)

- Fixes OpenSSL compilation so that it does not overwrite the OS version
and break OS functionality.
- Fixes issue where ES would not start due to ML pipe being unable to
write to Vagrant synced folder.
  - Reenabled ML in FIPS pipeline
- Fixes permission where Kibana could not write UUID file.
- Fixes smoke test exit code not reporting correctly.
- Fixes Buildkite annotation for failed tests
[example](https://buildkite.com/elastic/kibana-fips/builds/23).
- Switches the base VM image from RHEL9 to Ubuntu due to RHEL9
subscription requirements to install repo packages.
- This blocked installing Chrome, causing tests using Webdriver to fail.

---------

Co-authored-by: Dzmitry Lemechko <dzmitry.lemechko@elastic.co>
2024-05-16 08:13:57 -07:00
Brad White
306bcf6e85
[ci] Add FIPS Vagrant box and nightly testing pipeline (#176980)
## Summary

- Closes elastic/kibana-operations#26
- Adds a Vagrant box and corresponding Ansible playbook to create a test
environment for FIPS
- Adds a daily pipeline to run a subset of FTR tests in FIPS mode

### Known Issues
1. The compilation of OpenSSL in FIPS mode is breaking some of the OS
libraries and functionality (`sudo` / `dnf` likely more). Possibly due
to custom OpenSSL installation using different locations than the OS
version.
2. ES is having trouble starting, likely due to issue 1 ([Log
link](https://buildkite.com/elastic/kibana-pull-request/builds/205420#018f0c58-3dc3-41c5-a1a5-9d9a9e14aacc/265-552)).
Disabling ML is a temp workaround added in
803945c759, but we likely need it enabled
in the future anyways, so best to find a proper fix. Tracking at
https://github.com/elastic/kibana-operations/issues/96

### Reviewers
You can view a run of the new pipeline during testing
[here](https://buildkite.com/elastic/kibana-migration-pipeline-staging/builds/84).

---------

Co-authored-by: Tiago Costa <tiago.costa@elastic.co>
2024-04-26 16:41:56 -07:00
Jon
19714c780d
[artifacts/package testing] Update apt cache (#175789)
Fixes an issue where the `fonts-liberation` package could not be found
by running the equivalent of `apt-get update`.

https://buildkite.com/elastic/kibana-artifacts-snapshot/builds/3892
2024-01-29 07:51:00 -06:00
Luke Elmers
4b863abc18
Adds base implementation of the Kibana Health Gateway. (#141172) 2022-11-07 09:14:42 -07:00
Jonathan Budzenski
04d1ffea7e
set NODE_ENV=production for bin/* (#139649)
* Set NODE_ENV=production for bin/*

* add tests

* Revert "Set NODE_ENV=production for bin/*"

This reverts commit 8012ed6a2e.

* Revert "Revert "Set NODE_ENV=production for bin/*""

This reverts commit 2fd499c112.
2022-08-30 09:01:51 -05:00
Jonathan Budzenski
7fd3beee4e
[artifacts] Stabilize package testing (#134854)
* bump ansible logging verbosity

* upgrade base os

* update base images

* add specificity to docker image glob

* limit memory

* bump base vm memory

* more cpu

* decrease verbosity

* less downloads

* disable shared symlinks

* more logging

* bump concurrency to test stability

* add concurrency group

* revert

* parallelism

* Revert "parallelism"

This reverts commit 4cc00f7144.
2022-06-30 16:00:15 -05:00
Jonathan Budzenski
179cf309ec
[artifacts testing] Re-enable FTR smoke tests (#132076)
* [artifacts testing] Re-enable FTR smoke tests

* --quiet

* docker disable chromium sandbox

* newline
2022-05-12 08:03:39 -07:00
Jonathan Budzenski
f2654802a5
[package testing] Stabilize status api test (#129228)
There appears to be a brief moment after kibana starts where we are
listening for http connections but immediately closing requests to the
status API.  The return code by ansible here is -1, so this adds that as
a valid response to retry.
2022-04-01 13:45:21 -05:00
Jonathan Budzenski
ab109db73f
[package testing] Update networking profile to account for virtualbox update (#127298)
With a recent virtualbox update, we're getting failures in CI with:

> The IP address configured for the host-only network is not within the
> allowed ranges. Please update the address used to be within the allowed
> ranges and run the command again.

This updates the IP range used to be compatible.
2022-03-09 11:47:11 -06:00
Brian Seeders
7a70f857f3
[package-testing] Fix docker testing (#123249) 2022-01-18 13:03:24 -05:00
Jonathan Budzenski
da25960022
[package testing] Bump status page timeout (#107813)
The socket timeout for testing whether the status page is available or
not is currently 30 seconds.  This test was disabled for being flaky.
Reproducing this locally hasn't been straight forward, but I am seeing
an average of ~20 seconds, which is close enough to the timeout that I'd
like to rule out machine differences.  This gives the status check 120
seconds before dropping the connection.

Related to #106749 and #107300

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-08-16 10:55:32 -07:00
Jonathan Budzenski
f0e11bcd1b
Automated package testing (#88900)
Co-authored-by: Tyler Smalley <tylersmalley@me.com>
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-05-27 13:37:43 -05:00