Commit graph

138 commits

Author SHA1 Message Date
Suyog Rao
d71112da0e Cleanup of print messages
Fixes #5917
2016-09-22 13:43:47 -04:00
Suyog Rao
aa957b3594 Update README.md
Fixes #5917
2016-09-22 13:43:47 -04:00
Suyog Rao
bb4189cdc8 Add initial round of integration tests
Fixes #5917
2016-09-22 13:43:47 -04:00
Pere Urbon-Bayes
9bc982d795 ammend leftover
Fixes #5936
2016-09-16 12:05:26 -04:00
Pere Urbon-Bayes
d087b78d0d make redhat test uninstall a packege after test are done also making sure install errors are raised only when an error code is != 0
Fixes #5936
2016-09-16 12:05:26 -04:00
Pere Urbon-Bayes
a5c91f7b93 make the install command raise exception if some error happened
Fixes #5862
2016-09-08 12:32:38 -04:00
Joao Duarte
b8cb201d13 make sure sed replacements are posix compliant
using \s will not work in some systems, use [[:space]] instead

Fixes #5812
2016-08-23 13:57:48 -04:00
Pere Urbon-Bayes
688adca814 Add the idea of a debug flag to make the vagrant commands output explicit to the end user. Also does the changes necessaries to make the vagrant command runner fetch the stdout and stdin on demand and not waiting till the end of it to report.
Fixes #5566
2016-08-23 11:45:45 -04:00
Pier-Hugues Pellerin
9f9de6dd88 Fix an issue with the logstash-plugin list acceptance test
The previous regexp used to match the version did not take into
consideration pre-release version.

Fixes #5700
2016-07-27 16:00:20 -04:00
Pere Urbon-Bayes
d8d85d60e7 provide more clarity to the QA test readme
Fixes #5521
2016-07-19 10:50:17 -04:00
Pere Urbon-Bayes
612c9b8a6d Add specific tests in the plugin manager acceptance test for --no-verify flag
Fixes #5538
2016-06-29 08:16:37 -04:00
Pere Urbon-Bayes
739713b518 add --no-verify to all plugin install commands and prefix also all of them with JAR_SKIP in to improve speed of the acceptance test
exclude jar-dependency when running the plugin manager tests

Fixes #5538
2016-06-29 08:16:37 -04:00
Pere Urbon-Bayes
13b29db5f6 add .rspec file to the qa dir so the default formater is documentation
Fixes #5561
2016-06-29 04:47:15 -04:00
Pere Urbon-Bayes
1fa83b99dd add --force-confnew to pick automatically new config when updating packages for debians, this avoid interactive prompt issues
Fixes #5559
2016-06-28 10:06:39 -04:00
Joao Duarte
72b277404b make -V/--version fast on *nix 2016-06-21 14:30:15 +01:00
Pere Urbón
20b928392d make acceptance test understand there are artifacts that are snapshots and ones that not (#2)
Fixes #5522
2016-06-21 06:57:23 -04:00
Joao Duarte
0e022bb2d0 make acceptance test framework pick snapshot rpm/deb builds
Fixes #5522
2016-06-21 06:57:23 -04:00
Joao Duarte
bd43b28764 Revert "add acceptance test"
This reverts commit fc39bba223.
2016-06-17 10:00:44 +01:00
Pere Urbon-Bayes
3d8608f5a5 make LS_QA_EXPERIMENTAL be LS_QA_EXPERIMENTAL_OS
Fixes #5506
2016-06-17 03:03:35 -04:00
Pere Urbon-Bayes
85e39d99f1 Add the idea of experimental platforms for the acceptance testing framework, this will let us keep focus on platforms inside the support matrix, but also do some testing on upcoming platforms without mixing boths ideas.
Fixes #5506
2016-06-17 03:03:35 -04:00
Joao Duarte
fc39bba223 add acceptance test 2016-06-16 12:46:30 +01:00
Pere Urbon-Bayes
b148df70fc remove patch ot use common file name, wihtout arch, also update ls filename in bootstrap scripts
Fixes #5486
2016-06-15 06:45:43 -04:00
Pere Urbon-Bayes
b4e9d06401 remove fedora from qa
Fixes #5487
2016-06-14 10:09:57 -04:00
Pier-Hugues Pellerin
b70a64dae0 Remove the /bin/env command before using sed and rely on $PATH
related to a discussion in #5468

Fixes #5471
2016-06-09 12:17:56 -04:00
Pere Urbon-Bayes
e254d9f67d rework the acceptance update scenario to avoid using snapshort restore, this might be a temporary solution for ssh issues in vagrant and ubuntu hosts
Fixes #5456
2016-06-08 09:27:50 -04:00
Pere Urbon-Bayes
c5610505c7 Enhance QA acceptance test framework docs by adding comments and and upgraded readme in order to provide more context and knowledge around it.
Fixes #5436
2016-06-03 13:16:39 +00:00
Pere Urbon-Bayes
afce9e74ff Remove unused dependencies, cleanup readme and add new platforms to the list of options
Fixes #5350
2016-06-02 14:37:15 +00:00
Pere Urbon-Bayes
1c7640bb07 pass the settings file location as required by the new package structure
Fixes #5399

Fixes #5350
2016-06-02 14:37:15 +00:00
Pere Urbon-Bayes
21777bae40 Collection of small bootstrap related fixes like
* make sure downloaded logstashes use the new (arch independant files name)
* add specific privileged bootstrap script for debian 8 that is able to install java8 for this distro
* wrap the bootstrap scripts within the platform class, like this logic is in one specific place to select platform specific components
* add platform specific bootstrap file for sles-12 and also scripts to download latest logstash rpm version
* add custom bootstrap script for ubuntu-1404 to be sure it loads all ca certificates into the system
* make the necessary changes to compile with the new package system
* correct logstash path usage
* remove unnecessary dependancy to rake inside the acceptance test framework
* fix script execution under ubuntu environments, making sure it runs on bash

Fixes #5350
2016-06-02 14:37:15 +00:00
Pier-Hugues Pellerin
7b38e798c2 Migration of the CLI script to run under Vagrant VMs.
This is the First pass to add the `integration` test for the CLI, the
Logstash and the logstash-plugin command.

Fixes #5259

Fixes #5350
2016-06-02 14:37:15 +00:00
Pere Urbon-Bayes
7dbdf2b517 Introduction of an update scenario for artifacts, including snapshot/restore for VM's and initial schema for this scenario.
Some other minor changes include:

* add back the user level boostrap scripts, useful in that case to pull latest released LS
* cleanup formatting for specs and fixed bootstrap scripts for redhats
* make the latest logstash version available from the current platform config file
* make sure debian based machines use java8
* make sure to use hostname and not just ip:port address when reporting the names

Fixes #5350
2016-06-02 14:37:15 +00:00
Pere Urbon-Bayes
1be0d271d3 Introduce the concept of a single spec for the tests, we removed the platform depant test as they where mostly similar, but only used with small platform dependant metadata, this all has been moved to factory methods. make sure platforms uses canonicals "former" names, so no "ubuntu" platfrom as is debian based, and no "centos" as is redhat based.
Also:

* Refactored the specs organization to make the resoning behind simplier,
introducing the idea of an artifact subject that it wraps the
interactions with the platform.

* Add methods to destroy, bootstrap and halt a list of machines either all of them or the ones listed under a given platform name.

* Introduced more clear namespacing in the rakefile.

* Updated the list of available platforms for acceptance testing, including latest ubuntu, oel, fedora, debian and suse versions

Fixes #5350
2016-06-02 14:37:15 +00:00
Pier-Hugues Pellerin
f74e339e77 Allow to run acceptance test with the local logstash
This change introduce a new command ci/ci_acceptance which is
responsable of building the packages, bootstraping the acceptance test
environment, launching the VMs and running the tests.

You can use the following command to target specific platform.

```
ci/ci_acceptance.sh all
ci/ci_acceptance.sh centos
ci/ci_acceptance.sh debian
```

This PR also add a new rake task to build all the artifacts in a single
run called rake artifact:all it make sure we only install the plugin
only once and make the build process faster.

Fixes #5350
2016-06-02 14:37:15 +00:00
Tal Levy
34edb9773f update SNAPSHOT tests to run
Fixes #5350
2016-06-02 14:37:15 +00:00
Pier-Hugues Pellerin
99b7f772cf Introduce the use of a platforms.json file where to keep all platforms information to simplify the vagrantfile structure. Also make the vagrant execution more elegant under rake
Fixes #5350
2016-06-02 14:37:14 +00:00
Pere Urbon-Bayes
6c4a09c631 first iteration of a QA acceptance and integration test framework, this initial run include only very basic infraestructure and is for sure going to evolve as necessary to make it a reality.
Fixes #5350
2016-06-02 14:37:14 +00:00
Suyog Rao
d409e04df9 Remove Java 7 reference in comments
Fixes #5298
2016-05-13 22:29:29 +00:00
Pere Urbon-Bayes
d5daf1ea98 relocate windows scripted tests into the qa folder
Fixes #5268
2016-05-12 06:56:25 +00:00