Commit graph

170 commits

Author SHA1 Message Date
Pere Urbon-Bayes
3d8608f5a5 make LS_QA_EXPERIMENTAL be LS_QA_EXPERIMENTAL_OS
Fixes #5506
2016-06-17 03:03:35 -04:00
Pere Urbon-Bayes
85e39d99f1 Add the idea of experimental platforms for the acceptance testing framework, this will let us keep focus on platforms inside the support matrix, but also do some testing on upcoming platforms without mixing boths ideas.
Fixes #5506
2016-06-17 03:03:35 -04:00
Joao Duarte
fc39bba223 add acceptance test 2016-06-16 12:46:30 +01:00
Pere Urbon-Bayes
b148df70fc remove patch ot use common file name, wihtout arch, also update ls filename in bootstrap scripts
Fixes #5486
2016-06-15 06:45:43 -04:00
Pere Urbon-Bayes
b4e9d06401 remove fedora from qa
Fixes #5487
2016-06-14 10:09:57 -04:00
Pier-Hugues Pellerin
b70a64dae0 Remove the /bin/env command before using sed and rely on $PATH
related to a discussion in #5468

Fixes #5471
2016-06-09 12:17:56 -04:00
Pere Urbon-Bayes
e254d9f67d rework the acceptance update scenario to avoid using snapshort restore, this might be a temporary solution for ssh issues in vagrant and ubuntu hosts
Fixes #5456
2016-06-08 09:27:50 -04:00
Pere Urbon-Bayes
c5610505c7 Enhance QA acceptance test framework docs by adding comments and and upgraded readme in order to provide more context and knowledge around it.
Fixes #5436
2016-06-03 13:16:39 +00:00
Pere Urbon-Bayes
afce9e74ff Remove unused dependencies, cleanup readme and add new platforms to the list of options
Fixes #5350
2016-06-02 14:37:15 +00:00
Pere Urbon-Bayes
1c7640bb07 pass the settings file location as required by the new package structure
Fixes #5399

Fixes #5350
2016-06-02 14:37:15 +00:00
Pere Urbon-Bayes
21777bae40 Collection of small bootstrap related fixes like
* make sure downloaded logstashes use the new (arch independant files name)
* add specific privileged bootstrap script for debian 8 that is able to install java8 for this distro
* wrap the bootstrap scripts within the platform class, like this logic is in one specific place to select platform specific components
* add platform specific bootstrap file for sles-12 and also scripts to download latest logstash rpm version
* add custom bootstrap script for ubuntu-1404 to be sure it loads all ca certificates into the system
* make the necessary changes to compile with the new package system
* correct logstash path usage
* remove unnecessary dependancy to rake inside the acceptance test framework
* fix script execution under ubuntu environments, making sure it runs on bash

Fixes #5350
2016-06-02 14:37:15 +00:00
Pier-Hugues Pellerin
7b38e798c2 Migration of the CLI script to run under Vagrant VMs.
This is the First pass to add the `integration` test for the CLI, the
Logstash and the logstash-plugin command.

Fixes #5259

Fixes #5350
2016-06-02 14:37:15 +00:00
Pere Urbon-Bayes
7dbdf2b517 Introduction of an update scenario for artifacts, including snapshot/restore for VM's and initial schema for this scenario.
Some other minor changes include:

* add back the user level boostrap scripts, useful in that case to pull latest released LS
* cleanup formatting for specs and fixed bootstrap scripts for redhats
* make the latest logstash version available from the current platform config file
* make sure debian based machines use java8
* make sure to use hostname and not just ip:port address when reporting the names

Fixes #5350
2016-06-02 14:37:15 +00:00
Pere Urbon-Bayes
1be0d271d3 Introduce the concept of a single spec for the tests, we removed the platform depant test as they where mostly similar, but only used with small platform dependant metadata, this all has been moved to factory methods. make sure platforms uses canonicals "former" names, so no "ubuntu" platfrom as is debian based, and no "centos" as is redhat based.
Also:

* Refactored the specs organization to make the resoning behind simplier,
introducing the idea of an artifact subject that it wraps the
interactions with the platform.

* Add methods to destroy, bootstrap and halt a list of machines either all of them or the ones listed under a given platform name.

* Introduced more clear namespacing in the rakefile.

* Updated the list of available platforms for acceptance testing, including latest ubuntu, oel, fedora, debian and suse versions

Fixes #5350
2016-06-02 14:37:15 +00:00
Pier-Hugues Pellerin
f74e339e77 Allow to run acceptance test with the local logstash
This change introduce a new command ci/ci_acceptance which is
responsable of building the packages, bootstraping the acceptance test
environment, launching the VMs and running the tests.

You can use the following command to target specific platform.

```
ci/ci_acceptance.sh all
ci/ci_acceptance.sh centos
ci/ci_acceptance.sh debian
```

This PR also add a new rake task to build all the artifacts in a single
run called rake artifact:all it make sure we only install the plugin
only once and make the build process faster.

Fixes #5350
2016-06-02 14:37:15 +00:00
Tal Levy
34edb9773f update SNAPSHOT tests to run
Fixes #5350
2016-06-02 14:37:15 +00:00
Pier-Hugues Pellerin
99b7f772cf Introduce the use of a platforms.json file where to keep all platforms information to simplify the vagrantfile structure. Also make the vagrant execution more elegant under rake
Fixes #5350
2016-06-02 14:37:14 +00:00
Pere Urbon-Bayes
6c4a09c631 first iteration of a QA acceptance and integration test framework, this initial run include only very basic infraestructure and is for sure going to evolve as necessary to make it a reality.
Fixes #5350
2016-06-02 14:37:14 +00:00
Suyog Rao
d409e04df9 Remove Java 7 reference in comments
Fixes #5298
2016-05-13 22:29:29 +00:00
Pere Urbon-Bayes
d5daf1ea98 relocate windows scripted tests into the qa folder
Fixes #5268
2016-05-12 06:56:25 +00:00