Commit graph

84 commits

Author SHA1 Message Date
Pere Urbon-Bayes
7269b3da5f ammend leftover
Fixes #5936
2016-09-16 12:05:26 -04:00
Pere Urbon-Bayes
8be69814c8 make redhat test uninstall a packege after test are done also making sure install errors are raised only when an error code is != 0
Fixes #5936
2016-09-16 12:05:26 -04:00
Pere Urbon-Bayes
8271304f59 make the install command raise exception if some error happened
Fixes #5862
2016-09-08 12:33:46 -04:00
Joao Duarte
6c06082448 make sure sed replacements are posix compliant
using \s will not work in some systems, use [[:space]] instead

Fixes #5812
2016-08-23 13:57:49 -04:00
Pere Urbon-Bayes
95a387f990 Add the idea of a debug flag to make the vagrant commands output explicit to the end user. Also does the changes necessaries to make the vagrant command runner fetch the stdout and stdin on demand and not waiting till the end of it to report.
Fixes #5566
2016-08-23 11:45:46 -04:00
Pier-Hugues Pellerin
d4e611677d Fix an issue with the logstash-plugin list acceptance test
The previous regexp used to match the version did not take into
consideration pre-release version.

Fixes #5700
2016-07-27 16:00:20 -04:00
Pere Urbon-Bayes
f7ecded492 provide more clarity to the QA test readme
Fixes #5521
2016-07-19 10:50:17 -04:00
Pere Urbon-Bayes
a82fe85197 Add specific tests in the plugin manager acceptance test for --no-verify flag
Fixes #5538
2016-06-29 08:16:38 -04:00
Pere Urbon-Bayes
8bf0afbd4e add --no-verify to all plugin install commands and prefix also all of them with JAR_SKIP in to improve speed of the acceptance test
exclude jar-dependency when running the plugin manager tests

Fixes #5538
2016-06-29 08:16:37 -04:00
Pere Urbon-Bayes
137c0f1fd5 add .rspec file to the qa dir so the default formater is documentation
Fixes #5561
2016-06-29 04:47:15 -04:00
Pere Urbon-Bayes
f643fa2893 add --force-confnew to pick automatically new config when updating packages for debians, this avoid interactive prompt issues
Fixes #5559
2016-06-28 10:06:39 -04:00
Joao Duarte
3c7e62786c make -V/--version fast on *nix 2016-06-21 14:39:30 +01:00
Joao Duarte
fa0eeb579f add single command release task and other release support tooling
Purpose:

* manage releases through a minimum number of rake tasks
* simplify building of snapshot builds
* create staged artifacts, candidates for releases, that required no changes to become releases
* this means the snapshot release process will not involve publishing gems, therefore:
* the gem artifacts should only be published to rubygems as a final artifact, at the time of GA

Changes:

* release artifacts no longer depend on gems of core components
* all core components are used locally AS-IS to minimize code changes between snapshot, RC and GA
* `versions.yml` describes the versions of all logstash parts and package
  * `rake version:set[version]` manage the yaml file and push the changes to the gemspecs/version.rb files
  * `rake version:set_plugin_api[version]` manage the yaml file and push the changes to the gemspecs/version.rb files
  * `rake artifact:all` generates SNAPSHOT artifacts: tar.gz, zip, rpm, deb
  * `RELEASE=1 rake artifact:all` creates release candidate artifacts + 4 gems: logstash-core, logstash-core-event, logstash-core-event-java and logstash-core-plugin-api

implements #5416 and #5414

Fixes #5460
2016-06-21 12:29:18 +01:00
Joao Duarte
c9b243da38 Revert "add acceptance test"
This reverts commit ae09503df3.
2016-06-17 10:01:47 +01:00
Pere Urbon-Bayes
df4ac4d12e make LS_QA_EXPERIMENTAL be LS_QA_EXPERIMENTAL_OS
Fixes #5506
2016-06-17 03:03:36 -04:00
Pere Urbon-Bayes
9a1bfcea94 Add the idea of experimental platforms for the acceptance testing framework, this will let us keep focus on platforms inside the support matrix, but also do some testing on upcoming platforms without mixing boths ideas.
Fixes #5506
2016-06-17 03:03:35 -04:00
Joao Duarte
ae09503df3 add acceptance test 2016-06-16 12:47:49 +01:00
Pere Urbon-Bayes
74b9a7a570 remove patch ot use common file name, wihtout arch, also update ls filename in bootstrap scripts
Fixes #5486
2016-06-15 06:45:44 -04:00
Pere Urbon-Bayes
4b3e8b2d73 remove fedora from qa
Fixes #5487
2016-06-14 10:09:57 -04:00
Pier-Hugues Pellerin
c2a76b9aed Remove the /bin/env command before using sed and rely on $PATH
related to a discussion in #5468

Fixes #5471
2016-06-09 12:17:57 -04:00
Pere Urbon-Bayes
6ae54801da rework the acceptance update scenario to avoid using snapshort restore, this might be a temporary solution for ssh issues in vagrant and ubuntu hosts
Fixes #5456
2016-06-08 09:27:50 -04:00
Pere Urbon-Bayes
ebfa12ace8 Enhance QA acceptance test framework docs by adding comments and and upgraded readme in order to provide more context and knowledge around it.
Fixes #5436
2016-06-03 13:16:40 +00:00
Pere Urbon-Bayes
2f1b7b4d5e Remove unused dependencies, cleanup readme and add new platforms to the list of options
Fixes #5350
2016-06-02 14:37:16 +00:00
Pere Urbon-Bayes
605a5b5ed3 pass the settings file location as required by the new package structure
Fixes #5399

Fixes #5350
2016-06-02 14:37:16 +00:00
Pere Urbon-Bayes
8deab63ab0 Collection of small bootstrap related fixes like
* make sure downloaded logstashes use the new (arch independant files name)
* add specific privileged bootstrap script for debian 8 that is able to install java8 for this distro
* wrap the bootstrap scripts within the platform class, like this logic is in one specific place to select platform specific components
* add platform specific bootstrap file for sles-12 and also scripts to download latest logstash rpm version
* add custom bootstrap script for ubuntu-1404 to be sure it loads all ca certificates into the system
* make the necessary changes to compile with the new package system
* correct logstash path usage
* remove unnecessary dependancy to rake inside the acceptance test framework
* fix script execution under ubuntu environments, making sure it runs on bash

Fixes #5350
2016-06-02 14:37:16 +00:00
Pier-Hugues Pellerin
eed32abb3d Migration of the CLI script to run under Vagrant VMs.
This is the First pass to add the `integration` test for the CLI, the
Logstash and the logstash-plugin command.

Fixes #5259

Fixes #5350
2016-06-02 14:37:16 +00:00
Pere Urbon-Bayes
e52bda64c6 Introduction of an update scenario for artifacts, including snapshot/restore for VM's and initial schema for this scenario.
Some other minor changes include:

* add back the user level boostrap scripts, useful in that case to pull latest released LS
* cleanup formatting for specs and fixed bootstrap scripts for redhats
* make the latest logstash version available from the current platform config file
* make sure debian based machines use java8
* make sure to use hostname and not just ip:port address when reporting the names

Fixes #5350
2016-06-02 14:37:16 +00:00
Pere Urbon-Bayes
ced5e5e020 Introduce the concept of a single spec for the tests, we removed the platform depant test as they where mostly similar, but only used with small platform dependant metadata, this all has been moved to factory methods. make sure platforms uses canonicals "former" names, so no "ubuntu" platfrom as is debian based, and no "centos" as is redhat based.
Also:

* Refactored the specs organization to make the resoning behind simplier,
introducing the idea of an artifact subject that it wraps the
interactions with the platform.

* Add methods to destroy, bootstrap and halt a list of machines either all of them or the ones listed under a given platform name.

* Introduced more clear namespacing in the rakefile.

* Updated the list of available platforms for acceptance testing, including latest ubuntu, oel, fedora, debian and suse versions

Fixes #5350
2016-06-02 14:37:16 +00:00
Pier-Hugues Pellerin
1c6f97b86a Allow to run acceptance test with the local logstash
This change introduce a new command ci/ci_acceptance which is
responsable of building the packages, bootstraping the acceptance test
environment, launching the VMs and running the tests.

You can use the following command to target specific platform.

```
ci/ci_acceptance.sh all
ci/ci_acceptance.sh centos
ci/ci_acceptance.sh debian
```

This PR also add a new rake task to build all the artifacts in a single
run called rake artifact:all it make sure we only install the plugin
only once and make the build process faster.

Fixes #5350
2016-06-02 14:37:16 +00:00
Tal Levy
cffff49f2b update SNAPSHOT tests to run
Fixes #5350
2016-06-02 14:37:16 +00:00
Pier-Hugues Pellerin
0afbb50cac Introduce the use of a platforms.json file where to keep all platforms information to simplify the vagrantfile structure. Also make the vagrant execution more elegant under rake
Fixes #5350
2016-06-02 14:37:15 +00:00
Pere Urbon-Bayes
5ccc705a67 first iteration of a QA acceptance and integration test framework, this initial run include only very basic infraestructure and is for sure going to evolve as necessary to make it a reality.
Fixes #5350
2016-06-02 14:37:15 +00:00
Suyog Rao
dd521e2c06 Remove Java 7 reference in comments
Fixes #5298
2016-05-13 22:29:29 +00:00
Pere Urbon-Bayes
770b49b48f relocate windows scripted tests into the qa folder
Fixes #5268
2016-05-12 06:56:25 +00:00