Commit graph

24 commits

Author SHA1 Message Date
Pier-Hugues Pellerin
4f5f3490aa Relax the acceptance test expectation to match only the exception message
Fixes: #6310

Fixes #6325
2016-11-29 14:24:37 -05:00
Suyog Rao
b9c45083ba Fix acceptance tests
Fixes #6051
2016-10-13 11:51:14 -04:00
Suyog Rao
9c5e558c5a Deprecate uninstall for Plugin Manager
Adds remove and deprecates uninstall

Fixes #6041

Fixes #6042
2016-10-13 10:12:23 -04:00
Pere Urbon-Bayes
8be69814c8 make redhat test uninstall a packege after test are done also making sure install errors are raised only when an error code is != 0
Fixes #5936
2016-09-16 12:05:26 -04:00
Joao Duarte
6c06082448 make sure sed replacements are posix compliant
using \s will not work in some systems, use [[:space]] instead

Fixes #5812
2016-08-23 13:57:49 -04:00
Pier-Hugues Pellerin
d4e611677d Fix an issue with the logstash-plugin list acceptance test
The previous regexp used to match the version did not take into
consideration pre-release version.

Fixes #5700
2016-07-27 16:00:20 -04:00
Pere Urbon-Bayes
a82fe85197 Add specific tests in the plugin manager acceptance test for --no-verify flag
Fixes #5538
2016-06-29 08:16:38 -04:00
Pere Urbon-Bayes
8bf0afbd4e add --no-verify to all plugin install commands and prefix also all of them with JAR_SKIP in to improve speed of the acceptance test
exclude jar-dependency when running the plugin manager tests

Fixes #5538
2016-06-29 08:16:37 -04:00
Joao Duarte
3c7e62786c make -V/--version fast on *nix 2016-06-21 14:39:30 +01:00
Joao Duarte
fa0eeb579f add single command release task and other release support tooling
Purpose:

* manage releases through a minimum number of rake tasks
* simplify building of snapshot builds
* create staged artifacts, candidates for releases, that required no changes to become releases
* this means the snapshot release process will not involve publishing gems, therefore:
* the gem artifacts should only be published to rubygems as a final artifact, at the time of GA

Changes:

* release artifacts no longer depend on gems of core components
* all core components are used locally AS-IS to minimize code changes between snapshot, RC and GA
* `versions.yml` describes the versions of all logstash parts and package
  * `rake version:set[version]` manage the yaml file and push the changes to the gemspecs/version.rb files
  * `rake version:set_plugin_api[version]` manage the yaml file and push the changes to the gemspecs/version.rb files
  * `rake artifact:all` generates SNAPSHOT artifacts: tar.gz, zip, rpm, deb
  * `RELEASE=1 rake artifact:all` creates release candidate artifacts + 4 gems: logstash-core, logstash-core-event, logstash-core-event-java and logstash-core-plugin-api

implements #5416 and #5414

Fixes #5460
2016-06-21 12:29:18 +01:00
Joao Duarte
c9b243da38 Revert "add acceptance test"
This reverts commit ae09503df3.
2016-06-17 10:01:47 +01:00
Pere Urbon-Bayes
df4ac4d12e make LS_QA_EXPERIMENTAL be LS_QA_EXPERIMENTAL_OS
Fixes #5506
2016-06-17 03:03:36 -04:00
Pere Urbon-Bayes
9a1bfcea94 Add the idea of experimental platforms for the acceptance testing framework, this will let us keep focus on platforms inside the support matrix, but also do some testing on upcoming platforms without mixing boths ideas.
Fixes #5506
2016-06-17 03:03:35 -04:00
Joao Duarte
ae09503df3 add acceptance test 2016-06-16 12:47:49 +01:00
Pere Urbon-Bayes
6ae54801da rework the acceptance update scenario to avoid using snapshort restore, this might be a temporary solution for ssh issues in vagrant and ubuntu hosts
Fixes #5456
2016-06-08 09:27:50 -04:00
Pere Urbon-Bayes
ebfa12ace8 Enhance QA acceptance test framework docs by adding comments and and upgraded readme in order to provide more context and knowledge around it.
Fixes #5436
2016-06-03 13:16:40 +00:00
Pere Urbon-Bayes
605a5b5ed3 pass the settings file location as required by the new package structure
Fixes #5399

Fixes #5350
2016-06-02 14:37:16 +00:00
Pere Urbon-Bayes
8deab63ab0 Collection of small bootstrap related fixes like
* make sure downloaded logstashes use the new (arch independant files name)
* add specific privileged bootstrap script for debian 8 that is able to install java8 for this distro
* wrap the bootstrap scripts within the platform class, like this logic is in one specific place to select platform specific components
* add platform specific bootstrap file for sles-12 and also scripts to download latest logstash rpm version
* add custom bootstrap script for ubuntu-1404 to be sure it loads all ca certificates into the system
* make the necessary changes to compile with the new package system
* correct logstash path usage
* remove unnecessary dependancy to rake inside the acceptance test framework
* fix script execution under ubuntu environments, making sure it runs on bash

Fixes #5350
2016-06-02 14:37:16 +00:00
Pier-Hugues Pellerin
eed32abb3d Migration of the CLI script to run under Vagrant VMs.
This is the First pass to add the `integration` test for the CLI, the
Logstash and the logstash-plugin command.

Fixes #5259

Fixes #5350
2016-06-02 14:37:16 +00:00
Pere Urbon-Bayes
e52bda64c6 Introduction of an update scenario for artifacts, including snapshot/restore for VM's and initial schema for this scenario.
Some other minor changes include:

* add back the user level boostrap scripts, useful in that case to pull latest released LS
* cleanup formatting for specs and fixed bootstrap scripts for redhats
* make the latest logstash version available from the current platform config file
* make sure debian based machines use java8
* make sure to use hostname and not just ip:port address when reporting the names

Fixes #5350
2016-06-02 14:37:16 +00:00
Pere Urbon-Bayes
ced5e5e020 Introduce the concept of a single spec for the tests, we removed the platform depant test as they where mostly similar, but only used with small platform dependant metadata, this all has been moved to factory methods. make sure platforms uses canonicals "former" names, so no "ubuntu" platfrom as is debian based, and no "centos" as is redhat based.
Also:

* Refactored the specs organization to make the resoning behind simplier,
introducing the idea of an artifact subject that it wraps the
interactions with the platform.

* Add methods to destroy, bootstrap and halt a list of machines either all of them or the ones listed under a given platform name.

* Introduced more clear namespacing in the rakefile.

* Updated the list of available platforms for acceptance testing, including latest ubuntu, oel, fedora, debian and suse versions

Fixes #5350
2016-06-02 14:37:16 +00:00
Pier-Hugues Pellerin
1c6f97b86a Allow to run acceptance test with the local logstash
This change introduce a new command ci/ci_acceptance which is
responsable of building the packages, bootstraping the acceptance test
environment, launching the VMs and running the tests.

You can use the following command to target specific platform.

```
ci/ci_acceptance.sh all
ci/ci_acceptance.sh centos
ci/ci_acceptance.sh debian
```

This PR also add a new rake task to build all the artifacts in a single
run called rake artifact:all it make sure we only install the plugin
only once and make the build process faster.

Fixes #5350
2016-06-02 14:37:16 +00:00
Tal Levy
cffff49f2b update SNAPSHOT tests to run
Fixes #5350
2016-06-02 14:37:16 +00:00
Pere Urbon-Bayes
5ccc705a67 first iteration of a QA acceptance and integration test framework, this initial run include only very basic infraestructure and is for sure going to evolve as necessary to make it a reality.
Fixes #5350
2016-06-02 14:37:15 +00:00