Commit graph

63 commits

Author SHA1 Message Date
João Duarte
38e5e53def
Update logstash_releases.json (#10366) 2019-01-30 16:50:40 +00:00
João Duarte
a163b86c0b
Update logstash_releases.json 2018-12-12 11:25:49 +00:00
João Duarte
5c919f2831
Update logstash_releases.json 2018-12-09 09:59:49 +00:00
João Duarte
14a061431f
add reference json file with logstash releases (#10173) 2018-11-22 23:27:50 +00:00
Josh Soref
c6cd247ec3 Multiple spelling corrections (#9782)
* spelling: actually
* spelling: already
* spelling: concurrency
* spelling: constructor
* spelling: destinations
* spelling: different
* spelling: elasticsearch
* spelling: encoding
* spelling: error
* spelling: explicitly
* spelling: failings
* spelling: falsey
* spelling: guarantees
* spelling: having
* spelling: implementation
* spelling: logstash
* spelling: module
* spelling: multiple
* spelling: omitted
* spelling: overridden
* spelling: pipeline
* spelling: raspberry
* spelling: receive
* spelling: recommended
* spelling: registered
* spelling: registering
* spelling: shutdown
* spelling: signal
* spelling: specified
* spelling: successful
* spelling: successfully
* spelling: valuefied
* spelling: vector
2018-07-04 10:41:10 +01:00
Ry Biesemeyer
5b1cd67311 ci: ensure bundle installed before invoking bundle exec in cleanup
DRYs up cleanup code and prevents error that is raised when we attempt
to `bundle exec rake qa:vm:halt` when the bundle has not yet been installed.

Fixes #9803
2018-07-02 17:26:27 +00:00
Armin
0f1be10565 BUILD: Force utf-8 file encoding in java compilation
Fixes #9685
2018-05-30 09:53:57 +00:00
Andrew Cholakian
eae1cc0d0a Correctly CD between dirs in ci/acceptance-tests.sh
This correctly CDs back and forth between dirs and tracks things
with variables to make it easier on the brain than relative paths like '..'

Fixes #9657
2018-05-24 19:49:30 +00:00
Andrew Cholakian
03427d81a2 Fix VM halt task for acceptance tasks by CDing correctly
We were in the wrong dir before, we need to be in the qa dir to shutdown correctly

Fixes #9651
2018-05-24 14:01:31 +00:00
Andrew Cholakian
f8afd2fb39 Make commands to run all acceptance VMs actually do that.
Also, take conservative approach of halting any somehow stale VMs before building

Fixes #9642
2018-05-23 19:23:39 +00:00
Andrew Cholakian
55cd1875a2 Always halt vagrant instances when on CI server.
We were having issues with lots of stale VMs being left around. This, hopefully, fixes it.

Fixes #9642
2018-05-23 19:23:39 +00:00
Andrew Cholakian
e2a6d8b753 Enable TEST_DEBUG on CI servers
Some tests are impossible to debug since log messages are not echoed without this,
including fatal/error messages. This makes output more verbose, but actually debuggable.

We should really delete this 'functionality' from https://github.com/elastic/logstash-devutils/blob/master/lib/logstash/devutils/rspec/spec_helper.rb#L36
since it does more harm than good.

Fixes #9629
2018-05-22 14:50:34 +00:00
Andrew Cholakian
bf21f97eb3 Fix the license check CI task
This does a few small things:

1. Prefer invoking rake tasks via ./gradlew vs rake. This prevents Java from segfaulting on docker for unknown reasons
2. Remove use of COPYING.csv which has already been removed

Fixes #9583
2018-05-15 23:31:12 +00:00
Armin
b9cd58639c BUILD: Fix the docker build script to correctly see exit code
Fixes #9567
2018-05-14 02:37:26 +00:00
Andrew Cholakian
30e524e5ee Improved NOTICE.txt generation
Fixes #9530
2018-05-10 16:14:45 +00:00
Andrew Cholakian
cb0edd6f21 Add docker ci script for license check
Fixes #9514
2018-05-02 16:26:10 +00:00
Andrew Cholakian
00777ba027 Add ci script for license check
Fixes #9513
2018-05-02 15:49:02 +00:00
Jenkins CI
93cad10da1 Migrate x-pack-logstash source to logstash 2018-04-24 10:46:15 -05:00
Andrew Cholakian
7f4fcda8b0 Docker CI Images should cleanup in the event of an unclean exit.
Fixes #9279
2018-03-22 22:12:07 +00:00
Andrew Cholakian
7cb08df480 DRY docker shell scripts for use with docker CI
We'll be using ci/docker_run.sh to run our x-pack build scripts soon,
so this refactor makes sense

Fixes #9245
2018-03-15 23:50:33 +00:00
Andrew Cholakian
ee987ef5fc Set gradle log level to info on CI
Fixes #9240
2018-03-14 22:02:27 +00:00
Andrew Cholakian
041fca924f Never use gradle daemon on CI servers
We've had some issues with builds crashing the gradle daemon on CI servers. This can obfuscate errors.
This patch removes its usage in CI.

This is considered a gradle best practice: https://docs.gradle.org/current/userguide/gradle_daemon.html#sec:stopping_an_existing_daemon

Fixes #9240
2018-03-14 22:02:27 +00:00
Armin
86bf8dbb37 BUILD: Run rake tasks in Gradle JVM
Fixes #8941
2018-01-17 11:57:16 +00:00
Armin
e653f7e707 BUILD: Prevent zombie Docker Runs
Fixes #8953
2018-01-16 16:28:06 +00:00
Jake Landis
5c5619ff4e Minor: remove rake test:core-fail-fast
Fixes #8742

Fixes #8763
2017-11-29 19:48:00 +00:00
Jake Landis
b2514f2437 windows ci: remove rake in favor of gradle
fixes #8732

Fixes #8743
2017-11-28 14:34:45 +00:00
Armin
3aaea2f7e5 #8672 adjust gradle to use plain output on CI
Fixes #8678
2017-11-15 09:44:43 +00:00
Armin
2573082445 CR comments
Fixes #8599
2017-11-14 15:25:36 +00:00
Armin
35022f5c02 #7135 add Gradle task for bootstrapping and running all integration tests
Fixes #8599
2017-11-14 15:25:36 +00:00
Armin
c8d704c93e TESTS: Improve Gradle Test Configuration
* `clean` actually cleans all dynamically created files, in particular it now properly cleans the generated Gemfile so
that changes to the Gemfile.template reflect in a rerun of `bundler`
* `rubyTests` and `test` are now one-off and will automatically bootstrap JRuby and Gems required by the tests if necessary
* Fixed Readme to document the now much simpler test targets
* All rake tasks remain unchanged and still work exactly as they did before

Fixes #8583
2017-11-06 18:34:47 +00:00
Armin
bd99fc36ea Java Pipeline Compiler
Fixes #8569
2017-11-02 17:43:51 +00:00
Armin
c7b7025cc1 #8216 Use standard name for Gemfile.lock
Fixes #8525
2017-10-26 08:33:03 +00:00
Colin Surprenant
e172341f89 dynamically assign drive letter to WORKSPACE env var
fix underfined env var check

check for defined JRUBYSRCDIR env var

check for errorlevel after launching rake tasks

cosmetics

call rake

keep original path

cosmetic

cosmetic
2017-09-29 15:18:49 -04:00
Jake Landis
aef8c7a255 Instruct Jenkins to not abort other Vagrant hosts
See: https://stackoverflow.com/questions/19736862/vagrant-aborted-at-end-of-jenkins-job
and: https://wiki.jenkins.io/display/JENKINS/ProcessTreeKiller

Note - the existing vagrant lifecycle instructs a `destroy` before bootstrapping that will ensure a clean start if last process did not die properly.

Fixes #8380
2017-09-24 01:13:11 +00:00
Jake Landis
b7bd9dec13 Remove Travis builds (they have been replaced by Jenkins) Fixes: #8079
Fixes #8362
2017-09-21 23:16:44 +00:00
Pier-Hugues Pellerin
f7637058ea remove vendor plugin
Fixes #8281
2017-09-18 18:57:49 +00:00
Pier-Hugues Pellerin
0b7cb4a599 remove all trace of install all plugins in the code and in the build scripts
Fixes #8281
2017-09-18 18:57:49 +00:00
Jake Landis
196d1a1f7e Introduce docker for CI builds.
This commit includes:
* A base Dockerfile and script to push to a Docker repo
* A per-build Dockerfile (derived from the base)
* Updates to the test scripts to allow for more parallel builds
* Docker wrappers for the tests scripts
* Update for the integration test readme to manually run the tests
* Clean up the output of the Java tests
* Remove offline tag for tests (no longer needed that we don't use docker dependent services)

This commit does NOT include:
* Changes needed for the CI system to use Docker

Fixes #8223
2017-09-14 18:55:41 +00:00
Armin
c2aba55290 #8177 break cyclic dependency on old Logstash core in ITs and properly load it before service setup
Fixes #8181
2017-09-12 21:24:25 +00:00
Jake Landis
e87f810c76 Fix gradle tests on Windows
Addresses #7637

Fixes #7716
2017-07-17 22:49:05 +00:00
Jake Landis
c009cb8529 Ignore windows tests temporarily while addressing https://github.com/elastic/logstash/issues/7634 (#7637) 2017-07-11 08:43:38 +01:00
João Duarte
a797bf3721 add ci_test.bat file for windows testing (#7557)
this relies on jruby being installed locally with the same version as
the one contained in the .ruby-version file at the root of the project

The jruby must be installed in %JRUBYSRCDIR%\%JRUBYVERSION%
2017-07-10 13:50:34 +01:00
Pier-Hugues Pellerin
b3b9e605ac Check if the file exist before deleting them
When running the `ci_acceptance` test we need to make sure we don't have
any Gemfile or *.lock laying around. Deleting a non existant file would
make the test fails.

Fixes #7515
2017-06-27 00:41:08 +00:00
Pier-Hugues Pellerin
0f648858ef Remove *.lock and Gemfile before running any acceptance test
The acceptance test in our CI infrastructure doesn't clear the workspace between run
this mean the lock of the Gemfile can be sticky from a previous run, before generating any package
we will clear them out to make sure we use the latest version of theses files from the template.
If we don't do this we will run into gem Conflict error.

Fixes #7435
2017-06-16 14:28:39 +00:00
Pier-Hugues Pellerin
42e9c0d758 Extraction of the document from ruby to actual asciidoc file
This PR is based on the proposal from #6846, it does the following

- Change the format of the plugin help page
- Create an external file for each plugin type that will get included by the plugin
- Add a script to generate the PR on each plugin repo with the static doc
- Add a script `ci/ci_docs.sh` that will be used to generate the list of plugins that can be installed in logstash from all the available plugins from the community organization

This PR is the building block for change in https://github.com/elastic/docs-tools/issues/3

Fixes #6941
2017-06-08 20:14:36 +00:00
Andrew Cholakian
bb60eb8f47 Run offline specs separately from online ones.
The internet disabling C hack can break other tests, so, we now run
those tests separately.

Fixes https://github.com/elastic/logstash/issues/7178

Fixes #7179
2017-05-22 15:28:27 +00:00
Wainer dos Santos Moschetta
4636dd8dca Make ci_integration.sh use bash
The ci_integration.sh script uses double brackets ('[[') test
which is not portable. For instance, running it with dash you
get the error:

./ci/ci_integration.sh: 10: ./ci/ci_integration.sh: [[: not found

This change makes the script use bash, that supports this kind
of test.

Fixes #6939
2017-04-20 17:40:24 +00:00
Pier-Hugues Pellerin
4344e4b613 Allow Logstash to accept a PROXY configuration
Logstash's plugin manager will now follow proxy configuration from the environment.
If you configure `http_proxy` and `https_proxy`, the manager will now use theses information for all the ruby http
connection and will also pass that information down to maven.

Fixes: #6619, #6528

Fixes #6825
2017-03-31 14:20:38 -04:00
Josh Soref
a06dc211ff Spelling fixes (#6806)
Spelling fixes across the board.
2017-03-29 19:33:26 -07:00
Suyog Rao
7ebb928834 Support params to specify output dir
Fixes #6682
2017-02-09 15:03:46 -05:00