Commit graph

275 commits

Author SHA1 Message Date
Mashhur
eb9859276e
Update stack versions for CI. (#15864) 2024-01-28 21:02:30 -08:00
Andrea Selva
8657ce9d21
Re-enabled collectd codec in test_plugins script (#15857) 2024-01-26 17:31:31 +01:00
Dimitrios Liappis
52d9e6286e
Update active branches used by CI (#15816)
Relates https://github.com/elastic/logstash/pull/15814
2024-01-18 15:35:18 +02:00
Pavel Zorin
2c83a52380
[CI] Send Java and ruby tests to sonarqube simultaneously (#15810)
* Ruby code coverage with SimpleCov json formatter

* [CI] Send Java and ruby tests to sonarqube simultaneously

* Enabled COVERAGE for ruby tests

* Enabled COVERAGE for ruby tests

* Enabled COVERAGE for ruby tests

* Enabled COVERAGE for ruby tests

* Enabled COVERAGE for ruby tests

* Added compiled classes to artifacts

* Test change

* Removed test changes

* Returned back ENABLE_SONARQUBE condition

* Removed debug line

* Diable Ruby coverage if ENABLE_SONARQUBE is not true

* Run sonar scan on pull requests and onn push to main

* Run sonar can on release branches
2024-01-17 19:04:37 +00:00
Andrea Selva
4a2104b1a4
Update releases inventory after 8.11.4 (#15783) 2024-01-11 15:54:41 +01:00
Dimitrios Liappis
cebe4a7537
Refactor qa/acceptance tests to get away from vagrant (#15696)
This commit modernizes the qa/acceptance (packaging) test framework by
moving away from Vagrant and having the tests operate locally.

As we are migrating to Buildkite, the expectation is that those tests
will run on dedicated vms thus removing the necessity of vagrant.

Relates: https://github.com/elastic/ingest-dev/issues/1722
2024-01-08 09:40:58 +02:00
Andrea Selva
76d1677187
Fixes a typo in plugin's organization name (#15743)
Fixes a typo in string definition for Logstash's plugins organization.
2024-01-04 17:11:55 +01:00
Andrea Selva
6dc8423186
Add filter elastic_integration to be tested in test_plugins script (#15723)
Add the `logstash-filter-elasticsearch_integration` plugin to the list of test_plugins pipeline.
In doing so, reworked the definition of plugins, by not just specifying a plugin name but also adding support leve, type and organization. This necessary for plugins which repository is not part of `logstash-plugins` Github organization but at the same time permit an easier management of the different axes that partitions the plugin landscape.

Co-authored-by: João Duarte <jsvd@users.noreply.github.com>
2024-01-04 16:00:45 +01:00
Andrea Selva
2be661b9bc
Re-enable json filter and netflow codec plugins (#15722)
- Re-enabled logstash-filter-json and logstash-codec-netflow plugins into the test_plugins BK pipeline.
- Moved codecs tier2 to be executed in separata VM.
- Commented plugin logstash-codec-collectd till is fixed
2024-01-02 17:20:28 +01:00
João Duarte
aa05205a9e
Update logstash_releases.json to include 7.17.16 and 8.11.3 (#15688) 2023-12-12 18:23:46 +00:00
Andrea Selva
241c03274c
Avoid to run integration tests while testing all supported plugin (#15511)
Update the test_plugins pipeline script to execute only the unit tests.
Use the vendored JRuby in every Ruby related duty, such as running `bundler` and `gem`.
Temporarily comments plugins that has needs to be fixed and already fails on  their Travis CI.
Executes the testing of input tier1 plugins in VM instead of Buildkite agent.
2023-12-11 10:11:03 +01:00
Dimitrios Liappis
365ca4e2d6
Add new 8.12 branch to CI (#15667)
Now that we have a new 8.12 branch[^1], add it to CI definitions.

[^1]: https://github.com/elastic/logstash/tree/8.12
2023-12-07 15:59:08 +02:00
Dimitrios Liappis
0b1d15e250
Add list of active branches for automation (#15627)
This commit introduces a json file that contains a list of active
branches. It's essentially the same thing done in the Elasticsearch
repo in https://github.com/elastic/elasticsearch/pull/99026 and helps
simplify and automate Buildkite scheduled jobs.

Relates:

- https://github.com/elastic/ingest-dev/issues/2664
- https://elasticco.atlassian.net/browse/ENGPRD-318
- https://github.com/elastic/ingest-dev/issues/2663
2023-11-30 16:55:46 +02:00
João Duarte
6547f8c5c4
Update logstash_releases.json to include 7.17.15 and 8.11.1 (#15578) 2023-11-14 11:03:54 +00:00
Mashhur
8700179cf2
Update 8.x CI to 8.11 (#15551) 2023-11-12 05:10:56 +05:00
Ry Biesemeyer
a7e2839a83
build meta: bump 8.x snapshot to 8.12 (#15546)
once 8.11 was cut, snapshot build for 8.x should be 8.12
2023-11-07 14:34:08 -08:00
Andres Rodriguez
e3584fd53e
Plugin Tests: Exit 1 on error (#15527)
The plugin tests were not correctly exiting when plugin errors were present. It will now correctly exit 1 if there are plugins with errors.
2023-11-03 12:38:01 -04:00
Andres Rodriguez
cf71dae3ff
Add support to test unsupported plugins (#15526)
Add support to test unsupported plugins. Only enable input-rss for now.
2023-11-03 12:08:01 -04:00
Dimitrios Liappis
c384190718
[ci] aarch64 Buildkite pipeline part 2 (#15473)
This commit is the follow up PR after #15466, which migrates away
the remaining aarch64 acceptance test Jenkins jobs to Buildkite.

Relates:

- #15466
- https://github.com/elastic/ingest-dev/issues/1724
2023-10-25 18:08:56 +03:00
Dimitrios Liappis
b1ab2fad3e
Option to disable SonarQube with Java Tests (#15486)
This commit introduces a way to optionally disable SonarQube scanning
and coverage reports when running Java unit tests. The integration
was introduced in #15279, however, there are cases (e.g. running Java
unit tests outside of PRs) where we don't want this integration.

Disabling can be achieved by setting the env var `ENABLE_SONARQUBE`
to `false`.
2023-10-24 10:32:44 +03:00
Mashhur
3a753e49e8
Update Logstash core versions in CI after release. (#15424) 2023-10-12 22:57:43 -07:00
Andrea Selva
03e0b1a301
Updates CI versions after 8.10.2 (#15339) 2023-09-21 09:24:02 -07:00
João Duarte
c33af94faa
Update logstash_releases.json to include 8.10.1 2023-09-20 13:28:40 +01:00
Pavel Zorin
f90647d98d
Sonar integration with Java Tests code coverage (#15279)
* Sonar integration

* Removed sonar from test target
2023-09-15 00:47:38 +02:00
Andrea Selva
4bddfd7d06
Update CI releases after 7.17.13 (#15293) 2023-09-13 16:48:59 +02:00
kaisecheng
03f1a18a77
Update CI releases after 8.10.0 (#15319) 2023-09-13 10:56:50 +01:00
kaisecheng
236b8cb8cb
bump_ci_8.10.0 (#15315) 2023-09-12 14:14:08 +01:00
Andrea Selva
3d67f8238d
Update CI releases after 8.9.2 (#15295) 2023-09-08 14:47:06 +02:00
kaisecheng
0286f671d2
serverless test use minimum privileges per case (#15264)
This commit splits the privileges per use case and 
removes ilm in template for serverless test
2023-08-31 22:27:43 +01:00
kaisecheng
9e48f9cfde
update release version (#15263) 2023-08-17 17:14:15 +01:00
kaisecheng
a51c788e0c
[doc] serverless setup endpoint for test (#15249)
Co-authored-by: João Duarte <jsvd@users.noreply.github.com>
2023-08-16 17:37:12 +01:00
kaisecheng
fb66e9888c
Fix serverless test for api protection (#15252) 2023-08-16 14:02:11 +01:00
kaisecheng
9af7c7cef4
Serverless test against restricted API key (#15224)
This commit changes the serverless tests to use a restricted API key with necessary permissions and disables Logstash legacy monitoring test.

Fixes: #15234

Co-authored-by: João Duarte <jsvd@users.noreply.github.com>
2023-08-02 15:27:46 +01:00
Rob Bavey
6d4ae5e8e7
Update releases.json with latest released versions (#15219) 2023-07-25 10:24:13 -04:00
kaisecheng
0f8695593e
buildkite serverless test (#15150)
This commit adds a Buildkite pipeline to test against serverless endpoint daily

Tests cover 
- es-output
- es-input
- es-filter
- central pipeline management
- legacy monitoring
- dlq
- integration-filter
- kibana API
- metricbeat stack monitoring

Co-authored-by: João Duarte <jsvd@users.noreply.github.com>
Co-authored-by: João Duarte <jsvduarte@gmail.com>
2023-07-19 17:21:53 +01:00
Andres Rodriguez
4255a8fd1c
Rubocop: Enable SpaceAround cops (#15196)
* Enable SpaceARoundBlockParameters
* Enable SpaceAroundEqualsInParameterDefault
* Enable SpaceAroundKeyword
* Enable SpaceAroundOperators
* Enable SpaceBeforeBlockBraces, which yields no changes
2023-07-18 21:11:57 -04:00
Andres Rodriguez
acd87a69e7
Rubocop: Enable various EmptyLine cops (#15194)
Disabled:
 * EmptyLineAfterGuardClause
 * EmptyLineAfterMultilineCondition
 * EmptyLinesAroundAccessModifier

Enabled:
 * Layout/EmptyLineAfterMagicComment
 * Layout/EmptyLineBetweenDefs
 * Layout/EmptyLines
 * Layout/EmptyLinesAroundArguments
 * Layout/EmptyLinesAroundAttributeAccessor
 * Layout/EmptyLinesAroundBeginBody
 * Layout/EmptyLinesAroundBlockBody
 * Layout/EmptyLinesAroundExceptionHandlingKeywords
 * Layout/EmptyLinesAroundMethodBody
 * Layout/EmptyLinesAroundModuleBody
2023-07-18 16:49:16 -04:00
Andrea Selva
5d6aa105b0
Script to run all plugins tests and try an install, rooting in local Logstash (#15018)
Implements a script to test all supported plugins against Logstash/JRuby, in particular it uses the JRuby(and JDK) bundled with Logstash to execute the unit tests, create the gem and install the gem on local Logstash.

This doesn't start a real pipeline run into the local Logstash, but should be enough to reveal macroscopic Ruby syntax compatibility errors.

Refer to PR  https://github.com/elastic/logstash/pull/15018 for usage examples.

Co-authored-by: Ry Biesemeyer <yaauie@users.noreply.github.com>
2023-07-18 10:37:44 +02:00
Rob Bavey
9f14c649ff
Update released versions (#15129) 2023-06-30 13:37:36 -04:00
Andrea Selva
e5f35df62b
Update versions used in plugins CI (#15061) 2023-05-26 09:07:03 +02:00
João Duarte
139acd1058
Update logstash_releases.json with the releases of 7.17.10 and 8.7.1 (#15037) 2023-05-02 09:57:44 +01:00
kaisecheng
f6b14b9a28
Update ci release version 8.7.0 (#14983) 2023-04-02 16:31:21 +01:00
Mashhur
34dcdad62c
CI LS version bump, 8.6.2 (#14911) 2023-02-21 15:39:20 +05:00
João Duarte
d2858ffd66
Update releases list to include 8.6.1 2023-01-26 21:54:23 +00:00
Andrea Selva
a7027dc547
Update CI configured versions after 8.6.0 release (#14830) 2023-01-11 08:02:22 +01:00
kaisecheng
52d2d2e57a
update ci release file (#14807) 2022-12-12 13:54:54 +00:00
Andrea Selva
7a39d97055
Avoid to create and upload AARCH64 Docker images for UBI8 (#14786)
On ARM architecture UBI8 Docker images aren't created, so avoid to create empty tar.gz files.
2022-11-29 11:21:08 +01:00
Andrea Selva
2e5e49d10d
[DRA] Avoid to loose err code on docker save (#14780)
* [DRA] Force docker save to save directly on file instead of pipe to another command loosing the execution error code
2022-11-28 16:47:04 +01:00
Andrea Selva
aa73187d93
Update CI used versions after 8.5.2 release (#14772) 2022-11-22 18:39:30 +01:00
Andres Rodriguez
1dead06cdd
DRA: Build dockerfiles for release (#14730) 2022-11-03 09:14:44 -04:00