Commit graph

10505 commits

Author SHA1 Message Date
Andrea Selva
6534386f21
Created DRA shell script to create artifacts and dependency report (#14522)
* Created DRA shell script to create artifacts and dependency report
* Added console listing of the generated artifacts
2022-09-15 16:36:08 +02:00
Rob Bavey
0578ddbbd3
Upgrade jruby to 9.3.8.0 (#14524)
Also remove the explicit CSV import added in #14507, jruby-9.3.8.0 includes
the correct version by default
2022-09-13 17:36:40 -04:00
Rob Bavey
5d7fa78e09
Fix Windows scripts (#14515)
The work done in #14355 to fix the keystore and plugin scripts erroneously included
%JAVA_OPTS% in the command to invoke `jruby`, rather than as an environment variable, which
prevented these scripts from operating correctly, due to `jruby.exe` not handling Java options,
causing the scripts to crash on invocation.

This commit removes the %JAVA_OPTS% - this is already set as an environment variable, and allows the
scripts to operate correctly
2022-09-09 09:06:57 -04:00
Dan Kortschak
b7b9613c62
winlogbeat-modules: add docs for interfacing winlogbeat with logstash (#14472)
These are taken from the filebeat-modules doc with minor changes to
localise to winlogbeat and to remove the fully worked example.

Co-authored-by: Karen Metts <35154725+karenzone@users.noreply.github.com>
2022-09-08 12:48:11 +09:30
Rob Bavey
8d41b85498
Manually import CSV gem to work around thread leak (#14507)
* Manually import CSV gem to work around thread leak

The version of CSV included in jruby distributions >= `9.3.0.0` and
< `9.3.8.0` include a bug that triggers a thread leak when calling
`parse_line` in CSV files.

This commit updates the version of the CSV gem to the latest version,
which includes fixes, and remains compatible with ruby 2.6

Relates: https://github.com/jruby/jruby/issues/7346

* Add CSV license info
2022-09-07 14:45:37 -04:00
Andres Rodriguez
2a2f5ae24c
Update add_to_projects_beta.yml 2022-09-07 13:39:22 -04:00
Andres Rodriguez
328a4e20d1
Update add_to_projects_beta.yml 2022-09-07 13:32:58 -04:00
Andres Rodriguez
37ebcee716
Update add_to_projects_beta.yml 2022-09-07 13:32:25 -04:00
Andres Rodriguez
248a512350
Update add_to_projects_beta.yml 2022-09-07 11:57:01 -04:00
Andres Rodriguez
955c48131e
Update add_to_projects_beta.yml 2022-09-07 11:42:16 -04:00
Andres Rodriguez
842e45abaf
Update add_to_projects_beta.yml 2022-09-07 11:36:12 -04:00
Andres Rodriguez
5c5a52d6b0
Update add_to_projects_beta.yml 2022-09-07 11:26:18 -04:00
Andres Rodriguez
3d43f86fae
Update add_to_projects_beta.yml 2022-09-07 11:19:33 -04:00
João Duarte
4584b632fd
drop support for all DES ciphers in OpenSSL and simplify cipher list (#14499)
Remove support for DES-CBC3-SHA.

Also removes unnecessary exclusions for EDH-DSS-DES-CBC3-SHA, EDH-RSA-DES-CBC3-SHA and KRB5-DES-CBC3-SHA since there's already a "!DES" rule.
2022-09-07 13:12:27 +01:00
Andrea Selva
89c45d6d80
Change deb/rpm specification to describe as replacement of noarch old Logstash packages (#14346) 2022-09-06 18:56:33 +02:00
kaisecheng
3a78621109
fix SettingsImpl to remove hardcoded checkpointRetry (#14487)
SettingsImpl.checkpointRetry is hardcoded to false in builder. Prior to this change, users are unable to set queue.checkpoint.retry to true to enable Windows retry on PQ AccessDeniedException in checkpoint.

Fixed: #14486
2022-09-05 16:22:08 +01:00
Andrea Selva
26289b955c
Forward port release notes for 8.4.0 and 8.4.1 (#14484) 2022-08-31 09:44:45 +02:00
Andrea Selva
a10e236853
Update CI versions after 8.4.1 (#14482) 2022-08-31 09:44:08 +02:00
Andres Rodriguez
2944eacd29
Add missing reference to full config of LS-to-LS over HTTP (#14466) 2022-08-29 14:18:05 -04:00
kaisecheng
88d89fe896
[Doc] add off-heap memory session (#14431)
Relates: #12622

Co-authored-by: Karen Metts <35154725+karenzone@users.noreply.github.com>
2022-08-24 22:24:06 +01:00
Rob Bavey
a2a82f7406
Bump release and snapshot versions (#14469) 2022-08-24 16:45:16 -04:00
João Duarte
6bc2483cfc
bump jruby version to 9.3.7.0 (#14455) 2022-08-17 14:30:45 +01:00
João Duarte
9d16c3bce5
Stop pinning mustermann in logstash-core.gemspec (#14453) 2022-08-17 11:37:14 +01:00
João Duarte
24c675ccd8
remove sinatra constraint (#14446) 2022-08-17 10:04:16 +01:00
João Duarte
4cb900ce7e
update flores dependency to at least 0.0.8 (#14437) 2022-08-17 09:56:45 +01:00
Rob Bavey
c124cc6c9e
Remove the chmod g+s command from ironbank docker image (#14435) 2022-08-16 10:10:06 -04:00
Rob Bavey
cd60c6522a
Update tests to allow integration tests to use the bundled JDK (#14432)
* Adds tasks to add bundled JDK to tar file used to run integration tests
* Uses `RUNTIME_JAVA_HOME` environment variable to control whether bundled JDK or
  alternative is to be used
* Updates logstash service helper to respect value of `RUNTIME_JAVA_HOME`

* Requires updates to jenkins repo to set `RUNTIME_JAVA_HOME` correctly only for
  integration tests that expect to use a custom version of Java, such as the JDK
  matrix tests.
2022-08-16 09:03:52 -04:00
lior-orca
5767b3b986
Ensuring COPY instruction is used instead of ADD in Dockerfiles (#14423) 2022-08-12 14:59:52 +01:00
Andrea Selva
2e4837ccff
Fixes typo in running logstash CLI doc (#14428)
Co-authored-by: @zhangzheng1212
2022-08-10 14:34:12 +02:00
Boris Djurdjevic
f03330acd3
Add monitoring.cluster_uuid as Docker env setting(#14425)
Fix env2yaml tool to expose monitoring.cluster_uuid as Docker environment variable
2022-08-10 14:17:00 +02:00
Andres Rodriguez
5959676809
Update feature-request.md (#12873)
Update feature-request.md to provide a nicer description.

Co-authored-by: Karen Metts <35154725+karenzone@users.noreply.github.com>
Co-authored-by: hendry-lim <48344515+hendry-lim@users.noreply.github.com>
2022-08-09 14:46:28 +01:00
Rob Bavey
4771ad61b9
Update version of the bundled JDK to 17.0.4+8 (#14424) 2022-08-09 09:21:23 -04:00
kaisecheng
5b69f65797
Pin jar-dependencies 0.4.1 (#14421)
* pin jar-dependencies to 0.4.1
CI red with `Gem::LoadError: You have already activated jar-dependencies 0.4.1, but your Gemfile requires jar-dependencies 0.4.2`

* add comment
2022-08-04 11:13:30 -07:00
Andrea Selva
7887972348
Open java modules for gradle test after 7.5 upgrade (#14413)
Open the access to java.lang and java.util packages in java.base module.
With Gradle 7.5 these packages aren't anymore implicitly opened in test tasks. With this commit, those packages are opened for all test tasks, also on the buildSrc.
2022-08-03 15:32:49 +02:00
Karen Metts
5354998113
Doc: Fileset must be enabled in module (#14405) 2022-08-02 19:23:05 -04:00
João Duarte
dfa88aa0e9
Make version bump github action work with future JRuby versions (#14391)
Release branches are expected to have a lock file whose name is `Gemfile.jruby-X.Y.lock.release`, where `X.Y` is the Ruby language version.
This Ruby language version differs from JRuby version: for example, JRuby 9.2 is compatible with Ruby 2.5, while JRuby 9.3 is compatible with Ruby 2.6.
This commit makes the version bump agnostic to the version. Since there will be a lock file already present when the action is run, we only need to replace it, so there's no need to know the exact file name.
2022-07-29 21:18:15 +01:00
João Duarte
8aa62dc441
pin bundler 2.3.18 to avoid bug in .19 (#14394)
When using Bundler 2.3.19, doing a "bin/logstash-plugin uninstall <plugin>"
will crash, failing to find gems in the :build group.

Until we know more about why, pin bundler to 2.3.19
2022-07-29 17:46:10 +01:00
Mashhur
f798d5f0e4
Upgrade CI stack version to 8.3.3 (#14393) 2022-07-28 15:52:46 -07:00
github-actions[bot]
cf84698570
Release notes for 8.3.3 (#14365) (#14389)
Co-authored-by: Rob Bavey <rob.bavey@elastic.co>
Co-authored-by: Karen Metts <35154725+karenzone@users.noreply.github.com>
(cherry picked from commit b25960f86f)
2022-07-28 13:34:21 -04:00
github-actions[bot]
506094eda2
Release notes for 8.3.2 (#14327) (#14387)
Co-authored-by: logstashmachine <43502315+logstashmachine@users.noreply.github.com>
Co-authored-by: João Duarte <jsvd@users.noreply.github.com>
(cherry picked from commit f007d0ec04)
2022-07-28 12:24:29 -04:00
Andrea Selva
07fe589d8a
[doc] Describe DLQ's age retention policy (#14340)
Describe the DLQ age retention policy.
2022-07-27 13:01:22 -04:00
Andrea Selva
3c5ed2b62f
Document the cleaning of consumed events feature (#14341)
Documents the clean_consumed setting, which allows the user to remove processed/consumed DLQ events . 

Co-authored-by: Karen Metts <35154725+karenzone@users.noreply.github.com>
2022-07-27 12:43:41 -04:00
Rob Bavey
5a6460899d
Bump version to 8.5.0 (#14382) 2022-07-27 08:57:02 -04:00
João Duarte
6262cc6b70
upgrade to gradle 7.5 (#14378) 2022-07-26 14:34:50 +01:00
João Duarte
f377fd3e4f
update some java dependencies (#14377)
Update the following java dependencies:

* org.reflections:reflections
* commons-codec:commons-codec
* com.google.guava:guava
* com.google.googlejavaformat:google-java-format
* org.javassist:javassist

The goal of these updates is to not fall behind and avoid surprises when an upgrade is necessary due to a security issue.
2022-07-26 11:34:35 +01:00
João Duarte
ae4a64d9ae
introduce logstash-integration-aws (#14369)
The logstash-integration-aws plugin replaces the underlying individual plugins related to AWS.

This commit also updates the necessary files around license checking.
2022-07-26 10:50:58 +01:00
Andres Rodriguez
e5bc14b51d
[doc] Update example ES output configs to reflect DS being default (#14011)
Update example ES output configs to reflect DataStreams being default

Fixes #14008
2022-07-25 13:12:59 -04:00
Rob Bavey
422dfa7a26
Add darwin to aarch64 builds (#13425) 2022-07-22 15:55:17 -04:00
Rob Bavey
777254f6bc
Fix mismatched Java versions in integration tests (#14374)
* Fix version of java used to retrieve logstash version in integration tests

Prior to this commit, the system java would be used to retrieve logstash
version in integration tests, leading to test failures with IT environments
that have java 1.8 as system java

* Actually fix `test_port` this time

Use bash `/dev/tcp` to test ports rather than attempting to use `nc` and
`ruby`
2022-07-22 14:15:32 -04:00
Rob Bavey
254fdbb8a3
Revert "Update .ruby-version to match jruby version of 9.3.6.0 (#14357)" (#14373)
This reverts commit 772d4e89d2.

Release Manager workers are not ready for this update
2022-07-22 10:04:17 -04:00