Commit graph

1250 commits

Author SHA1 Message Date
github-actions[bot]
7302a0067c
Release notes for 7.17.15 (#15573)
Co-authored-by: logstashmachine <43502315+logstashmachine@users.noreply.github.com>
Co-authored-by: João Duarte <jsvd@users.noreply.github.com>
Co-authored-by: Karen Metts <35154725+karenzone@users.noreply.github.com>
2023-11-13 14:28:38 +00:00
github-actions[bot]
34824fc464
Release notes for 7.17.14 (#15389)
Co-authored-by: Mashhur <mashhur.sattorov@elastic.co>
2023-10-09 17:57:15 -04:00
github-actions[bot]
e2047573fa
Release notes for 7.17.13 (#15289)
* Update release notes for 7.17.13
---------

Co-authored-by: logstashmachine <43502315+logstashmachine@users.noreply.github.com>
Co-authored-by: andsel <selva.andre@gmail.com>
Co-authored-by: Karen Metts <35154725+karenzone@users.noreply.github.com>
2023-09-04 21:52:58 +01:00
github-actions[bot]
fce9da92dd
Release notes for 7.17.12 (#15199)
Co-authored-by: João Duarte <jsvd@users.noreply.github.com>
Co-authored-by: Karen Metts <35154725+karenzone@users.noreply.github.com>
Co-authored-by: Edmo Vamerlatti Costa <11836452+edmocosta@users.noreply.github.com>
2023-07-24 19:20:00 -04:00
github-actions[bot]
3a4bd272c8
Fix typo that caused subtitle not to show (#15202) (#15203)
(cherry picked from commit b082e519c0)

Co-authored-by: Andres Rodriguez <andres.lazo@elastic.co>
2023-07-20 13:09:30 -04:00
github-actions[bot]
c2cb579eba
Add initial PQ sizing doc (#15033) (#15171)
Add storage sizing guidance for Persistent Queues.

Co-authored-by: Karen Metts <karen.metts@elastic.co>
Co-authored-by: Joao Duarte <joao@elastic.co>
(cherry picked from commit c2bbed8266)
2023-07-14 15:23:06 -04:00
github-actions[bot]
b4f2694554
Release notes for 7.17.11 (#15107)
* Update release notes for 7.17.11


---------

Co-authored-by: logstashmachine <43502315+logstashmachine@users.noreply.github.com>
Co-authored-by: Rob Bavey <rob.bavey@elastic.co>
2023-06-28 12:50:18 -04:00
github-actions[bot]
06ae8240b0
Release notes for 7.17.10 (#15026)
Co-authored-by: João Duarte <jsvd@users.noreply.github.com>
2023-04-27 12:59:55 +01:00
github-actions[bot]
a8bca85b75
Release notes for 7.17.9 (#14858)
Co-authored-by: João Duarte <jsvd@users.noreply.github.com>
2023-02-02 09:26:47 -05:00
github-actions[bot]
6180be5a43
Release notes for 7.17.8 (#14798)
Co-authored-by: Karen Metts <35154725+karenzone@users.noreply.github.com>
2022-12-07 22:55:11 +00:00
github-actions[bot]
a6db1b0db5
Backport PR #14738 to 7.17: [Doc] Document the usage of LS_JAVA_OPTS environment variable #14750
* [Doc] Document the usage of LS_JAVA_OPTS environment variable

Co-authored-by: Rob Bavey <rob.bavey@elastic.co>
(cherry picked from commit 9242105c3c)

Co-authored-by: Andrea Selva <selva.andre@gmail.com>
2022-11-15 09:45:09 +01:00
github-actions[bot]
b7f5962070
Release notes for 7.17.7 (#14623)
Co-authored-by: David Kilfoyle <41695641+kilfoyle@users.noreply.github.com>
Co-authored-by: Kaise Cheng <kaise.cheng@elastic.co>
2022-10-18 10:08:11 -04:00
Karen Metts
38574bd6ee
Doc: Update release notes with security notice [7.17] (#14467) 2022-08-24 13:09:27 -04:00
github-actions[bot]
361279da1f
Release notes for 7.17.6 (#14462)
Co-authored-by: Karen Metts <35154725+karenzone@users.noreply.github.com>
Co-authored-by: Rob Bavey <rob.bavey@elastic.co>
2022-08-23 21:14:04 -04:00
github-actions[bot]
c8419c2097
Fix broken link to image (#14343) (#14344)
(cherry picked from commit 1ddd4ccd83)

Co-authored-by: Cleydyr Bezerra de Albuquerque <cleydyr.bezerradealbuquerque@elastic.co>
2022-07-12 16:47:28 +01:00
Ry Biesemeyer
6f0bcb45dc
Bump for 7.17.6 (#14309)
* bump to 7.17.6

* bump version of logstash itself in gemfile.lock.release

* Update docs/static/releasenotes.asciidoc

Co-authored-by: João Duarte <jsvd@users.noreply.github.com>

* Update docs/static/releasenotes.asciidoc

Co-authored-by: João Duarte <jsvd@users.noreply.github.com>

Co-authored-by: João Duarte <jsvd@users.noreply.github.com>
2022-06-28 08:11:05 -07:00
Logstash Machine
8fe63b3884
Release notes for 7.17.5 (#14303)
* Update release notes for 7.17.5

* humanize the 7.17.5 release notes

* Apply suggestions from code review

Co-authored-by: Ry Biesemeyer <ry.biesemeyer@elastic.co>
Co-authored-by: Karen Metts <35154725+karenzone@users.noreply.github.com>
2022-06-27 12:20:50 -07:00
Logstash Machine
24bef99622
Release notes draft for 7.17.4 (#14124)
* Update release notes for 7.17.4

* update release note

Co-authored-by: Jenkins CI <jenkins@logstash-ci-immutable-ubuntu-1604-lts-1652877190169841117.c.elastic-ci-prod.internal>
Co-authored-by: Kaise Cheng <kaise.cheng@elastic.co>
2022-05-23 11:02:25 +01:00
github-actions[bot]
94b5f982c8
[Doc] queue.max_bytes for all queues (#14128) (#14140)
* bring back the details of PQ size checking

(cherry picked from commit 205cf43213)

Co-authored-by: kaisecheng <69120390+kaisecheng@users.noreply.github.com>
2022-05-20 10:38:12 +01:00
github-actions[bot]
d2240e072c
Doc: Update settings file doc to call out queue type (#14127) (#14135)
* [DOCS] Added a few missing "(`queue.type: persisted`)" to a few of the logstash.yml.
* [DOCS] Moved a few of the queue_type persisted indicators.
(cherry picked from commit a6e418adf7)

Co-authored-by: Nicole Albee <2642763+a03nikki@users.noreply.github.com>
2022-05-19 21:13:08 -04:00
github-actions[bot]
2c1771f89f
[Doc] PQ and DLQ do not support NFS (#14095) (#14100)
* [Doc] PQ and DLQ do not support NFS
Fixed: #12097

Co-authored-by: Karen Metts <35154725+karenzone@users.noreply.github.com>
(cherry picked from commit 90e7c8864e)

Co-authored-by: kaisecheng <69120390+kaisecheng@users.noreply.github.com>
2022-05-16 16:17:46 +01:00
Logstash Machine
56d0bc72bd
Release notes for 7.17.4 (#14035)
* Update release notes for 7.17.4

Co-authored-by: Jenkins CI <jenkins@logstash-ci-immutable-debian-9-1651052841408258358.c.elastic-ci-prod.internal>
Co-authored-by: Kaise Cheng <kaise.cheng@elastic.co>
Co-authored-by: Karol Bucek <kares@users.noreply.github.com>
Co-authored-by: Karen Metts <35154725+karenzone@users.noreply.github.com>
2022-05-02 14:56:02 +01:00
Logstash Machine
6bb0758909
Release notes for 7.17.3 (#13985)
* Update release notes for 7.17.3

* Update releasenotes.asciidoc

* Update docs/static/releasenotes.asciidoc

Co-authored-by: Karen Metts <35154725+karenzone@users.noreply.github.com>

Co-authored-by: Jenkins CI <jenkins@logstash-ci-immutable-ubuntu-1804-lts-1649756278313218066.c.elastic-ci-prod.internal>
Co-authored-by: João Duarte <jsvd@users.noreply.github.com>
Co-authored-by: Karen Metts <35154725+karenzone@users.noreply.github.com>
2022-04-19 09:20:23 -05:00
Logstash Machine
43b1261cf0
Release notes for 7.17.2 (#13932)
Co-authored-by: João Duarte <jsvd@users.noreply.github.com>

Co-authored-by: Jenkins CI <jenkins@logstash-ci-immutable-opensuse-15-1-1648138023535464121.c.elastic-ci-prod.internal>
Co-authored-by: João Duarte <jsvd@users.noreply.github.com>
Co-authored-by: Karen Metts <35154725+karenzone@users.noreply.github.com>
2022-03-30 20:57:29 +01:00
github-actions[bot]
7474ce9275
[DOC] precedence between environment variables and yml in docker (#12198) (#13949)
Backport PR #12198 to 7.17 branch

Co-authored-by: Andrea Selva <selva.andre@gmail.com>
(cherry picked from commit 682f07b703)

Co-authored-by: João Duarte <jsvd@users.noreply.github.com>
2022-03-29 17:38:06 +01:00
github-actions[bot]
86ed160086
add backoff to checkpoint write (#13902) (#13931)
This commit changes `queue.checkpoint.retry` to `true` by default allowing retry of checkpoint write failure.
Add exponential backoff retry to checkpoint write to mitigate AccessDeniedExcpetion in Windows.
Fixed: #12345

(cherry picked from commit 1a5030bd63)

Co-authored-by: kaisecheng <69120390+kaisecheng@users.noreply.github.com>
2022-03-24 15:39:22 +00:00
github-actions[bot]
59a30d8b39
[Doc] update queue.max_bytes and queue.page_capacity (#13833) (#13910)
Fixed: #8650, #10718

Backport PR #13833 to 7.17 branch

Co-authored-by: Karen Metts <35154725+karenzone@users.noreply.github.com>
(cherry picked from commit d71553e5d7)

Co-authored-by: kaisecheng <69120390+kaisecheng@users.noreply.github.com>
2022-03-18 11:05:27 +00:00
Ry Biesemeyer
6fe6bc1054
Backport PR #13715 to 7.17: artifacts: omit openssl_pkcs8_pure specs from built artifacts (#13852)
* artifacts: omit openssl_pkcs8_pure specs from built artifacts (#13715)

* artifacts: omit openssl_pkcs8_pure specs from built artifacts

* Exclude _all_ top-level spec and test directories from built artifacts

Co-authored-by: João Duarte <jsvd@users.noreply.github.com>

Co-authored-by: João Duarte <jsvd@users.noreply.github.com>
(cherry picked from commit 0369ba208d)

* Update releasenotes.asciidoc (#13701)

Fixed OS name. Ubuntu instead of Ununtu.

Co-authored-by: Cris da Rocha <cdarocha.astro@gmail.com>
2022-03-04 17:33:49 -08:00
Logstash Machine
60688f2377
Release notes draft for 7.17.1 (#13813)
* Update release notes for 7.17.1

* copy from 8.0.1 release note

Co-authored-by: Jenkins CI <jenkins@logstash-ci-immutable-ubuntu-1804-lts-1645618372441025592.c.elastic-ci-prod.internal>
Co-authored-by: Kaise Cheng <kaise.cheng@elastic.co>
2022-02-24 10:21:39 +00:00
Cris da Rocha
2c515750fd
Update releasenotes.asciidoc (#13701)
Fixed OS name. Ubuntu instead of Ununtu.
2022-02-02 10:28:50 -05:00
Logstash Machine
4113c6b424
Release notes draft for 7.17.0 (#13690)
* Update release notes for 7.17.0

* humanize the generated release notes for 7.17.0

* release-notes: improve tense continuity and wording

Co-authored-by: Karen Metts <35154725+karenzone@users.noreply.github.com>

Co-authored-by: Ry Biesemeyer <ry.biesemeyer@elastic.co>
Co-authored-by: Ry Biesemeyer <yaauie@users.noreply.github.com>
Co-authored-by: Karen Metts <35154725+karenzone@users.noreply.github.com>
2022-01-31 10:46:57 -08:00
Karen Metts
455995c32a
Doc: Add placeholder for 7.17.0 release notes (#13688) 2022-01-27 13:16:35 -05:00
kaisecheng
4cfe698391
Revert "[DOC] Clarify the scope of environment variable expansion (#13299)" (#13679) (#13683)
This reverts commit 096eb7ac48.
2022-01-27 10:24:32 +00:00
Ry Biesemeyer
22e2e52d9c
Backport PR #13612 to 7.17: [Docs] Add pipeline.ecs_compatibility to the list (#13638)
* [Docs] Add pipeline.ecs_compatibility to the list (#13612)

* Add pipeline.ecs_compatibility to the list

* Update docs/static/running-logstash-command-line.asciidoc

Co-authored-by: Ry Biesemeyer <yaauie@users.noreply.github.com>

Co-authored-by: Ry Biesemeyer <yaauie@users.noreply.github.com>
(cherry picked from commit e11d0364d4)

* Rephrase docs for --pipeline.ecs_compatibility flag for 7.x perspective

Co-authored-by: Toby Sutor <55087308+toby-sutor@users.noreply.github.com>
2022-01-20 10:52:26 -08:00
Karen Metts
3c0b948a85
[DOC] Clarify scope of queue settings 7.17 (#13651)
Backports #12955 to 8.0

Author: Luca Belluccini <luca.belluccini@elastic.co>
Co-authored-by: Karen Metts <35154725+karenzone@users.noreply.github.com>
Co-authored-by: Andrea Selva <andrea.selva@elastic.co>
2022-01-20 11:42:13 -05:00
Ry Biesemeyer
abadc329e1
ecs: docs and comments syncing for 7.last (#13626) 2022-01-18 16:35:07 -08:00
Karen Metts
5b8e61595b
Doc: Forward 7.16.2 and 7.16.2 release notes to 7.17 (#13611) 2022-01-13 14:02:39 -05:00
Ry Biesemeyer
e48a0810e6
docs: sprintf vs UTC nature of @timestamp field (#13576) (#13590)
Add notes to the Event sprintf docs about timestamp formatting to call out the
UTC nature of the Timestamp object.

Resolves: elastic/logstash#13112
Closes: elastic/logstash#13571
(cherry picked from commit ef40bb0643)
2022-01-06 15:52:07 -08:00
Karen Metts
18c30527c4
Doc: Add anchor to bundled jdk info 7.17 (#13542)
Backports #13535 to 7.17
2021-12-17 19:18:12 -05:00
Karen Metts
5fad50496b
Doc: remove PQ on input for Output Isolator 7.17 (#13539)
Backports #13537 to 7.17

The Output Isolator Pattern doesn't need a persisted queue on the input
pipeline to work. It just needs one on every output pipeline.

Authored-by: Toby McLaughlin <toby@jarpy.net>
2021-12-17 18:28:57 -05:00
Karen Metts
c3b0bb4224
Doc: Add dependency fix to 7.16.1 release notes (#13516) 2021-12-14 15:50:13 -05:00
Karen Metts
7875e243f7
Doc: Add filter known issue to 7.16.1 release notes (#13513) 2021-12-14 13:15:49 -05:00
Logstash Machine
59c275474e
Release notes for 7.16.1 (#13503)
Co-authored-by: João Duarte <jsvd@users.noreply.github.com>
2021-12-13 15:58:56 +00:00
Logstash Machine
c228710041
Release notes for 7.16.0 (#13436)
Co-authored-by: Karol Bucek <kares@users.noreply.github.com>
Co-authored-by: João Duarte <jsvd@users.noreply.github.com>
Co-authored-by: Karen Metts <35154725+karenzone@users.noreply.github.com>
2021-12-07 11:41:48 +01:00
Karol Bucek
fcf7fa87ba
Forward Port: Release notes for 7.15.2 (#13435)
Co-authored-by: Karen Metts <35154725+karenzone@users.noreply.github.com>
Co-authored-by: Rob Bavey <rob.bavey@elastic.co>
2021-11-23 10:45:20 +01:00
Karol Bucek
2c965533bc
Forward Port: Release notes for 7.15.1 (#13434)
Co-authored-by: Karen Metts <karen.metts@elastic.co>
2021-11-23 10:22:15 +01:00
Karen Metts
1f9f78274b
Doc: Expand PQ content for pipeline-pipeline (#13422)
Backports #13319 to 7.16
2021-11-18 20:57:42 -05:00
Karen Metts
354210663d
Doc: Update central management license info (#13374)
Backports #13368 to 7.16
2021-11-02 16:37:03 -04:00
Ry Biesemeyer
0603651ba7
Secure API (Backport to 7.x) (#13342)
* settings: add "deprecated alias" support

A deprecated alias provides a path for renaming a setting.

 - When a deprecated alias is set on its own, a deprecation notice is emitted
   but fetching the canonical setting value will reflect the value set with the
   deprecated alias.
 - When both the canonical setting (new name) and the deprecated alias (old
   name) are specified, it is an error condition.
 - When the value of the deprecated alias is queried, a warning is emitted to
   the logger and only the value explicitly set to the deprecated alias is
   returned.

Additionally, some relevant cleanup is also included:

 - Starting Logstash with invalid settings no longer results in the obtuse "An
   unexpected error occurred" with backtrace and exception data obscuring the
   issue. Instead, a simple message is emitted indicating that the settings are
   invalid along with the originating exception's message.
 - The various settings implementations share a common logger, instead of each
   implementation class providing its own. This is aimed to reduce noise from
   the logs and to ensure specs validating logging do not need to tie so
   closely to implementation details.

* settings: add password-wrapped setting

* settings: make any setting type capable of being nullable

* settings: add `Settings#names` to power programatic iteration

* cli: route CLI-flag deprecations in to deprecation logger

* settings: group API-related settings under `api.*`

retains deprecated aliases, and is fully backward-compatible.

* webserver: cleanup orphaned attr accessors for never-set ivars

* api: pull settings extraction down from agent

This net-no-change refactor introduces a new method `WebServer#from_settings`
that bridges the gap between Logstash settings and Puma-related options, so
that future additions to the API settings don't add complexity to the Agent.

It also has the benefit of initializing the API Rack App and just ONCE, instead
of once per attempted HTTP port.

* api: add optional TLS/SSL

* docs: reference API security settings

* api: when configured securely, bind to all available interfaces by default

* cleanup: remove unused cert artifacts

* tests: generate fresh webserver certificates

* certs: actually add the binary keystores 🤦
2021-10-19 14:13:37 -07:00
Karen Metts
e1b3445ad1
Doc: Add link to pq info from troubleshooting topic (#13327)
Backports #13320 to 7.x
Fixes: #13158
Related: #13173
2021-10-15 15:13:40 -04:00