Commit graph

11063 commits

Author SHA1 Message Date
Karen Metts
b519cf4213
Doc: Remove local k8s files (#17547) 2025-04-17 19:20:41 -04:00
Karen Metts
f91f5a692d
Remove ADOC preview link (#17496) 2025-04-17 12:15:45 -04:00
João Duarte
005358ffb4
set major-version to "9.x" used only for the package installation section (#17562)
closes #17561
2025-04-17 17:13:50 +01:00
Victor Martinez
6646400637
mergify: support 8.19 and remove support 8.x (#17567) 2025-04-16 20:07:34 +02:00
Colleen McGinnis
47d430d4fb
Doc: Fix image paths for docs-assembler (#17566) 2025-04-16 09:46:48 -04:00
Cas Donoghue
49cf7acad0
Update logstash_releases.json after 8.17.5 (#17560)
* Update logstash_releases.json after 8.17.5

* Update 9.next  post 9.0.0 release

Co-authored-by: Mashhur <99575341+mashhurs@users.noreply.github.com>

---------

Co-authored-by: Mashhur <99575341+mashhurs@users.noreply.github.com>
2025-04-15 11:18:37 -07:00
Andrea Selva
dae2b61ab2
Update logstash_releases.json after 8.18.0 (#17506) 2025-04-15 12:02:11 +02:00
Yehor Shvedov
86042f8c98
New way of backporting to active branches using gh action (#17551) 2025-04-15 00:39:38 +03:00
George Wallace
2c95068e04
Update index.md (#17548) 2025-04-10 16:08:27 -04:00
Karen Metts
187c925cc8
Doc: Update installation info (#17532) 2025-04-09 17:04:17 -04:00
Cas Donoghue
8e6e183adc
Ensure elasticsearch logs and data dirs exist before startup (#17531)
With a recent change in ES https://github.com/elastic/elasticsearch/pull/125449
configuring path.data or path.logs to directories that do not exist cause ES to
not be able to start up. This commit ensures those directories exist. The
teardown script already ensures they are removed 712b37e1df/qa/integration/services/elasticsearch_teardown.sh (L26-L27)
2025-04-09 13:32:32 -07:00
Rye Biesemeyer
712b37e1df
setting: enforce non-nullable (restore 8.15.x behavior) (#17522) 2025-04-09 09:28:38 -07:00
João Duarte
815fa8be1c
updates to docker image template based on feedback (#17494)
* change base images to ubi9-minimal
* do all env2yaml related copying in 1 COPY
* use -trimpath in go build
* move other COPY to end of dockerfile
* don't run package manager upgrade
* FROM and AS with same case
* ENV x=y instead of ENV x y
* remove indirect config folder
2025-04-09 16:17:39 +01:00
Mashhur
b9bac5dfc6
[Monitoring LS] Recommends collecting metricsets to fully visualize metrics on dashboards. (#17479)
* Disabling some of metricsets may cause dashboards partially display some metrics. This change recommends collecting metricsets to fully visualize metrics on dashboards.

* Paraphrasing sentences and grammar correction.

Co-authored-by: Rob Bavey <rob.bavey@elastic.co>

* Update docs/reference/serverless-monitoring-with-elastic-agent.md

* Make recommendation as a tip.

---------

Co-authored-by: Rob Bavey <rob.bavey@elastic.co>
2025-04-08 15:03:53 -07:00
Dimitrios Liappis
b9469e0726
Fix JDK matrix pipeline after configurable it split (#17461)
PR #17219 introduced configurable split quantities for IT tests, which
resulted in broken JDK matrix pipelines (e.g. as seen via the elastic
internal link:
https://buildkite.com/elastic/logstash-linux-jdk-matrix-pipeline/builds/444

reporting the following error

```
  File "/buildkite/builds/bk-agent-prod-k8s-1743469287077752648/elastic/logstash-linux-jdk-matrix-pipeline/.buildkite/scripts/jdk-matrix-tests/generate-steps.py", line 263
    def integration_tests(self, part: int, parts: int) -> JobRetValues:
    ^^^
SyntaxError: invalid syntax
There was a problem rendering the pipeline steps.
Exiting now.
```
)

This commit fixes the above problem, which was already fixed in #17642, using a more
idiomatic way.

Co-authored-by: Andrea Selva <selva.andre@gmail.com>
2025-04-08 15:34:07 +03:00
Karen Metts
d66a2cf758
Release notes, deprecations, breaking for 9.0.0 (#17507) 2025-04-07 19:09:14 -04:00
Karen Metts
e13fcadad8
Doc: Incorporate field ref deep dive content (#17484)
Co-authored-by: Rob Bavey <rob.bavey@elastic.co>
2025-04-07 15:04:49 -04:00
Andrea Selva
cb4c234aee
Update uri gem required by Logstash (#17495) 2025-04-07 10:32:12 +02:00
kaisecheng
eeb2162ae4
pin cgi to 0.3.7 (#17487) 2025-04-03 18:34:58 +01:00
Mashhur
ae3b3ed17c
Remove tech preview from agent driven LS monitoring pages. (#17482)
* Remove tech preview from agent driven LS monitoring pages.

Co-authored-by: Rob Bavey <rob.bavey@elastic.co>
2025-04-02 10:43:42 -07:00
Rob Bavey
3c6cbbf35b
Breaking changes for 9.0 (#17380) 2025-04-01 23:19:30 -04:00
Rob Bavey
5a052b33f9
Fix standalone agent access for agent-driven monitoring (#17386)
* Fix standalone agent access for agent-driven monitoring

Change incorrect dedicated instructions, and base them on those from running Elastic Agent
in standalone mode.


---------

Co-authored-by: Karen Metts <35154725+karenzone@users.noreply.github.com>
2025-04-01 14:50:14 -04:00
Karen Metts
7913f91340
Doc: Move 9.0 pre-release notes to release notes (#17439) 2025-04-01 10:16:51 -04:00
João Duarte
5f5b4bb3c3
Fix persistent-queues.md PQ sizing multiplication factors #17451 (#17452)
closes #17431 for main/9.0 branches
2025-04-01 13:22:50 +01:00
Andrea Selva
422cd4e06b
Fix syntax in BK CI script (#17462) 2025-04-01 12:26:07 +02:00
Victor Martinez
26af21df85
ci(backport): remove former approach (#17347) 2025-03-31 17:45:31 +02:00
Victor Martinez
a539695830
github-actions: enable dependabot (#17421) 2025-03-30 10:06:18 +02:00
Mashhur
4b88773726
Do not pipe Git output into a pager. (#17442) 2025-03-28 10:56:39 -07:00
Colleen McGinnis
e5bebcea17
remove reliance on redirects (#17440) 2025-03-28 12:45:19 -05:00
Karen Metts
e2c6254c81
Doc: Remove plugin docs from logstash core (#17405)
Co-authored-by: Colleen McGinnis <colleen.mcginnis@elastic.co>
2025-03-27 11:02:45 -04:00
Karen Metts
add7b3f4d3
Doc: Upgrade content improvements (#17403)
* Change upgrade prereq from 8.17 to 8.18
2025-03-26 13:25:31 -04:00
Cas Donoghue
6de59f2c02
Pin rubocop-ast development gem due to new dep on prism (#17407)
The rubocop-ast gem just introduced a new dependency on prism.
 - https://rubygems.org/gems/rubocop-ast/versions/1.43.0

In our install default gem rake task we are seeing issues trying to build native
extensions. I see that in upstream jruby they are seeing a similar problem (at
least it is the same failure mode https://github.com/jruby/jruby/pull/8415

This commit pins rubocop-ast to 1.42.0 which is the last version that did not
have an explicit prism dependency.
2025-03-26 08:48:28 -07:00
Andrea Selva
075fdb4152
Limit memory consumption in test on overflow (#17373)
Updates only test code to be able to run a test that consumes big memory if:
- the physical memory is bigger than the requested Java heap
- JDK version is greater than or equal to 21.

The reason to limit the JDK version is that on 16GB machine the G1GC is more efficient than the one on previous JDKs and so let complete the test with 10GB heap, while in JDK 17 it consistently fails with OOM error.
2025-03-26 11:29:09 +01:00
Andrea Selva
6b277ccf0d
Update logstash_releases.json after 8.17.4 (#17396) 2025-03-26 09:50:25 +01:00
Andrea Selva
f76edcea5e
Update logstash_releases.json after 8.16.6 (#17394) 2025-03-26 09:01:27 +01:00
Rob Bavey
f705a9de48
Fix Elasticsearch output SSL settings (#17391)
Replace removed Elasticsearch output SSL settings with the latest values
2025-03-24 11:45:14 -04:00
Kaarina Tungseth
7ac0423de0
Updates navigation titles and descriptions for release notes (#17381) 2025-03-21 11:58:31 -05:00
Colleen McGinnis
284272b137
[docs] Miscellaneous docs clean up (#17372)
* remove unused substitutions
* move images
* validate build
2025-03-21 11:11:24 -04:00
Karen Metts
960d997e9f
Doc: Fix upgrade TOC structure (#17361) 2025-03-21 10:28:39 -04:00
Rye Biesemeyer
3e0f488df2
tests: make integration split quantity configurable (#17219)
* tests: make integration split quantity configurable

Refactors shared splitter bash function to take a list of files on stdin
and split into a configurable number of partitions, emitting only those from
the currently-selected partition to stdout.

Also refactors the only caller in the integration_tests launcher script to
accept an optional partition_count parameter (defaulting to `2` for backward-
compatibility), to provide the list of specs to the function's stdin, and to
output relevant information about the quantity of partition splits and which
was selected.

* ci: run integration tests in 3 parts
2025-03-19 16:37:27 -07:00
Yehor Shvedov
7683983168
Disable support of OpenJDK 17 (#17338) 2025-03-20 01:34:33 +02:00
Andrea Selva
afde43f918
Added test to verify the int overflow happen (#17353)
Use long instead of int type to keep the length of the first token.

The size limit validation requires to sum two integers, one with the length of the accumulated chars till now plus the next fragment head part. If any of the two sizes is close to the max integer it generates an overflow and could successfully fail the test 9c0e50faac/logstash-core/src/main/java/org/logstash/common/BufferedTokenizerExt.java (L123).

To fall in this case it's required that sizeLimit is bigger then 2^32 bytes (2GB) and data fragments without any line delimiter is pushed to the tokenizer with a total size close to 2^32 bytes.
2025-03-19 16:50:04 +01:00
Andrea Selva
9c0e50faac
Use org.logstash.common.Util to hashing by default to SHA256 (#17346)
Removes the usage fo Apache Commons Codec MessgeDigest to use internal Util class with embodies hashing methods.
2025-03-19 09:15:25 +01:00
Rye Biesemeyer
10b5a84f84
add ci shared qualified-version script (#17311)
* ci: add shareable script for generating qualified version

* ci: use shared script to generate qualified version
2025-03-18 15:41:33 -07:00
Andrea Selva
787fd2c62f
Removed unused configHash computation that can be replaced by PipelineConfig.configHash() (#17336)
Removed unused configHash computation happening in AbstractPipeline and used only in tests replaced by PipelineConfig.configHash() invocation
2025-03-18 08:58:24 +01:00
Karen Metts
193af6a272
Doc: Refine new MD docs (WIP) (#17325) 2025-03-17 17:14:40 -04:00
Mashhur
8d10baa957
Internal collection doc update to reflect enabling legacy collection. (#17326) 2025-03-14 14:50:42 -07:00
Karen Metts
ea99e1db58
Doc: Update TOC order in API docs (#17324) 2025-03-14 15:47:16 -04:00
kaisecheng
4779d5e250
[Doc] OpenAPI spec (#17292)
This commit migrated API doc to OpenAPI spec

- expand Node Info `/_node/<types>`
- expand Node Stats 
- add health report 
- break down the share part to components
- add examples
- update authentication

Co-authored-by: Lisa Cawley <lcawley@elastic.co>
2025-03-14 17:31:39 +00:00
Cas Donoghue
964468f922
Require shellwords in artifact rake task (#17319)
The https://github.com/elastic/logstash/pull/17310 PR changed the rake task for
artifact creation to use shellwords from standard library. The acceptance tests
need to explitily load that library. This commit updates the rake file to handle
loading the required code.
2025-03-13 18:38:52 -07:00