github-mirrors/logstash
1
0
Fork 0
mirror of https://github.com/elastic/logstash.git synced 2025-04-24 22:57:16 -04:00
Code Issues Projects Releases Packages Wiki Activity
logstash/docs/static/releasenotes.asciidoc
Rob Bavey 448c9c6533 7.6.2 Release notes 
Fixes #11705
2020-03-30 19:08:31 +00:00

1178 lines
No EOL
71 KiB
Text
Raw Blame History

[[releasenotes]]
== Release Notes
This section summarizes the changes in the following releases:
* <<logstash-7-6-2,Logstash 7.6.2>>
* <<logstash-7-6-1,Logstash 7.6.1>>
* <<logstash-7-6-0,Logstash 7.6.0>>
* <<logstash-7-5-2,Logstash 7.5.2>>
* <<logstash-7-5-1,Logstash 7.5.1>>
* <<logstash-7-5-0,Logstash 7.5.0>>
* <<logstash-7-4-2,Logstash 7.4.2>>
* <<logstash-7-4-1,Logstash 7.4.1>>
* <<logstash-7-4-0,Logstash 7.4.0>>
* <<logstash-7-3-2,Logstash 7.3.2>>
* <<logstash-7-3-1,Logstash 7.3.1>>
* <<logstash-7-3-0,Logstash 7.3.0>>
* <<logstash-7-2-1,Logstash 7.2.1>>
* <<logstash-7-2-0,Logstash 7.2.0>>
* <<logstash-7-1-1,Logstash 7.1.1>>
* <<logstash-7-1-0,Logstash 7.1.0>>
* <<logstash-7-0-1,Logstash 7.0.1>>
* <<logstash-7-0-0,Logstash 7.0.0>>
* <<logstash-7-0-0-rc2,Logstash 7.0.0-rc2>>
* <<logstash-7-0-0-rc1,Logstash 7.0.0-rc1>>
* <<logstash-7-0-0-beta1,Logstash 7.0.0-beta1>>
* <<logstash-7-0-0-alpha2,Logstash 7.0.0-alpha2>>
* <<logstash-7-0-0-alpha1,Logstash 7.0.0-alpha1>>
[[logstash-7-6-2]]
=== Logstash 7.6.2 Release Notes
* Fixed: Support for quoted plugin option key. The Java execution engine had a regression where adding quotes
around plugin configuration keys would stop the pipeline from starting. https://github.com/elastic/logstash/pull/11694[#11694]
* Fixed: Issue where users were not able to start pipeline when a configuration file was completely commented out. https://github.com/elastic/logstash/pull/11615[#11615]
* Fixed: Typo in gauge metric of unknown type log. https://github.com/elastic/logstash/pull/11689[#11689]
* Fixed: Issue where using command line `--help` option was showing wrong information. https://github.com/elastic/logstash/pull/11634[#11634]
* [Doc] Backport more references to contributing issues guidelines. https://github.com/elastic/logstash/pull/11666[#11666]
* [Doc] Add tips for troubleshooting a pipeline. https://github.com/elastic/logstash/pull/11545[#11545]
* [Doc] Update to include verification mode switch. https://github.com/elastic/logstash/pull/11284[#11284]
* [Doc] Updates security API examples https://github.com/elastic/logstash/pull/10752[#10752]
* [Doc] Update logging.asciidoc to emphasize that logging to console is included in out-of-the-box settings. https://github.com/elastic/logstash/pull/10717[#10717]
* [Doc] Update offline-plugins.asciidoc to use correct command syntax. https://github.com/elastic/logstash/pull/10912[#10912]
* Bump puma to 4.3.3. https://github.com/elastic/logstash/pull/11651[#11651]
==== Plugins
*Beats Input*
* Fixed issue where calling `java_import` on `org.logstash.netty.SslContextBuilder` was causing the TCP input to pick up the wrong SslContextBuilder class
potentially causing pipeline creation to fail https://github.com/logstash-plugins/logstash-input-beats/pull/388[#388]
*Http Input*
* Refactor: scope (and avoid unused) java imports https://github.com/logstash-plugins/logstash-input-http/pull/124[#124]
*Redis Input*
* [DOC] Reordered config option to alpha order https://github.com/logstash-plugins/logstash-input-redis/issues/79[#79]
*Snmp Input*
* Refactor: scope and review java_imports https://github.com/logstash-plugins/logstash-input-snmp/pull/72[#72]
*Tcp Input*
* Refactor: scope java_import to avoid polluting https://github.com/logstash-plugins/logstash-input-tcp/pull/152[#152]
*Kafka Integration*
* Fix links in changelog pointing to stand-alone plugin changelogs. https://github.com/logstash-plugins/logstash-integration-kafka/pull/18[#18]
* Refactor: scope java_import to plugin class https://github.com/logstash-plugins/logstash-integration-kafka/pull/18[#18]
*Rabbitmq Integration*
* Refactor: scope (and remove unused) java imports https://github.com/logstash-plugins/logstash-integration-rabbitmq/pull/29[#29]
*Elasticsearch Output*
* [DOC] Replaced link to Elastic Cloud trial with attribute, and fixed a comma splice https://github.com/logstash-plugins/logstash-output-elasticsearch/pull/926[#926]
* [DOC] Replaced setting name with correct value https://github.com/logstash-plugins/logstash-output-elasticsearch/pull/919[#919]
* Fixed integration tests for Elasticsearch 7.6+ https://github.com/logstash-plugins/logstash-output-elasticsearch/pull/922[#922]
* Fixed integration tests for Elasticsearch API `7.5.0` https://github.com/logstash-plugins/logstash-output-elasticsearch/pull/923[#923]
[[logstash-7-6-1]]
=== Logstash 7.6.1 Release Notes
* [DOC] Rework ls netflow module deprecation notice https://github.com/elastic/logstash/pull/11600[#11600]
* [DOC] Clarify internal collectors deprecation status for 7.6 https://github.com/elastic/logstash/pull/11607[#11607]
* [DOC] Fix setting name for monitoring https://github.com/elastic/logstash/pull/11597[#11597]
* [DOC] Add Apple notarization info https://github.com/elastic/logstash/pull/11588[#11588]
==== Plugins
*Dns Filter*
* Replaced Timeout::timeout block with `Resolv::DNS::timeouts=` https://github.com/logstash-plugins/logstash-filter-dns/pull/62[#62]
* Added restriction for ruby version > 2.0, effectively making Logstash 6.x+ a requirement https://github.com/logstash-plugins/logstash-filter-dns/pull/62[#62]
*Memcached Filter*
* Fixed issue with ttl not being set https://github.com/logstash-plugins/logstash-filter-memcached/pull/13[#13]
*Split Filter*
* Fixed issue where @target optimization would stop event.remove(@field) from being called, which can be expensive with large split fields. https://github.com/logstash-plugins/logstash-filter-split/pull/40[#40]
*Beats Input*
* Fixed issue where an SslContext was unnecessarily being created for each connection https://github.com/logstash-plugins/logstash-input-beats/pull/383[#383]
* Fixed issue where `end` was not being called when an Inflater was closed https://github.com/logstash-plugins/logstash-input-beats/pull/383[#383]
* Downgraded netty to 4.1.34 due to an issue in IdleStateHandler https://github.com/logstash-plugins/logstash-input-beats/pull/380[#380]
*File Input*
* Added configuration setting exit_after_read to read to EOF and terminate the input https://github.com/logstash-plugins/logstash-input-file/pull/240[#240]
* Fixed bug in conversion of sincedb_clean_after setting https://github.com/logstash-plugins/logstash-input-file/pull/257[#257]
* Fixed bug in delete of multiple watched files https://github.com/logstash-plugins/logstash-input-file/pull/254[#254]
* Fixed sinceDB to work spaces filename https://github.com/logstash-plugins/logstash-input-file/pull/249[#249]
*Jdbc Integration*
* Fixed tracking_column regression with Postgresql Numeric types https://github.com/logstash-plugins/logstash-integration-jdbc/pull/17[#17]
* Fixed driver loading when file not accessible https://github.com/logstash-plugins/logstash-integration-jdbc/pull/15[#15]
*Elasticsearch Output*
* Fix: handle proxy => '' as if none was set https://github.com/logstash-plugins/logstash-output-elasticsearch/pull/912[#912]
[[logstash-7-6-0]]
=== Logstash 7.6.0 Release Notes
* Feature: Introduce deprecation logger for internal classes and plugins. https://github.com/elastic/logstash/pull/11260[#11260] and https://github.com/elastic/logstash/pull/11486[#11486]
** The Deprecation logger is a unified way for Logstash components to log deprecation notices into a separate file,
located by default at `log/logstash-deprecation.log`. This file gives users a single location to see if they are using features that may stop working after a major upgrade.
* Feature: Add support for cloud-id/auth for Logstash monitoring/management https://github.com/elastic/logstash/pull/11496[#11496]
* Feature: Initial release of the https://github.com/logstash-plugins/logstash-integration-jdbc[Jdbc Integration Plugin],
which combines previously-separate Jdbc plugins and shared dependencies into a single codebase
* Fixed: Regression where compilation of multiple pipelines experiences slowdown https://github.com/elastic/logstash/issues/11560[#11560]
** The fix for the Java execution pipeline compilation slowdown relative to the number of workers in https://github.com/elastic/logstash/issues/11482[#11482]
introduced a regression which caused a slowdown of pipeline compilation when using multiple pipelines. This
fix solves that regression and the original issue when using multiple workers.
* Updated puma to 4.x https://github.com/elastic/logstash/pull/11241[#11241]
* Updated jruby to 9.2.9.0 https://github.com/elastic/logstash/pull/11281[#11281]
* Fixed: Correct directory for versions.yml file when building plugins https://github.com/elastic/logstash/pull/11318[#11318]
This fixes an issue where a `versions.yml` was unnecessarily required when trying to build native Java plugins
* Updated sinatra and rack to 2.x https://github.com/elastic/logstash/pull/11354[#11354]
* Changed: base JRUBY_OPTS to default to --dev (for 'fast' scripts) https://github.com/elastic/logstash/pull/11355[#11355]
* Fixed: Removed use of deprecated Thread.exclusive method, which caused a warning message every time logstash started. https://github.com/elastic/logstash/pull/11388[#11388]
* Add Enterprise license level https://www.elastic.co/subscriptions[subscription] https://github.com/elastic/logstash/pull/11407[#11407]
* [DOC] Remove module-only disclaimer for cloud id https://github.com/elastic/logstash/pull/11469[#11469]
* [DOC] Add details about pipeline.workers https://github.com/elastic/logstash/pull/11474[#11474]
* [DOC] Add deprecation notice to internal collectors for monitoring https://github.com/elastic/logstash/pull/11526[#11526]
* Build: Fail license report job on missing licenses https://github.com/elastic/logstash/pull/11554[#11554]
* Fixed: Updated log4j2.properties file that the Docker container image uses to also log the pipeline.id. https://github.com/elastic/logstash/pull/11567[#11567]
==== Plugins
*Jdbc Integration*
* Initial release of the
https://github.com/logstash-plugins/logstash-integration-jdbc[Jdbc
Integration Plugin], which combines previously-separate Jdbc plugins and shared
dependencies into a single codebase
*Cef Codec*
* Fixed CEF short to long name translation for ahost/agentHostName field, according to documentation https://github.com/logstash-plugins/logstash-codec-cef/pull/75[#75]
*Fluent Codec*
* Handle EventTime msgpack extension to handle nanosecond precision time and add its parameter https://github.com/logstash-plugins/logstash-codec-fluent/pull/18[#18]
*Dns Filter*
* Fixed an issue where each missed lookup could result in unreclaimed memory (https://github.com/jruby/jruby/issues/6015[jruby bug]) by handling lookup misses without raising exceptions https://github.com/logstash-plugins/logstash-filter-dns/pull/61[#61]
* Added restriction on JRuby resolv.rb patch to versions prior to 9.2.9.0 https://github.com/logstash-plugins/logstash-filter-dns/pull/58[#58]
* Fixed asciidoc formatting for unordered list and a code sample in docs https://github.com/logstash-plugins/logstash-filter-dns/pull/57[#57]
* Added search domains to the `nameserver` option https://github.com/logstash-plugins/logstash-filter-dns/pull/56[#56]
*Elasticsearch Filter*
* Feat: support cloud_id / cloud_auth configuration https://github.com/logstash-plugins/logstash-filter-elasticsearch/pull/122[#122]
*Beats Input*
* Updated Jackson dependencies
*Elasticsearch Input*
* Feat: Added support for cloud_id / cloud_auth configuration https://github.com/logstash-plugins/logstash-input-elasticsearch/pull/112[#112]
* Changed Elasticsearch Client transport to use Manticore https://github.com/logstash-plugins/logstash-input-elasticsearch/pull/111[#111]
*File Input*
* Fix regression in `exclude` handling. Patterns are matched against the filename, not full path.
https://github.com/logstash-plugins/logstash-input-file/issues/237[#237]
*Http Input*
* Revert updates to netty and tcnative since CBC ciphers are still used in many contexts
*Csv Output*
* Docs: Correct typos https://github.com/logstash-plugins/logstash-output-csv/pull/19[#19]
* Docs: Fix formatting after code sample https://github.com/logstash-plugins/logstash-output-csv/pull/22[#22]
*Elasticsearch Output*
* Feat: Added support for cloud_id and cloud_auth https://github.com/logstash-plugins/logstash-output-elasticsearch/pull/906[#906]
*S3 Output*
* Added ability to specify https://aws.amazon.com/s3/storage-classes/#__[ONEZONE_IA] as storage_class
*Udp Output*
* Fixed plugin crash upon socket write exception https://github.com/logstash-plugins/logstash-output-udp/pull/10[#10]
* Added support for the 'retry_count' and 'retry_backoff_ms' options https://github.com/logstash-plugins/logstash-output-udp/pull/12[#12]
[[logstash-7-5-2]]
=== Logstash 7.5.2 Release Notes
* Fix: Java Execution - Improve Logstash start-time by moving class caching from ComputeStepSyntaxElement to CompiledPipeline https://github.com/elastic/logstash/pull/11490[#11490]
* Fix: Java Execution - Avoid starting inputs when filters and output compilation is not complete, by starting only when all WorkerLoops are fully initialized https://github.com/elastic/logstash/pull/11492[#11492]
* Fix: Avoid issue with `nil` native threads by making get_thread_id "nil safe" https://github.com/elastic/logstash/pull/11458[#11458]
* Update JrJackson and jackson dependencies https://github.com/elastic/logstash/pull/11478[#11478]
==== Plugins
*Beats Input*
* Updated Netty dependencies, and removed support for insecure CBC ciphers https://github.com/logstash-plugins/logstash-input-beats/pull/376[#376]
* Updated Jackson dependencies https://github.com/logstash-plugins/logstash-input-beats/pull/375[#375]
*File Input*
* Fix: Regression in `exclude` handling. Patterns are matched against the filename, not full path.
https://github.com/logstash-plugins/logstash-input-file/issues/237[#237]
[[logstash-7-5-1]]
=== Logstash 7.5.1 Release Notes
* Improved usefullness of log messages when reporting full DLQ by including the relevant DLQ's path https://github.com/elastic/logstash/pull/11280[#11280]
* Fix: eliminates a crash that could occur at pipeline startup when the pipeline references a java-based plugin that had been installed via offline plugin pack https://github.com/elastic/logstash/pull/11340[#11340]
* Fix: The common `remove_field` plugin option now correctly works on `@metadata` fields https://github.com/elastic/logstash/pull/11342[#11342]
* Fix: do not leak ThreadContext into the system https://github.com/elastic/logstash/pull/11356[#11356]
* Fix: eliminates a regression introduced in 7.2.0 where streaming-oriented inputs configured with payload-oriented codecs (`plain` or `json`) would use them as-is instead of using the appropriate line-oriented codec implementation (`lines` or `json_lines`, respectively) https://github.com/elastic/logstash/pull/11401[#11401]
* Fix: handle cloud-id with an empty kibana part https://github.com/elastic/logstash/pull/11435[#11435]
* bump dependencies for patch release https://github.com/elastic/logstash/pull/11438[#11438]
==== Plugins
*Dns Filter*
* Added documentation on the `nameserver` option for relying on `/etc/resolv.conf` to configure the resolver
*Elasticsearch Filter*
* Loosen restrictions on Elasticsearch gem https://github.com/logstash-plugins/logstash-filter-elasticsearch/pull/120[#120]
*Grok Filter*
* Improved grok filter performance in multi-match scenarios. If you've noticed
some slowdown in grok and you're using many more workers than cores, this update
allows you to configure the
https://github.com/logstash-plugins/logstash-filter-grok/blob/master/docs/index.asciidoc#timeout_scope[timeout_scope
setting] to improve performance. https://github.com/logstash-plugins/logstash-filter-grok/pull/153[#153]
*Jdbc_static Filter*
* Fixed issue with driver verification using Java 11 https://github.com/logstash-plugins/logstash-filter-jdbc_static/pull/51[#51]
*Jdbc_streaming Filter*
* Fixed driver loading https://github.com/logstash-plugins/logstash-filter-jdbc_streaming/pull/35[#35]
* Added support for prepared statements https://github.com/logstash-plugins/logstash-filter-jdbc_streaming/pull/32[#32]
* Added support for `sequel_opts` to pass options to the 3rd party Sequel library.
* Added support for driver loading in JDK 9+ https://github.com/logstash-plugins/logstash-filter-jdbc_streaming/issues/25[#25]
* Added support for multiple driver jars https://github.com/logstash-plugins/logstash-filter-jdbc_streaming/issues/21[#21]
*Elasticsearch Input*
* Loosen restrictions on Elasticsearch gem https://github.com/logstash-plugins/logstash-input-elasticsearch/pull/110[#110]
*Http Input*
* Update netty and tcnative dependency https://github.com/logstash-plugins/logstash-input-http/issues/118[#118]
* Added 201 to valid response codes https://github.com/logstash-plugins/logstash-input-http/issues/114[#114]
* Documented response\_code option
*Jdbc Input*
* Fixed issue where paging settings in configuration were not being honored https://github.com/logstash-plugins/logstash-input-jdbc/pull/361[#361]
* Fix issue with driver loading https://github.com/logstash-plugins/logstash-input-jdbc/pull/356[#356]
* Added documentation to provide more info about jdbc driver loading https://github.com/logstash-plugins/logstash-input-jdbc/pull/352[#352]
*Jms Input*
* Docs: Added additional troubleshooting information https://github.com/logstash-plugins/logstash-input-jms/pull/38[#38]
*Rabbitmq Integration*
* Fixes issue in Output where failure to register connection recovery hooks prevented the output from starting
* Improves Input Plugin documentation to better align with upstream guidance https://github.com/logstash-plugins/logstash-integration-rabbitmq/pull/4[#4]
*Elasticsearch Output*
* Opened type removal logic for extension. This allows X-Pack Elasticsearch output to continue using types for special case `/_monitoring` bulk endpoint, enabling a fix for Logstash #11312. https://github.com/logstash-plugins/logstash-output-elasticsearch/pull/900[#900]
* Fixed 8.x type removal compatibility issue https://github.com/logstash-plugins/logstash-output-elasticsearch/pull/892[#892]
[[logstash-7-5-0]]
=== Logstash 7.5.0 Release Notes
* Give multiple pipelines all the settings https://github.com/elastic/logstash/pull/11076[#11076]
* Support substitutions in pipelines.yml file https://github.com/elastic/logstash/pull/11081[#11081]
* Provide log appender per pipeline https://github.com/elastic/logstash/pull/11108[#11108]
* Use 2048 bits key in OpenSSL socket specs https://github.com/elastic/logstash/pull/11115[#11115]
* Add origins of pipeline configurations https://github.com/elastic/logstash/pull/11123[#11123]
* Remove 10k character truncation from log4j2.properties https://github.com/elastic/logstash/pull/11206[#11206]
* Remove from system properties if Java runtime is less than 11 https://github.com/elastic/logstash/pull/11225[#11225] to
fix https://github.com/elastic/logstash/issues/11221[#11221]
* [DOC] Add metricbeat as a monitoring option https://github.com/elastic/logstash/issues/11190[#11190]
==== Plugins
*Kafka Integration*
* Initial release of the
https://github.com/logstash-plugins/logstash-integration-kafka[Kafka
Integration Plugin], which combines previously-separate Kafka plugins and shared
dependencies into a single codebase
*Rabbitmq Integration*
* Initial release of the
https://github.com/logstash-plugins/logstash-integration-rabbitmq[RabbitMQ
Integration Plugin], which combines previously-separate RabbitMQ plugins and
shared dependencies into a single codebase
*Elasticsearch Output*
* Fixed wording and corrected option in documentation https://github.com/logstash-plugins/logstash-output-elasticsearch/pull/881[#881] https://github.com/logstash-plugins/logstash-output-elasticsearch/pull/883[#883]
* Deprecation: Added warning about connecting a default Distribution of Logstash with an OSS version of ES https://github.com/logstash-plugins/logstash-output-elasticsearch/pull/875[#875]
* Added template for connecting to ES 8.x https://github.com/logstash-plugins/logstash-output-elasticsearch/pull/871[#871]
* Added sniffing support for ES 8.x https://github.com/logstash-plugins/logstash-output-elasticsearch/pull/878[#878]
[[logstash-7-4-2]]
=== Logstash 7.4.2 Release Notes
No user facing changes in this release.
[[logstash-7-4-1]]
=== Logstash 7.4.1 Release Notes
* Update patch plugin versions in gemfile lock for 7.4.1 https://github.com/elastic/logstash/pull/11181[#11181]
* Update JrJackson to 0.4.10 https://github.com/elastic/logstash/pull/11184[#11184]
* Remove 10k character truncation from log4j2.properties https://github.com/elastic/logstash/pull/11206[#11206]
* [DOCS] replace unicode non-breaking hyphen U+8211 with ASCII hyphen https://github.com/elastic/logstash/pull/11217[#11217]
* [DOCS] Clarify monitoring hosts should not be master-only https://github.com/elastic/logstash/pull/11194[#11194]
* [DOCS] Add metricbeat as monitoring option https://github.com/elastic/logstash/pull/11191[#11191]
==== Plugins
*Cef Codec*
* Fixed support for deep dot notation https://github.com/logstash-plugins/logstash-codec-cef/pull/73[#73]
*Aggregate Filter*
* bugfix: fix inactivity timeout feature when processing old logs (PR https://github.com/logstash-plugins/logstash-filter-aggregate/pull/103[#103], thanks @jdratlif for his contribution!)
* docs: fix several typos in documentation
* docs: enhance example 4 documentation
* ci: enhance plugin continuous integration
*Cidr Filter*
* Support string arrays in network setting https://github.com/logstash-plugins/logstash-filter-cidr/pull/21[#21]
*Prune Filter*
* Fixed regex to prevent Exception in sprintf call https://github.com/logstash-plugins/logstash-filter-prune/pull/25[#25]
* Changed testing to docker https://github.com/logstash-plugins/logstash-filter-prune/pull/27[#27]
*Beats Input*
* Fixed configuration example in doc https://github.com/logstash-plugins/logstash-input-beats/pull/371[#371]
* Improved handling of invalid compressed content https://github.com/logstash-plugins/logstash-input-beats/pull/368[#368]
*Exec Input*
* Docs: improved doc on memory usage https://github.com/logstash-plugins/logstash-input-exec/pull/27[#27]
*File Input*
* Fixed link to FAQ https://github.com/logstash-plugins/logstash-input-file/pull/247[#247]
*Imap Input*
* Added facility to use IMAP uid to retrieve new mails instead of "NOT SEEN" https://github.com/logstash-plugins/logstash-input-imap/pull/36[#36]
*Jdbc Input*
* Add support for prepared statements https://github.com/logstash-plugins/logstash-input-jdbc/issues/233[#233]
* Use atomic booleam to load drivers once
* Added support for driver loading in JDK 9+ https://github.com/logstash-plugins/logstash-input-jdbc/issues/331[#331]
[[logstash-7-4-0]]
=== Logstash 7.4.0 Release Notes
* Improved logging of version mismatch in DLQ file reader (RecordIOReader) https://github.com/elastic/logstash/pull/11039[#11039]
* Update jruby to 9.2.8.0 https://github.com/elastic/logstash/pull/11041[#11041]
* Integration test for Java plugins https://github.com/elastic/logstash/pull/11054[#11054]
* Use correct execution engine for test-and-exit mode https://github.com/elastic/logstash/pull/11067[#11067]
* Support substitutions in pipelines.yml file https://github.com/elastic/logstash/pull/11081[#11081]
* Do not write generated Java files to disk unless debug flag is set https://github.com/elastic/logstash/pull/11082[#11082]
* Add pipeline.id to log lines https://github.com/elastic/logstash/pull/11087[#11087]
* Prepare 7.4 branch for 7.4.0 https://github.com/elastic/logstash/pull/11092[#11092]
* Update minor plugin versions in gemfile lock for 7.4 https://github.com/elastic/logstash/pull/11096[#11096]
* Use 2048 bits key in OpenSSL socket specs https://github.com/elastic/logstash/pull/11115[#11115]
* Remove mention of pipeline to pipeline being Beta https://github.com/elastic/logstash/pull/11150[#11150]
* Backport release notes to 7.4 branch https://github.com/elastic/logstash/pull/11159[#11159]
* Docs: Fix backticks in how to docs https://github.com/elastic/logstash/pull/11018[#11018]
NOTICE: {ls} Netflow module has been deprecated and replaced by the
{filebeat-ref}/filebeat-module-netflow.html[{Filebeat} Netflow Module] which is
compliant with the {ecs-ref}/index.html[Elastic Common Schema (ECS)]
https://github.com/elastic/logstash/pull/11113[#11113]
==== Plugins
*Geoip Filter*
* Fixed docs for missing region_code https://github.com/logstash-plugins/logstash-filter-geoip/pull/158[#158]
* Update of GeoLite2 DB https://github.com/logstash-plugins/logstash-filter-geoip/pull/157[#157]
*Beats Input*
* Updated Jackson dependencies https://github.com/logstash-plugins/logstash-input-beats/pull/366[#366]
*Gelf Input*
* Updated library to gelfd2 https://github.com/logstash-plugins/logstash-input-gelf/pull/48[#48]
*Kafka Input*
* Updated Kafka client version to 2.3.0
*Redis Input*
* Updated redis client dependency to ~> 4
* Changed `redis_type` to `data_type` in .rb file https://github.com/logstash-plugins/logstash-input-redis/issues/70[#70] and asciidoc file https://github.com/logstash-plugins/logstash-input-redis/issues/71[#71]
* Added support for renamed redis commands https://github.com/logstash-plugins/logstash-input-redis/issues/29[#29]
* Add channel to the event https://github.com/logstash-plugins/logstash-input-redis/issues/46[#46]
* Add support for SSL https://github.com/logstash-plugins/logstash-input-redis/issues/61[#61]
* Add support for Redis unix sockets https://github.com/logstash-plugins/logstash-input-redis/issues/64[#64]
*Kafka Output*
* Updated kafka client to version 2.3.0
*S3 Output*
* Added clarification for endpoint in documentation https://github.com/logstash-plugins/logstash-output-s3/pull/198[#198]
[[logstash-7-3-2]]
=== Logstash 7.3.2 Release Notes
* Bugfix: Avoid variable collision in pipeline stats api (backport of #11059 to 7.x) https://github.com/elastic/logstash/pull/11062[#11062]
* Bugfix: Give multiple pipelines all the settings https://github.com/elastic/logstash/pull/11076[#11076]
* Docs: Hint plugins need to be installed before bundle https://github.com/elastic/logstash/pull/11080[#11080]
* Docs: Fix backticks in how to docs https://github.com/elastic/logstash/pull/11018[#11018]
* Docs: Update link to Debugging Java Performance https://github.com/elastic/logstash/pull/11084[#11084]
* Docs: Add missing "create" privilege to documentation https://github.com/elastic/logstash/pull/11013[#11013]
* Tests: Use 2048 bits key in OpenSSL socket specs https://github.com/elastic/logstash/pull/11115[#11115]
[[logstash-7-3-1]]
=== Logstash 7.3.1 Release Notes
* Add regex support for conditionals with constants https://github.com/elastic/logstash/pull/11017[#11017]
* Fix compilation of "[field] in [field]" event conditions https://github.com/elastic/logstash/pull/11026[#11026]
* Add support for boolean evaluation of constants https://github.com/elastic/logstash/pull/11032[#11032]
==== Plugins
*Snmp Input*
* Fixed GAUGE32 integer overflow https://github.com/logstash-plugins/logstash-input-snmp/pull/65[#65]
[[logstash-7-3-0]]
=== Logstash 7.3.0 Release Notes
* Fixes a crash that could occur when an illegal field reference was used as part of a field key https://github.com/elastic/logstash/pull/10839[#10839]
* Fixes a stall that could occur when using the Beta Pipeline-to-Pipeline feature by ensuring that a Pipeline Input will not shut down before its upstream pipeline https://github.com/elastic/logstash/pull/10872[#10872]
* Fixes an issue during shutdown where the API could shut down before the pipelines have completed shutting down https://github.com/elastic/logstash/pull/10880[#10880]
* Fixes an issue where the bundled plugins built on the Java Plugin API would fail to load on Java 11 https://github.com/elastic/logstash/pull/10951[#10951]
* Fixes an issue where runaway matchers inside KV and Grok Filter Plugins could fail to respect configured timeouts https://github.com/elastic/logstash/pull/10978[#10978]
* Enhanced `GET _node/stats/pipelines` API for Metricbeat monitoring https://github.com/elastic/logstash/pull/10576[#10576]
* Enhanced `GET /` API to include `workers` and `batch_size` metadata https://github.com/elastic/logstash/pull/10853[#10853]
* Added Plain codec for Java https://github.com/elastic/logstash/pull/10791[#10791]
* Added JMS Input Plugin to the list of default plugins https://github.com/elastic/logstash/pull/10865[#10865]
==== Plugins
*Grok Filter*
* Changed timeout handling using the Timeout class, resolving an issue where Logstash would fail to enforce timeouts https://github.com/logstash-plugins/logstash-filter-grok/pull/147[#147]
*Http Filter*
*Jdbc_streaming Filter*
* Fixed formatting in documentation https://github.com/logstash-plugins/logstash-filter-jdbc_streaming/pull/17[#17] and https://github.com/logstash-plugins/logstash-filter-jdbc_streaming/pull/28[#28]
*Json Filter*
* Added better error handling, preventing some classes of malformed inputs from crashing the pipeline.
*Kv Filter*
* Changed timeout handling using the Timeout class, resolving an issue where Logstash would fail to enforce timeouts https://github.com/logstash-plugins/logstash-filter-kv/pull/84[#84]
* Fixed asciidoc formatting in docs
* Resolved potential race condition in pipeline shutdown where the timeout enforcer could be shut down while work was still in-flight, potentially leading to stuck pipelines.
* Resolved potential race condition in pipeline shutdown where work could be submitted to the timeout enforcer after it had been shutdown, potentially leading to stuck pipelines.
*Memcached Filter*
* Fixed link formatting issues in doc https://github.com/logstash-plugins/logstash-filter-memcached/pull/16[#16]
*Mutate Filter*
*Useragent Filter*
* Added support for OS regular expressions that use backreferences https://github.com/logstash-plugins/logstash-filter-useragent/pull/59[#59]
*Azure_event_hubs Input*
* Added workaround to fix errors when using this plugin with Java 11 https://github.com/logstash-plugins/logstash-input-azure_event_hubs/pull/38[#38]
*Kafka Input*
* Added support for `sasl_jaas_config` setting to allow JAAS config per plugin, rather than per JVM https://github.com/logstash-plugins/logstash-input-kafka/pull/313[#313]
*Jms Input*
* The JMS Input is now a default plugin distributed with Logstash
*Snmp Input*
* Adding oid_path_length config option https://github.com/logstash-plugins/logstash-input-snmp/pull/59[#59]
* Fixing bug with table support removing index value from OIDs https://github.com/logstash-plugins/logstash-input-snmp/issues/60[#60]
* Added information and other improvements to documentation https://github.com/logstash-plugins/logstash-input-snmp/pull/57[#57]
*Tcp Input*
* Skip empty lines while reading certificate files https://github.com/logstash-plugins/logstash-input-tcp/issues/144[#144]
*Twitter Input*
* Updated Twitter gem to v6.2.0, cleaned up obsolete monkey patches, fixed integration tests https://github.com/logstash-plugins/logstash-input-twitter/pull/63[#63]
*Elastic_app_search Output*
*Kafka Output*
* Added support for `sasl_jaas_config` setting to allow JAAS config per plugin, rather than per JVM https://github.com/logstash-plugins/logstash-output-kafka/pull/223[#223]
[[logstash-7-2-1]]
=== Logstash 7.2.1 Release Notes
* Changed: Make sure joni regexp interruptability is enabled Fixes https://github.com/elastic/logstash/pull/10978[#10978]
* Fixed: Java core plugin support for Java 11 https://github.com/elastic/logstash/pull/10951[#10951]
* Updated: Jinja2 docker dependency https://github.com/elastic/logstash/pull/10986[#10986]
* Fixed: pipeline to pipeline shutdown ordering https://github.com/elastic/logstash/pull/10872[#10872]
* Changed: Do not shut down API webserver until after pipelines have been shut down https://github.com/elastic/logstash/pull/10880[#10880]
* Documentation: documentation for java plugins:
** Add java example plugins to skiplist https://github.com/elastic/logstash/pull/10921[#10921]
** docs for Java plain codec https://github.com/elastic/logstash/pull/10870[#10870]
** docs for Java line codec https://github.com/elastic/logstash/pull/10869[#10869]
** docs for java dots codec https://github.com/elastic/logstash/pull/10868[#10868]
** docs for Java sink output https://github.com/elastic/logstash/pull/10867[#10867]
** docs for java stdout output https://github.com/elastic/logstash/pull/10866[#10866]
** docs for the Java UUID filter https://github.com/elastic/logstash/pull/10859[#10859]
** docs for java stdin input https://github.com/elastic/logstash/pull/10858[#10858]
** docs for java_generator input https://github.com/elastic/logstash/pull/10857[#10857]
* Documentation: Remove gcs output from skip list https://github.com/elastic/logstash/pull/10919[#10919]
* Documentation: Remove the beta designation from the docs for Java plugins https://github.com/elastic/logstash/pull/10891[#10891]
* Documentation: Add homebrew as installation option https://github.com/elastic/logstash/pull/10874[#10874]
* Documentation: Running Logstash on Windows https://github.com/elastic/logstash/pull/10805[#10805]
[[logstash-7-2-0]]
=== Logstash 7.2.0 Release Notes
* Native support for Java Plugins (GA) https://github.com/elastic/logstash/pull/10620[#10620]. Changes to Java plugins for GA include:
** BREAKING: The signature for the codec.encode() method was changed to make the codec API easier to use correctly in pipelines with multiple concurrent workers.
** BREAKING: The return type on the Context::getDlqWriter method was changed to an interface to decouple it from any specific DLQ implementation.
** BETA: Isolated classloader for Java plugins. When enabled with the pipeline.plugin_classloaders flag, each Java plugin will be loaded with its own parent-last classloader. All dependencies for the Java plugin, with the exception of any classes in org.logstash.* or co.elastic.logstash.* packages, will be loaded first from the plugin's jar file delegating to the main Logstash classloader only if the dependency is not found within the plugin's jar. This allows Java plugins to use dependencies that might clash with the dependencies for other Java plugins or Logstash core itself.
** Gradle tasks to automate the packaging of Java plugins as Ruby gems. The gem task will bootstrap all JRuby dependencies, automatically generate Gemfile and the gemspec file for the plugin as well as the two "glue" Ruby source files for triggering the loading of the Java class files during Logstash startup, and then invoke the necessary commands to create the gem file itself. The gem task also performs a number of validation checks to proactively identify common problems with the packaging of Java plugins. The clean task will remove all of those generated artifacts.
** Java plugin validation. At pipeline startup, all Java plugins will be checked to ensure that they implement the same version of the Java plugin API present in the current Logstash version.
** DLQ writer interface provided to Java plugins.
** Float, URI, and password config types, each of which provide validation for the supplied config value.
** New built-in Java plugins:
*** A Java-based generator input for testing with the same capabilities as the Ruby generator input as well as an optional eps option to generate events at a given event-per-second rate for situations where as-fast-as-possible event generation is too much.
*** Also includes a jdots codec that mirrors the Ruby dots codec.
*** Java-based sink output that discards any events received. Analogous to the Ruby null plugin though much faster.
* Documentation: Add details about Elastic Search dependency https://github.com/elastic/logstash/pull/10852[#10852]
* Fixed parsing of boolean options provided to Java plugins https://github.com/elastic/logstash/pull/10848[#10848]
* Field reference: handle illegal field references in converted maps https://github.com/elastic/logstash/pull/10839[#10839]
* Fixes unit test failures on some runs of ConfigCompilerTest::testComplexConfigToPipelineIR https://github.com/elastic/logstash/pull/10837[#10837]
* Documentation: Value of start_timestamp must to be quoted https://github.com/elastic/logstash/pull/10836[#10836]
* Build: name rpm/deb oss packages as logstash-oss https://github.com/elastic/logstash/pull/10833[#10833]
* LIR support for octal literals in pipeline definitions https://github.com/elastic/logstash/pull/10828[#10828]
* Merge config values in LIR https://github.com/elastic/logstash/pull/10832[#10832]
* Build: generate tarballs for docker images https://github.com/elastic/logstash/pull/10819[#10819]
* Documentation: Document copy semantics of QueueWriter::push method https://github.com/elastic/logstash/pull/10808[#10808]
* Default stack trace size for hot threads to 50 and make it configurable https://github.com/elastic/logstash/pull/10793[#10793]
* Include G1 in JVM heap metrics https://github.com/elastic/logstash/pull/10784[#10784]
* Expose Metrics API to Java plugins https://github.com/elastic/logstash/pull/10761[#10761]
* Documentation: Clarify behavior of ensure_delivery flag https://github.com/elastic/logstash/pull/10754[#10754]
* Fix JRuby resolv.rb leak https://github.com/elastic/logstash/pull/10741[#10741]
* Add LogStash::PluginMetadata for simple key/value plugin metadata https://github.com/elastic/logstash/pull/10691[#10691]
* Fix default codec and buffer handling in Java stdout output https://github.com/elastic/logstash/pull/10673[#10673]
* Collect and expose codec metrics https://github.com/elastic/logstash/pull/10614[#10614]
* Enhance `GET /` API for Metricbeat Merge config values in LIR https://github.com/elastic/logstash/pull/10589[#10589]
==== Plugins
*Es bulk Codec*
* Fixed deeplink to Elasticsearch Reference https://github.com/logstash-plugins/logstash-codec-es_bulk/pull/18[#18]
*Dns Filter*
* Fixed JRuby resolver bug for versions after to 9.2.0.0 https://github.com/logstash-plugins/logstash-filter-dns/pull/51[#51]
*Geoip Filter*
* Fixed deeplink to Elasticsearch Reference https://github.com/logstash-plugins/logstash-filter-geoip/pull/151[#151]
*Jdbc streaming Filter*
* Fixes connection leak in pipeline reloads by properly disconnecting on plugin close https://github.com/logstash-plugins/logstash-filter-jdbc_streaming/pull/26[#26]
*Azure event hubs Input*
* Updated Azure event hub library dependencies https://github.com/logstash-plugins/logstash-input-azure_event_hubs/pull/36[#36]
*Elasticsearch Input*
* Fixed deeplink to Elasticsearch Reference https://github.com/logstash-plugins/logstash-input-elasticsearch/pull/103[#103]
*Elasticsearch Output*
* Added cluster id tracking through the plugin metadata registry https://github.com/logstash-plugins/logstash-output-elasticsearch/pull/857[#857]
[[logstash-7-1-1]]
=== Logstash 7.1.1 Release Notes
* There are no user facing changes in this release.
[[logstash-7-1-0]]
=== Logstash 7.1.0 Release Notes
* Updates to support changes to licensing of security features.
+
Some Elastic Stack security features, such as encrypted communications, file and native authentication, and
role-based access control, are now available in more subscription levels. For details, see https://www.elastic.co/subscriptions.
[[logstash-7-0-1]]
=== Logstash 7.0.1 Release Notes
* Fixed default codec and buffer handling in Java stdout output https://github.com/elastic/logstash/pull/10673[#10673]
* Corrected the description of codec behavior in the output stage of Logstash pipelines https://github.com/elastic/logstash/pull/10682[#10682]
* Corrected settings file doc to note that Java execution defaults to true https://github.com/elastic/logstash/pull/10701[#10701]
* Updated JRuby to 9.2.7.0 https://github.com/elastic/logstash/pull/10674[#10674]
* Updated Bundler to 1.17.3 https://github.com/elastic/logstash/pull/10685[#10685]
==== Plugins
*Csv Filter*
* Fixed asciidoc formatting for example https://github.com/logstash-plugins/logstash-filter-csv/pull/73[#73]
* Documented that the `autodetect_column_names` and `skip_header` options work only when the number of Logstash
pipeline workers is set to `1`.
*Dns Filter*
* Fixed issue where unqualified domains would fail to resolve when running this plugin with Logstash 5.x https://github.com/logstash-plugins/logstash-filter-dns/pull/48[#48]
* Fixed crash that could occur when encountering certain classes of invalid inputs https://github.com/logstash-plugins/logstash-filter-dns/pull/49[#49]
*Kv Filter*
* Fixed asciidoc formatting in documentation https://github.com/logstash-plugins/logstash-filter-kv/pull/81[#81]
* Added a timeout enforcer which prevents inputs that are pathological against the generated parser from blocking
the pipeline. By default, timeout is a generous 30s, but can be configured or disabled entirely with the new
`timeout_millis` and `tag_on_timeout` directives (https://github.com/logstash-plugins/logstash-filter-kv/pull/79[#79])
* Made error-handling configurable with `tag_on_failure` directive.
*Xml Filter*
* Fixed creation of empty arrays when xpath failed https://github.com/logstash-plugins/logstash-filter-xml/pull/59[#59]
*Dead_letter_queue Input*
* Fixed asciidoc formatting in documentation https://github.com/logstash-plugins/logstash-input-dead_letter_queue/pull/21[#21]
*File Input*
* Fixed problem in Windows where some paths would fail to return an identifier ("inode"). Make path into a C style String before encoding to UTF-16LE. https://github.com/logstash-plugins/logstash-input-file/issues/232[#232]
*Snmp Input*
* Added support for querying SNMP tables
* Changed three error messages in the base_client to include the target address for clarity in the logs.
*Tcp Input*
* Fixed race condition where data would be accepted before queue was configured
* Added support for multiple certificates per file https://github.com/logstash-plugins/logstash-input-tcp/pull/140[#140]
*Twitter Input*
* Updated http-form_data to `~> 2` and public_suffix to `~> 3`
*Elasticsearch Output*
* Fixed bug where index patterns in custom templates could be erroneously overwritten https://github.com/logstash-plugins/logstash-output-elasticsearch/pull/861[#861]
*Kafka Output*
* Fixed issue with unnecessary sleep after retries exhausted https://github.com/logstash-plugins/logstash-output-kafka/pull/216[#216]
*S3 Output*
* Added configuration information for multiple s3 outputs to documentation https://github.com/logstash-plugins/logstash-output-s3/pull/196[#196]
* Fixed formatting problems and typographical errors https://github.com/logstash-plugins/logstash-output-s3/pull/194[#194], https://github.com/logstash-plugins/logstash-output-s3/pull/201[#201], and https://github.com/logstash-plugins/logstash-output-s3/pull/204[#204]
* Added support for setting mutipart upload threshold https://github.com/logstash-plugins/logstash-output-s3/pull/202[#202]
[[logstash-7-0-0]]
=== Logstash 7.0.0 Release Notes
The list combines release notes from the 7.0.0-alpha1, -alpha2, -beta1, -rc1 and -rc2 releases.
==== Logstash core
* BUGFIX: Correctly count total queued items across multiple pipelines https://github.com/elastic/logstash/pull/10564[#10564]
* BUGFIX: Fix issue setting 'enable_metric => false' https://github.com/elastic/logstash/pull/10538[#10538]
* BUGFIX: Prevent concurrent convergence of pipeline actions https://github.com/elastic/logstash/pull/10537[#10537]
* Monitoring: Change internal document type to push "_doc" instead of "doc" https://github.com/elastic/logstash/pull/10533[#10533]
* BUGFIX: Allow explicitly-specified Java codecs https://github.com/elastic/logstash/pull/10520[#10520]
* Central management typeless API https://github.com/elastic/logstash/pull/10421[#10421]
* Improve docs about using Filebeat modules with Logstash https://github.com/elastic/logstash/pull/10438[#10438]
* Bump JRuby to 9.2.6.0 https://github.com/elastic/logstash/pull/10425[#10425]
* BUGFIX: Remove exclusive lock for Ruby pipeline initialization https://github.com/elastic/logstash/pull/10462[#10462]
* Update Java dependencies https://github.com/elastic/logstash/pull/10340[#10340]
* Remove pipeline output workers setting https://github.com/elastic/logstash/pull/10358[#10358]
* Cleanup Ruby gems dependencies https://github.com/elastic/logstash/pull/10171[#10171]
* Ensure compatibility of module data with ES and Kibana 7.0 https://github.com/elastic/logstash/pull/10356[#10356]
* Rename x-pack monitoring and management config option .url and .ca to .hosts and .certificate_authority https://github.com/elastic/logstash/pull/10380[#10380]
* BUGFIX: building of deb and rpm artifacts https://github.com/elastic/logstash/pull/10396[#10396]
* Make Java execution the default https://github.com/elastic/logstash/pull/8649[#8649]
* Field-reference parsing is now strict by default https://github.com/elastic/logstash/pull/9543[#9543]
* Improvements to core Javaification
* BUGFIX: Support for Byte, Short and Date type conversions as seen in the rabbitmq input plugin https://github.com/elastic/logstash/pull/9984[#9984]
==== Plugins
Here are the plugin changes.
===== Codec plugins
* logstash-codec-cef
- Removed obsolete `sev` and `deprecated_v1_fields` fields
- Fixed minor doc inconsistencies (added reverse_mapping to options table, moved it to alpha order in option descriptions, fixed typo)
https://github.com/logstash-plugins/logstash-codec-cef/pull/60[#60]
* logstash-codec-es_bulk
- Add documentation about use with http input
* logstash-codec-netflow
- Fix sub-second timestamp math
- BREAKING: Added support for RFC6759 decoding of application_id. This is a breaking change to the way application_id is decoded. The format changes from e.g. 0:40567 to 0..12356..40567
- Fixed IPFIX options template parsing for Juniper MX240 JunOS 15.1
- Fixed incorrect parsing of zero-filled Netflow 9 packets from Palo Alto
- Added support for Netflow v9 devices with VarString fields (H3C Netstream)
- Reduced complexity of creating, persisting, loading an retrieving template caches
- Fixed issue where TTL in template registry was not being respected
- Added Cisco ACI to list of known working Netflow v9 exporters
- Added support for IXIA Packet Broker IPFIX
- Fixed issue with Procera float fields
===== Filter plugins
* logstash-filter-aggregate
- new feature: add ability to dynamically define a custom `timeout` or `inactivity_timeout` in `code` block (fix issues https://github.com/logstash-plugins/logstash-filter-aggregate/issues/91[#91] and https://github.com/logstash-plugins/logstash-filter-aggregate/issues/92[#92])
- new feature: add meta informations available in `code` block through `map_meta` variable
- new feature: add Logstash metrics, specific to aggregate plugin: aggregate_maps, pushed_events, task_timeouts, code_errors, timeout_code_errors
- new feature: validate at startup that `map_action` option equals to 'create', 'update' or 'create_or_update'
* logstash-filter-clone
- Make 'clones' a required option
- Added a warning when 'clones' is empty since that results in a no-op https://github.com/logstash-plugins/logstash-filter-clone/issues/14[#14]
* logstash-filter-de_dot
- fix failure of fieldnames with boolean value "false"
* logstash-filter-dns
- Fixed issue where unqualified domains would fail to resolve when running this plugin with Logstash 5.x https://github.com/logstash-plugins/logstash-filter-dns/pull/48[#48]
- Fixed crash that could occur when encountering certain classes of invalid inputs https://github.com/logstash-plugins/logstash-filter-dns/pull/49[#49]
* logstash-filter-elasticsearch
- Add support for extracting hits total from Elasticsearch 7.x responses
- Added connection check during register to avoid failures during processing
- Changed Elasticsearch Client transport to use Manticore
- Changed amount of logging details during connection failure
* logstash-filter-fingerprint
- Fixed concurrent SHA fingerprinting by making the instances thread local
* logstash-filter-geoip
- Removed obsolete lru_cache_size field
* NEW: logstash-filter-http
- Beta version of HTTP filter plugin based on @lucashenning's https://github.com/lucashenning/logstash-filter-rest[REST filter].
- Fixed minor documentation issues https://github.com/logstash-plugins/logstash-filter-http/pull/9[#9]
- Minor documentation fixes
* logstash-filter-jdbc_static
- Added info to documentation to emphasize significance of table order https://github.com/logstash-plugins/logstash-filter-jdbc_static/pull/36[36]
* logstash-filter-jdbc_streaming
- Swap out mysql for postgresql for testing https://github.com/logstash-plugins/logstash-filter-jdbc_streaming/pull/11[#11]
* logstash-filter-json
- Updated documentation with some clarifications and fixes
* logstash-filter-kv
- Added a timeout enforcer which prevents inputs that are pathological against the generated parser from blocking
the pipeline. By default, timeout is a generous 30s, but can be configured or disabled entirely with the new
`timeout_millis` and `tag_on_timeout` directives https://github.com/logstash-plugins/logstash-filter-kv/pull/79[#79]
- Made error-handling configurable with `tag_on_failure` directive.
* NEW: logstash-filter-memcached
- Updated to 1.0.0
- The plugin common options (e.g., `add_field`, `add_tag`, etc.) are now correctly only invoked when the plugin successfully gets one or more values from, or sets one or more values to memcached (#4)
- Fix links to argument types in documentation (#3)
* logstash-filter-metrics
- Fixed two minor typos in documentation
* logstash-filter-mutate
- Added ability to directly convert from integer and float to boolean https://github.com/logstash-plugins/logstash-filter-mutate/pull/127[#127]
* logstash-filter-split
- Fixed numeric values, optimized @target verification, cleanups and specs https://github.com/logstash-plugins/logstash-filter-split/pull/36[#36]
* logstash-filter-xml
- Fixed creation of empty arrays when xpath failed https://github.com/logstash-plugins/logstash-filter-xml/pull/59[#59]
- Fixed force_array behavior with nested elements https://github.com/logstash-plugins/logstash-filter-xml/pull/57[#57]
===== Input plugins
* logstash-input-azure_event_hubs
- Updated Azure event hub library dependencies https://github.com/logstash-plugins/logstash-input-azure_event_hubs/pull/27[#27]
* logstash-input-beats
- Removed obsolete setting congestion_threshold and target_field_for_codec
- Changed default value of `add_hostname` to false
- Loosen jar-dependencies manager gem dependency to allow plugin to work with JRubies that include a later version
- Updated jar dependencies to reflect newer releases
* logstash-input-elasticsearch
- Added managed slice scrolling with `slices` option
* logstash-input-file
- Fixed problem in Windows where some paths would fail to return an identifier ("inode"). Make path into a C style String before encoding to UTF-16LE. https://github.com/logstash-plugins/logstash-input-file/issues/232[#232]
- Fixed issue where logs were being spammed with needless error messages https://github.com/logstash-plugins/logstash-input-file/pull/224[#224]
- Fixed problem in tail and read modes where the read loop could get stuck if an IO error occurs in the loop.
The file appears to be being read but it is not, suspected with file truncation schemes.
https://github.com/logstash-plugins/logstash-input-file/issues/205[#205]
- Fixed problem in rotation handling where the target file being rotated was
subjected to the start_position setting when it must always start from the beginning.
https://github.com/logstash-plugins/logstash-input-file/issues/214[#214]
* logstash-input-gelf
- Fixed shutdown handling, robustness in socket closing and restarting, json parsing, code DRYing and cleanups https://github.com/logstash-plugins/logstash-input-gelf/pull/62[#62]
* logstash-input-http
- Added configurable response code option https://github.com/logstash-plugins/logstash-input-http/pull/103[#103]
- Added explanation about operation order of codec and additional_codecs https://github.com/logstash-plugins/logstash-input-http/pull/104[#104]
- Added configurable response code option https://github.com/logstash-plugins/logstash-input-http/pull/103[#103]
- Added explanation about operation order of codec and additional_codecs https://github.com/logstash-plugins/logstash-input-http/pull/104[#104]
- Loosen jar-dependencies manager gem dependency to allow plugin to work with JRubies that include a later version.
- Changed jar dependencies to reflect newer versions
* logstash-input-http_poller
- Fixed minor doc and doc formatting issues https://github.com/logstash-plugins/logstash-input-http_poller/pull/107[#107]
- Removed obsolete field `interval`
- Changed `schedule` entry to show that it is required
https://github.com/logstash-plugins/logstash-input-http_poller/pull/102[#102]
* logstash-input-kafka
- Removed obsolete `ssl` option
- Added support for kafka property ssl.endpoint.identification.algorithm https://github.com/logstash-plugins/logstash-input-kafka/pull/302[#302]
- Changed Kafka client version to 2.1.0
- Changed Kafka client version to 2.0.1 https://github.com/logstash-plugins/logstash-input-kafka/pull/295[#295]
* logstash-input-snmp
- Added no_codec condition to the documentation and bumped version https://github.com/logstash-plugins/logstash-input-snmp/pull/39[#39]
- Changed docs to improve options layout https://github.com/logstash-plugins/logstash-input-snmp/pull/38[#38]
- Added support for querying SNMP tables
- Changed three error messages in the base_client to include the target address for clarity in the logs.
* logstash-input-sqs
- Added support for multiple events inside same message from SQS https://github.com/logstash-plugins/logstash-input-sqs/pull/48[#48]
* logstash-input-tcp
- Removed obsolete `data_timeout` and `ssl_cacert` options
- Fixed race condition where data would be accepted before queue was configured
- Support multiple certificates per file https://github.com/logstash-plugins/logstash-input-tcp/pull/140[#140]
===== Output plugins
* logstash-output-elasticsearch
- Remove support for parent child (still support join data type) since we don't support multiple document types any more
- Removed obsolete `flush_size` and `idle_flush_time`
- Added 'auto' setting for ILM with default of 'auto' https://github.com/logstash-plugins/logstash-output-elasticsearch/pull/838[#838]
- Fixed sniffing support for 7.x https://github.com/logstash-plugins/logstash-output-elasticsearch/pull/827[#827]
- Fixed issue with escaping index names which was causing writing aliases for ILM to fail https://github.com/logstash-plugins/logstash-output-elasticsearch/pull/831[#831]
- Adds support for Index Lifecycle Management for Elasticsearch 6.6.0 and above, running with at least a Basic License(Beta) https://github.com/logstash-plugins/logstash-output-elasticsearch/pull/805[#805]
- Fixed support for Elasticsearch 7.x https://github.com/logstash-plugins/logstash-output-elasticsearch/pull/812[#812]
- Tweaked logging statements to reduce verbosity
- Fixed numerous issues relating to builds on Travis https://github.com/logstash-plugins/logstash-output-elasticsearch/pull/799[#799]
* logstash-output-file
- Removed JRuby check when using FIFOs https://github.com/logstash-plugins/logstash-output-file/pull/75[#75]
* logstash-output-http
- Relax dependency on http_client mixin since current major works on both
- Fixed handling of empty `retryable_codes` https://github.com/logstash-plugins/logstash-output-http/pull/99[#99]
* logstash-output-kafka
- Fixed issue with unnecessary sleep after retries exhausted https://github.com/logstash-plugins/logstash-output-kafka/pull/216[#216]
- Removed obsolete `block_on_buffer_full`, `ssl` and `timeout_ms` options
- Added support for kafka property `ssl.endpoint.identification.algorithm` https://github.com/logstash-plugins/logstash-output-kafka/pull/213[#213]
- Changed Kafka client to version 2.1.0
- Changed Kafka client to version 2.0.1 https://github.com/logstash-plugins/logstash-output-kafka/pull/209[#209]
* logstash-output-pagerduty
- Update _development_ dependency webmock to latest version to prevent conflicts in logstash core's dependency matrix.
* logstash-output-redis
- Removed obsolete fields `queue` and `name`
- Changed major version of redis library dependency to 4.x
* logstash-output-s3
- Add support for setting mutipart upload threshold https://github.com/logstash-plugins/logstash-output-s3/pull/202[#202]
- Fixed issue where on restart, 0 byte files could erroneously be uploaded to s3 https://github.com/logstash-plugins/logstash-output-s3/issues/195[#195]
* logstash-output-sqs
- Removed obsolete fields `batch` and `batch_timeout`
- Removed workaround to JRuby bug https://github.com/jruby/jruby/issues/3645[#3645]
* logstash-output-tcp
- Removed obsolete field `message_format`
- Removed requirement to have a certificate/key pair when enabling ssl
* logstash-mixin-http_client
- Removed obsolete ssl_certificate_verify option
[[logstash-7-0-0-rc2]]
=== Logstash 7.0.0-rc2 Release Notes
==== Plugins
* logstash-input-snmp
- Added support for querying SNMP tables
- Changed three error messages in the base_client to include the target address for clarity in the logs.
[[logstash-7-0-0-rc1]]
=== Logstash 7.0.0-rc1 Release Notes
==== Logstash core
* BUGFIX: Correctly count total queued items across multiple pipelines https://github.com/elastic/logstash/pull/10564[#10564]
* BUGFIX: Fix issue setting 'enable_metric => false' https://github.com/elastic/logstash/pull/10538[#10538]
* BUGFIX: Prevent concurrent convergence of pipeline actions https://github.com/elastic/logstash/pull/10537[#10537]
* Monitoring: Change internal document type to push "_doc" instead of "doc" https://github.com/elastic/logstash/pull/10533[#10533]
* BUGFIX: Allow explicitly-specified Java codecs https://github.com/elastic/logstash/pull/10520[#10520]
* Central management typeless API https://github.com/elastic/logstash/pull/10421[#10421]
* Improve docs about using Filebeat modules with Logstash https://github.com/elastic/logstash/pull/10438[#10438]
* Bump JRuby to 9.2.6.0 https://github.com/elastic/logstash/pull/10425[#10425]
* BUGFIX: Remove exclusive lock for Ruby pipeline initialization https://github.com/elastic/logstash/pull/10462[#10462]
==== Plugins
* logstash-filter-dns
- Fixed issue where unqualified domains would fail to resolve when running this plugin with Logstash 5.x https://github.com/logstash-plugins/logstash-filter-dns/pull/48[#48]
- Fixed crash that could occur when encountering certain classes of invalid inputs https://github.com/logstash-plugins/logstash-filter-dns/pull/49[#49]
* logstash-filter-kv
- Added a timeout enforcer which prevents inputs that are pathological against the generated parser from blocking
the pipeline. By default, timeout is a generous 30s, but can be configured or disabled entirely with the new
`timeout_millis` and `tag_on_timeout` directives https://github.com/logstash-plugins/logstash-filter-kv/pull/79[#79]
- Made error-handling configurable with `tag_on_failure` directive.
* logstash-filter-xml
- Fixed creation of empty arrays when xpath failed https://github.com/logstash-plugins/logstash-filter-xml/pull/59[#59]
* logstash-input-file
- Fixed problem in Windows where some paths would fail to return an identifier ("inode"). Make path into a C style String before encoding to UTF-16LE. https://github.com/logstash-plugins/logstash-input-file/issues/232[#232]
* logstash-input-tcp
- Fixed race condition where data would be accepted before queue was configured
- Support multiple certificates per file https://github.com/logstash-plugins/logstash-input-tcp/pull/140[#140]
* logstash-output-kafka
- Fixed issue with unnecessary sleep after retries exhausted https://github.com/logstash-plugins/logstash-output-kafka/pull/216[#216]
* logstash-output-s3
- Add support for setting mutipart upload threshold https://github.com/logstash-plugins/logstash-output-s3/pull/202[#202]
[[logstash-7-0-0-beta1]]
=== Logstash 7.0.0-beta1 Release Notes
==== Logstash core
* Update Java dependencies https://github.com/elastic/logstash/pull/10340[#10340]
* Remove pipeline output workers setting https://github.com/elastic/logstash/pull/10358[#10358]
* Cleanup Ruby gems dependencies https://github.com/elastic/logstash/pull/10171[#10171]
* Ensure compatibility of module data with ES and Kibana 7.0 https://github.com/elastic/logstash/pull/10356[#10356]
* Rename x-pack monitoring and management config option .url and .ca to .hosts and .certificate_authority https://github.com/elastic/logstash/pull/10380[#10380]
* BUGFIX: building of deb and rpm artifacts https://github.com/elastic/logstash/pull/10396[#10396]
==== Plugins
* logstash-codec-cef
- Removed obsolete `sev` and `deprecated_v1_fields` fields
- Fixed minor doc inconsistencies (added reverse_mapping to options table, moved it to alpha order in option descriptions, fixed typo)
https://github.com/logstash-plugins/logstash-codec-cef/pull/60[#60]
* logstash-codec-es_bulk
- Add documentation about use with http input
* logstash-codec-netflow
- Fix sub-second timestamp math
* logstash-filter-clone
- Make 'clones' a required option
- Added a warning when 'clones' is empty since that results in a no-op https://github.com/logstash-plugins/logstash-filter-clone/issues/14[#14]
* logstash-filter-de_dot
- fix failure of fieldnames with boolean value "false"
* logstash-filter-geoip
- Removed obsolete lru_cache_size field
* logstash-filter-http
- Fixed minor documentation issues https://github.com/logstash-plugins/logstash-filter-http/pull/9[#9]
- Minor documentation fixes
* logstash-filter-jdbc_streaming
- Swap out mysql for postgresql for testing https://github.com/logstash-plugins/logstash-filter-jdbc_streaming/pull/11[#11]
* logstash-filter-json
- Updated documentation with some clarifications and fixes
* logstash-filter-memcached
- Updated to 1.0.0
- The plugin common options (e.g., `add_field`, `add_tag`, etc.) are now correctly only invoked when the plugin successfully gets one or more values from, or sets one or more values to memcached (#4)
- Fix links to argument types in documentation (#3)
* logstash-filter-metrics
- Fixed two minor typos in documentation
* logstash-filter-mutate
- Added ability to directly convert from integer and float to boolean https://github.com/logstash-plugins/logstash-filter-mutate/pull/127[#127]
* logstash-filter-split
- Fixed numeric values, optimized @target verification, cleanups and specs https://github.com/logstash-plugins/logstash-filter-split/pull/36[#36]
* logstash-input-azure_event_hubs
- Updated Azure event hub library dependencies https://github.com/logstash-plugins/logstash-input-azure_event_hubs/pull/27[#27]
* logstash-input-beats
- Removed obsolete setting congestion_threshold and target_field_for_codec
- Changed default value of `add_hostname` to false
* logstash-input-elasticsearch
- Added managed slice scrolling with `slices` option
* logstash-input-http
- Added configurable response code option https://github.com/logstash-plugins/logstash-input-http/pull/103[#103]
- Added explanation about operation order of codec and additional_codecs https://github.com/logstash-plugins/logstash-input-http/pull/104[#104]
* logstash-input-http_poller
- Fixed minor doc and doc formatting issues https://github.com/logstash-plugins/logstash-input-http_poller/pull/107[#107]
- Removed obsolete field `interval`
- Changed `schedule` entry to show that it is required
https://github.com/logstash-plugins/logstash-input-http_poller/pull/102[#102]
* logstash-input-kafka
- Removed obsolete `ssl` option
* logstash-input-tcp
- Removed obsolete `data_timeout` and `ssl_cacert` options
* logstash-mixin-http_client
- Removed obsolete ssl_certificate_verify option
* logstash-output-elasticsearch
- Remove support for parent child (still support join data type) since we don't support multiple document types any more
- Removed obsolete `flush_size` and `idle_flush_time`
- Added 'auto' setting for ILM with default of 'auto' https://github.com/logstash-plugins/logstash-output-elasticsearch/pull/838[#838]
- Fixed sniffing support for 7.x https://github.com/logstash-plugins/logstash-output-elasticsearch/pull/827[#827]
- Fixed issue with escaping index names which was causing writing aliases for ILM to fail https://github.com/logstash-plugins/logstash-output-elasticsearch/pull/831[#831]
* logstash-output-file
- Removed JRuby check when using FIFOs https://github.com/logstash-plugins/logstash-output-file/pull/75[#75]
* logstash-output-http
- Relax dependency on http_client mixin since current major works on both
* logstash-output-kafka
- Removed obsolete `block_on_buffer_full`, `ssl` and `timeout_ms` options
* logstash-output-pagerduty
- Update _development_ dependency webmock to latest version to prevent conflicts in logstash core's dependency matrix.
* logstash-output-redis
- Removed obsolete fields `queue` and `name`
- Changed major version of redis library dependency to 4.x
* logstash-output-sqs
- Removed obsolete fields `batch` and `batch_timeout`
- Removed workaround to JRuby bug https://github.com/jruby/jruby/issues/3645[#3645]
* logstash-output-tcp
- Removed obsolete field `message_format`
- Removed requirement to have a certificate/key pair when enabling ssl
[[logstash-7-0-0-alpha2]]
=== Logstash 7.0.0-alpha2 Release Notes
==== Plugins
* logstash-filter-elasticsearch
- Add support for extracting hits total from Elasticsearch 7.x responses
- Added connection check during register to avoid failures during processing
- Changed Elasticsearch Client transport to use Manticore
- Changed amount of logging details during connection failure
* logstash-filter-fingerprint
- Fixed concurrent SHA fingerprinting by making the instances thread local
* NEW: logstash-filter-http
- Beta version of HTTP filter plugin based on @lucashenning's https://github.com/lucashenning/logstash-filter-rest[REST filter].
* NEW: logstash-filter-memcached
* logstash-input-beats
- Loosen jar-dependencies manager gem dependency to allow plugin to work with JRubies that include a later version
- Updated jar dependencies to reflect newer releases
* logstash-input-file
- Fixed issue where logs were being spammed with needless error messages https://github.com/logstash-plugins/logstash-input-file/pull/224[#224]
- Fixed problem in tail and read modes where the read loop could get stuck if an IO error occurs in the loop.
The file appears to be being read but it is not, suspected with file truncation schemes.
https://github.com/logstash-plugins/logstash-input-file/issues/205[#205]
* logstash-input-gelf
- Fixed shutdown handling, robustness in socket closing and restarting, json parsing, code DRYing and cleanups https://github.com/logstash-plugins/logstash-input-gelf/pull/62[#62]
* logstash-input-http
- Loosen jar-dependencies manager gem dependency to allow plugin to work with JRubies that include a later version.
- Changed jar dependencies to reflect newer versions
* logstash-input-kafka
- Added support for kafka property ssl.endpoint.identification.algorithm https://github.com/logstash-plugins/logstash-input-kafka/pull/302[#302]
- Changed Kafka client version to 2.1.0
- Changed Kafka client version to 2.0.1 https://github.com/logstash-plugins/logstash-input-kafka/pull/295[#295]
* logstash-output-elasticsearch
- Adds support for Index Lifecycle Management for Elasticsearch 6.6.0 and above, running with at least a Basic License(Beta) https://github.com/logstash-plugins/logstash-output-elasticsearch/pull/805[#805]
- Fixed support for Elasticsearch 7.x https://github.com/logstash-plugins/logstash-output-elasticsearch/pull/812[#812]
* logstash-output-http
- Fixed handling of empty `retryable_codes` https://github.com/logstash-plugins/logstash-output-http/pull/99[#99]
* logstash-output-kafka
- Added support for kafka property `ssl.endpoint.identification.algorithm` https://github.com/logstash-plugins/logstash-output-kafka/pull/213[#213]
- Changed Kafka client to version 2.1.0
- Changed Kafka client to version 2.0.1 https://github.com/logstash-plugins/logstash-output-kafka/pull/209[#209]
[[logstash-7-0-0-alpha1]]
=== Logstash 7.0.0-alpha1 Release Notes
==== Logstash core
* Make Java execution the default https://github.com/elastic/logstash/pull/8649[#8649]
* Field-reference parsing is now strict by default https://github.com/elastic/logstash/pull/9543[#9543]
* Improvements to core Javaification
* BUGFIX: Support for Byte, Short and Date type conversions as seen in the rabbitmq input plugin https://github.com/elastic/logstash/pull/9984[#9984]
==== Plugins
* logstash-codec-netflow
- BREAKING: Added support for RFC6759 decoding of application_id. This is a breaking change to the way application_id is decoded. The format changes from e.g. 0:40567 to 0..12356..40567
- Fixed IPFIX options template parsing for Juniper MX240 JunOS 15.1
- Fixed incorrect parsing of zero-filled Netflow 9 packets from Palo Alto
- Added support for Netflow v9 devices with VarString fields (H3C Netstream)
- Reduced complexity of creating, persisting, loading an retrieving template caches
- Fixed issue where TTL in template registry was not being respected
- Added Cisco ACI to list of known working Netflow v9 exporters
- Added support for IXIA Packet Broker IPFIX
- Fixed issue with Procera float fields
* logstash-filter-aggregate
- new feature: add ability to dynamically define a custom `timeout` or `inactivity_timeout` in `code` block (fix issues https://github.com/logstash-plugins/logstash-filter-aggregate/issues/91[#91] and https://github.com/logstash-plugins/logstash-filter-aggregate/issues/92[#92])
- new feature: add meta informations available in `code` block through `map_meta` variable
- new feature: add Logstash metrics, specific to aggregate plugin: aggregate_maps, pushed_events, task_timeouts, code_errors, timeout_code_errors
- new feature: validate at startup that `map_action` option equals to 'create', 'update' or 'create_or_update'
* logstash-filter-jdbc_static
- Added info to documentation to emphasize significance of table order https://github.com/logstash-plugins/logstash-filter-jdbc_static/pull/36[36]
* logstash-filter-xml
- Fixed creation of empty arrays when xpath failed https://github.com/logstash-plugins/logstash-filter-xml/pull/59[#59]
- Fixed force_array behavior with nested elements https://github.com/logstash-plugins/logstash-filter-xml/pull/57[#57]
* logstash-input-file
- Fixed problem in rotation handling where the target file being rotated was
subjected to the start_position setting when it must always start from the beginning.
https://github.com/logstash-plugins/logstash-input-file/issues/214[#214]
* logstash-input-snmp
- Added no_codec condition to the documentation and bumped version https://github.com/logstash-plugins/logstash-input-snmp/pull/39[#39]
- Changed docs to improve options layout https://github.com/logstash-plugins/logstash-input-snmp/pull/38[#38]
* logstash-input-sqs
- Added support for multiple events inside same message from SQS https://github.com/logstash-plugins/logstash-input-sqs/pull/48[#48]
* logstash-output-elasticsearch
- Tweaked logging statements to reduce verbosity
- Fixed numerous issues relating to builds on Travis https://github.com/logstash-plugins/logstash-output-elasticsearch/pull/799[#799]
* logstash-output-s3
- Fixed issue where on restart, 0 byte files could erroneously be uploaded to s3 https://github.com/logstash-plugins/logstash-output-s3/issues/195[#195]
Reference in a new issue View git blame Copy permalink