github-mirrors/logstash
1
0
Fork 0
mirror of https://github.com/elastic/logstash.git synced 2025-04-21 21:27:20 -04:00
Code Issues Projects Releases Packages Wiki Activity
8588 commits 254 branches 379 tags 173 MiB
Commit graph

8588 commits

This branch
This branch
All branches
Author SHA1 Message Date
Armin
b6ad235990 #7784 cleanup metric parser 
Fixes #7816
 2017-07-27 04:43:48 +00:00
Armin
0f6cf36065 PERFORMANCE: Optimizetagging API paths 
Fixes #7821
 2017-07-27 04:42:14 +00:00
Rob Bavey
8cc1a9f924 Add some safety to closing the writer and deleting the lock file 
Fixes #7822
 2017-07-26 20:56:23 +00:00
Rob Bavey
9da03c5e9e Close channel associated with lock 
Fix Windows build issue where .lock file cannot be deleted due to
underling channel associated with lock not being closed. This
will stop the file from being deleted until the JVM exits, despite
reporting through Java that the file *has* been deleted and does not
exist. It also blocks new files from being created with the same
filename, which caused the test failure here.

Fixes #7822
 2017-07-26 20:56:23 +00:00
Armin
ee725806ad PERFORMANCE: Extracted cold paths in BiValues and Accessors 
Fixes #7815
 2017-07-26 10:19:38 +00:00
Jake Landis
c4d0a33134 Revert "Fix path for local development" 
This reverts commit ae21bf374c.

This change was only applicable to IntelliJ, see https://youtrack.jetbrains.com/issue/IDEA-175172

Fixes #7806
 2017-07-25 19:22:37 +00:00
Armin
35a8a41c05 PERFORMANCE: Remve needless locking on batch reads 
Fixes #7623
 2017-07-25 18:33:09 +00:00
Armin
92c9b1f08b Fixes #7676 and generally improves the performance of org.logstash.StringInterpolation#evaluate by: 
* Don't use regex to find the contents between `%{}`, it's way too inefficient for a simple case like this with all its allocations
* Flatten logic out of the many helper classes
* Use a reusable, thread-local `StringBuilder` to serialize into
* Don't use `.substring` for comparisons
* `static` `ObjectMapper`
* `org.joda.time.format.DateTimeFormat#forPattern` not being cached is not an issue, since it's cached in `org.joda.time.format.DateTimeFormat#cPatternCache`

* Added benchmark
   * ~15% faster for a few cases I ran, even for repeated patterns with interpolation + couldn't find any case even with date formatting, where this implementation is slower than the cached one
   *  no leaking on dynamic patterns

Fixes #7692
 2017-07-25 18:29:09 +00:00
Armin
dcf9a10d88 Minor: Fix a few more compiler warnings 
Fixes #7802
 2017-07-25 15:07:48 +00:00
Armin
bb714cfce8 #7799 fix Windows incompatible Resource use + Windows incompatible use of /dev/null 
Fixes #7800
 2017-07-25 12:35:20 +00:00
Armin
0c3a58c172 MINOR: Enable JRuby AOT compilation and turn JIT threshold down to 0 
Fixes #7783
 2017-07-24 21:34:41 +00:00
Rob Bavey
d67b06da6b Update based on code review comments 
Test cleanup

Fixes #7789
 2017-07-24 20:04:55 +00:00
Rob Bavey
c0047586bb Fix seek by Timestamp bugs 
Fixes 2 seekByTimestamp failure scenarios that occur when a segment is closed with entries smaller than BLOCK_SIZE

If the next segment is > BLOCK_SIZE, then the seek will advance to the next segment. (Skipping past all events
 in the closed segment)
If the next segment < BLOCK_SIZE, then the seek will advance to the start of the small segment. (Processing
 entries prior to the timestamp)

Fixes #7789
 2017-07-24 20:04:55 +00:00
Suyog Rao
c8445ce246 [docs] Mark 6.1.0 as unreleased 2017-07-24 12:30:49 -07:00
Suyog Rao
4350f00e71 Update breaking-changes.asciidoc 2017-07-24 12:27:09 -07:00
Suyog Rao
e274043054 Bump version of 6.x to 6.1.0 (#7794) 2017-07-24 11:54:44 -07:00
Suyog Rao
ce040d6f24 Fix doc build by adding the right heading level 2017-07-24 11:17:20 -07:00
Suyog Rao
330e05b282 [Docs] Add breaking changes for 6.0.0 (#7787) 
* [Docs] Add breaking changes for 6.0.0

* Changes after review
 2017-07-24 10:57:46 -07:00
Jake Landis
ae21bf374c Fix path for local development 
Fixes #7786
 2017-07-24 16:55:26 +00:00
Andrew Cholakian
1811283250 Fix bug where hot threads did not work with duplicate names / add thread_id 
The hot threads endpoint used to require thread names to be unique in a map and would crash otherwise. This patch fixes this by internally using a List instead of a Map to store these thread ids.

Additionally, this patch adds the `thread_id` to the response to allow for disambiguation of of threads for any client applications.

Fixes https://github.com/elastic/logstash/issues/7608

Fixes #7617
 2017-07-24 16:38:18 +00:00
Armin
bff61d59fe MINOR: Remove unused take and timed offer from queue wrappers 
Fixes #7782
 2017-07-24 16:03:00 +00:00
Armin
d9436dd760 Benchmark Tool 
Fixes #7629
 2017-07-24 15:46:30 +00:00
Armin
10a72ce015 #7700 ignore ENV JAVA_OPTS in rake tasks 
Fixes #7785
 2017-07-24 15:44:52 +00:00
Armin
933919367a MINOR: Extract hot constructor from RubyEvent 
Fixes #7781
 2017-07-24 08:18:56 +00:00
Armin
6355c839ab MINOR: Cleanup Event by making it final and removing the incorrect serializable interface 
Fixes #7769
 2017-07-23 18:35:09 +00:00
Armin
5c77bde6e4 MINOR: Inline hot path code in Accessors 
Fixes #7771
 2017-07-23 18:34:05 +00:00
Armin
a055b2b854 MINOR: Make IO interfaces with close method implement java.io.Closeable 
Fixes #7776
 2017-07-23 18:33:18 +00:00
Rob Bavey
b5c540010b Add at_least(:once) to work around intermittent test failures 
The test that calls out to /proc/loadavg has been intermittently
 failing, because /proc/loadavg is being read from more than once
This should be benign, so this commit allows it to happen

Fixes #6867

Fixes #7757
 2017-07-20 18:22:50 +00:00
Jake Landis
f1361de660 Test stabilization: add max retry and timeouts to pipeline spec 
Fixes #7738

Fixes #7752
 2017-07-20 17:58:05 +00:00
Jake Landis
78d0d5a364 Test stabilization: Add retry to have_running_pipeline matcher 
Fixes #7737

Fixes #7753
 2017-07-20 17:57:31 +00:00
Jake Landis
0c59550d65 Test stabilization: Ensure that logging is set back to 'info' after tests that may change it 
Fixes #7739

Fixes #7743
 2017-07-20 17:56:33 +00:00
Guy Boertje
a6e9ab91ed Merge CLI into YML settings + limit user specified modules to 1 for 5.x (#7756) 2017-07-20 17:47:01 +01:00
Joao Duarte
5e883e17c9 pass http_options to can_connect in kibana_client 
Fixes #7751
 2017-07-20 14:36:00 +00:00
Jake Landis
acd632aa89 Pin logstash-output-s3 to 4.0.9+ since prior version will not work with JRuby 9k 
Fixes #7735
 2017-07-20 13:22:14 +00:00
Aaron Mildenstein
56569810cb Add netflow module for 6.x 
Fixes #7747
 2017-07-20 00:04:47 +00:00
Aaron Mildenstein
c32e2d692e Add netflow module (#7741) 2017-07-19 14:31:52 -06:00
João Duarte
7579f96797 test multiple pipelines using RATS (#7732) 
- also adds `config.support_escapes` do list of pipeline settings
 2017-07-19 16:43:56 +01:00
Deb Adair
00d3af162f [DOCS] Changed xrefs to cross doc links to enable GS mini-book builds. 2017-07-18 18:41:14 -07:00
Jake Landis
a25d329f64 Test Failure Fix: Retry pipeline metrics 
Fixes #7724

Fixes #7728
 2017-07-18 22:04:02 +00:00
Colin Surprenant
aedf397397 fix empty queue condition for queue shutdown drain, PR #7575 
page test

queue test

move is_empty? at queue level

new wrapped acked queue spec
 2017-07-18 16:32:22 -04:00
Colin Surprenant
f3f24dc706 reference correct class path 2017-07-18 16:21:09 -04:00
Armin
b6ebbb3eed MINOR: Set Xms == Xmx as a default 
Fixes #7725
 2017-07-18 17:08:29 +00:00
Guy Boertje
dbcce19888 correct ES_client to only split strings + add csv_string(array) method (#7722) 
an x-pack-logstash PR will be reliant on the csv_string method.
 2017-07-18 15:40:49 +01:00
Jake Landis
e87f810c76 Fix gradle tests on Windows 
Addresses #7637

Fixes #7716
 2017-07-17 22:49:05 +00:00
Andrew Cholakian
85fc814105 Fix SafeURI to maintain pre-5.5.0 escaping behavior 
Prior to Logstash 5.5.0 the ::LogStash::Util::SafeURI class returned escaped values where applicable. As part of the refactor in https://github.com/elastic/logstash/pull/7236 this behavior was accidentally changed, breaking the ES output and resulting in bugs like: https://github.com/logstash-plugins/logstash-output-elasticsearch/issues/618 .

This PR maintains the java.net.URI refactor but fixes the behavior to align with pre-5.5.0 logstashes by correctly returning escaped values.

Fixes #7687
 2017-07-17 18:15:36 +00:00
Suyog Rao
23b8d4d948 Add translate filter to default filter list (#7713) 2017-07-17 10:43:24 -07:00
Magnus Bäck
c86c346765 docs: Fix typo in markup (#7689) 2017-07-17 09:59:34 -05:00
Armin
1ebb0e350f #7662 Make StringBiValue safe against mutations to the underlying RubyString 
Fixes #7663
 2017-07-17 14:13:20 +00:00
Armin
59df92321a MINOR: Turn NullBiValue into a Singleton 
Fixes #7707
 2017-07-17 12:10:33 +00:00
Armin
03e6f4d4a9 MINOR: default to -Djruby.compile.invokedynamic=true 
Fixes #7698
 2017-07-17 11:59:51 +00:00