github-mirrors/elasticsearch
1
0
Fork 0
mirror of https://github.com/elastic/elasticsearch.git synced 2025-04-25 15:47:23 -04:00
Code Issues Projects Releases Packages Wiki Activity
elasticsearch/docs/reference/ingest/processors
History
Keith Massey f327352601
Making JsonProcessor stricter so that it does not silently drop data (#93179) 
This PR makes JsonProcessor's JSON parsing a little bit stricter so that
we are not silently dropping data when given bad inputs. Previously if
the input string began with something that could be parsed as a valid
json field, then the processor would grab that and ignore the rest. For
example, `123 "foo"` would be parsed as `123`, dropping the `"foo"`. Now
by default it will throw an IllegalArgumentException on a string like
this. A user can now set the `strict_json_parsing` parameter to false to
get the old behavior. For example:

```
POST _ingest/pipeline/_simulate
{
  "pipeline": {
    "description": "",
    "processors" : [
      {
        "json" : {
          "field" : "message",
          "strict_json_parsing": false
        }
      }
    ]
  },
  "docs": [
    {
      "_source": {
        "message": "123 \"foo\""
      }
    }
  ]
}'
```

Closes #92898
2023-01-24 18:43:35 -05:00
..
append.asciidoc Configurable media_type for mustache template encoding on append processor (#76210) 2021-08-10 15:13:36 -05:00
attachment.asciidoc Deprecate 'remove_binary' default of false for ingest attachment processor (#90460) 2022-10-04 01:04:40 +10:30
bytes.asciidoc [DOCS] Fix case of ingest processor titles (#61024) 2020-08-12 11:28:00 -04:00
circle.asciidoc [DOCS] Remove testenv annotations from doc snippet tests (#80023) 2021-11-05 18:38:50 -04:00
common-options.asciidoc [DOCS] Fix xref for conditionally running ingest processor (#82001) 2021-12-21 11:37:20 -05:00
community-id.asciidoc Update documentation with supported IANA numbers (#90531) 2022-10-19 08:23:11 -05:00
convert.asciidoc [DOCS] IP type for convert processor (#70599) 2021-03-22 11:36:50 -05:00
csv.asciidoc [DOCS] Fix case of ingest processor titles (#61024) 2020-08-12 11:28:00 -04:00
date-index-name.asciidoc Ingest: IngestDocument requires non-null version (#87665) 2022-06-15 07:50:45 -05:00
date.asciidoc Correct docs on output_format option for date processor (#81557) 2021-12-17 06:07:03 -06:00
dissect.asciidoc [DOCS] Fix xref for conditionally running ingest processor (#82001) 2021-12-21 11:37:20 -05:00
dot-expand.asciidoc Support for wildcards and override option for dot_expander processor (#74601) 2021-07-08 14:39:27 +02:00
drop.asciidoc [DOCS] Fix case of ingest processor titles (#61024) 2020-08-12 11:28:00 -04:00
enrich.asciidoc [DOCS] Remove testenv annotations from doc snippet tests (#80023) 2021-11-05 18:38:50 -04:00
fail.asciidoc [DOCS] Use HTML-unescaped Mustache variables in ingest pipelines (#71360) 2021-04-06 15:33:10 -04:00
fingerprint.asciidoc Ingest: IngestDocument requires non-null version (#87665) 2022-06-15 07:50:45 -05:00
foreach.asciidoc [DOCS] Fixes a link that breaks the docs build. (#88111) 2022-06-28 10:22:23 +02:00
geoip.asciidoc Adding more detail about ingest.geoip.downloader.endpoint (#91182) 2022-11-09 09:17:33 -06:00
grok.asciidoc Ingest: IngestDocument requires non-null version (#87665) 2022-06-15 07:50:45 -05:00
gsub.asciidoc [DOCS] Fix Gsub processor snippet (#61720) 2020-08-31 10:14:54 -04:00
html_strip.asciidoc [DOCS] Fix case of ingest processor titles (#61024) 2020-08-12 11:28:00 -04:00
inference.asciidoc [ML] add roberta/bart docs (#85001) 2022-03-17 12:14:57 -04:00
join.asciidoc [DOCS] Fix field def for join processor (#61395) 2020-08-21 08:35:56 -04:00
json.asciidoc Making JsonProcessor stricter so that it does not silently drop data (#93179) 2023-01-24 18:43:35 -05:00
kv.asciidoc Add template snippets support for KV ingest processor (#73758) 2021-06-22 16:32:11 -05:00
lowercase.asciidoc [DOCS] Fix case of ingest processor titles (#61024) 2020-08-12 11:28:00 -04:00
network-direction.asciidoc Ingest: IngestDocument requires non-null version (#87665) 2022-06-15 07:50:45 -05:00
pipeline.asciidoc Allow pipeline processor to ignore missing pipelines (#87354) 2022-06-07 07:02:18 -04:00
registered-domain.asciidoc Ingest: IngestDocument requires non-null version (#87665) 2022-06-15 07:50:45 -05:00
remove.asciidoc [Docs] Update remove processor with 'keep' option (#92836) 2023-01-11 12:52:35 -05:00
rename.asciidoc [DOCS] Refactor ingest pipeline docs (#70253) 2021-03-15 12:22:57 -04:00
script.asciidoc Ingest: IngestDocument requires non-null version (#87665) 2022-06-15 07:50:45 -05:00
set-security-user.asciidoc Expose API Key metadata to SetSecurityUser ingest processor (#72137) 2021-04-29 14:47:36 +10:00
set.asciidoc Ingest: IngestDocument requires non-null version (#87665) 2022-06-15 07:50:45 -05:00
sort.asciidoc [DOCS] Fix double spaces (#71082) 2021-03-31 09:57:47 -04:00
split.asciidoc [DOCS] Fix case of ingest processor titles (#61024) 2020-08-12 11:28:00 -04:00
trim.asciidoc [DOCS] Fix case of ingest processor titles (#61024) 2020-08-12 11:28:00 -04:00
uppercase.asciidoc [DOCS] Fix case of ingest processor titles (#61024) 2020-08-12 11:28:00 -04:00
uri-parts.asciidoc [DOCS] Remove testenv annotations from doc snippet tests (#80023) 2021-11-05 18:38:50 -04:00
url-decode.asciidoc [DOCS] Fix case of ingest processor titles (#61024) 2020-08-12 11:28:00 -04:00
user-agent.asciidoc Update JSON parser and snippets (#77983) 2021-09-20 11:08:26 +01:00