elasticsearch/docs/reference/release-notes/8.14.0.asciidoc

[[release-notes-8.14.0]]
== {es} version 8.14.0

Also see <<breaking-changes-8.14,Breaking changes in 8.14>>.

[[breaking-8.14.0]]
[float]
=== Breaking changes

Security::
* Prevent DLS/FLS if `replication` is assigned {es-pull}108600[#108600]
* Apply stricter Document Level Security (DLS) rules for the validate query API with the rewrite parameter {es-pull}105709[#105709]
* Apply stricter Document Level Security (DLS) rules for terms aggregations when min_doc_count is set to 0 {es-pull}105714[#105714]

[[known-issues-8.14.0]]
[float]
=== Known issues
* When upgrading clusters from version 8.11.4 or earlier, if your cluster contains non-master-eligible nodes,
information about the new functionality of these upgraded nodes may not be registered properly with the master node.
This can lead to some new functionality added since 8.12.0 not being accessible on the upgraded cluster.
If your cluster is running on ECK 2.12.1 and above, this may cause problems with finalizing the upgrade.
To resolve this issue, perform a rolling restart on the non-master-eligible nodes once all Elasticsearch nodes
are upgraded. This issue is fixed in 8.15.0.

* The `pytorch_inference` process used to run Machine Learning models can consume large amounts of memory.
In environments where the available memory is limited, the OS Out of Memory Killer will kill the `pytorch_inference`
process to reclaim memory. This can cause inference requests to fail.
Elasticsearch will automatically restart the `pytorch_inference` process
after it is killed up to four times in 24 hours. (issue: {es-issue}110530[#110530])

[[bug-8.14.0]]
[float]
=== Bug fixes

Aggregations::
* Cross check livedocs for terms aggs when index access control list is non-null {es-pull}105714[#105714]
* ESQL: Enable VALUES agg for datetime {es-pull}107016[#107016]
* Fix IOOBE in TTest aggregation when using filters {es-pull}109034[#109034]
* Validate stats formatting in standard `InternalStats` constructor {es-pull}107678[#107678] (issue: {es-issue}107671[#107671])

Application::
* [Bugfix] Connector API - fix status serialisation issue in termquery {es-pull}108365[#108365]
* [Connector API] Fix bug with filtering validation toXContent {es-pull}107467[#107467]
* [Connector API] Fix bug with parsing *_doc_count nullable fields {es-pull}108854[#108854]
* [Connector API] Fix bug with with wrong target index for access control sync {es-pull}109097[#109097]

Authorization::
* Users with monitor privileges can access async_search/status endpoint even when setting keep_alive {es-pull}107383[#107383]

CAT APIs::
* Fix numeric sorts in `_cat/nodes` {es-pull}106189[#106189] (issue: {es-issue}48070[#48070])

CCR::
* Add ?master_timeout query parameter to ccr apis {es-pull}105168[#105168]

CRUD::
* Fix `noop_update_total` is not being updated when using the `_bulk` {es-pull}105745[#105745] (issue: {es-issue}105742[#105742])
* Use correct system index bulk executor {es-pull}106150[#106150]

Cluster Coordination::
* Fix support for infinite `?master_timeout` {es-pull}107050[#107050]

Data streams::
* Add non-indexed fields to ecs templates {es-pull}106714[#106714]
* Fix bulk NPE when retrying failure redirect after cluster block {es-pull}107598[#107598]
* Improve error message when rolling over DS alias {es-pull}106708[#106708] (issue: {es-issue}106137[#106137])
* Only skip deleting a downsampled index if downsampling is in progress as part of DSL retention {es-pull}109020[#109020]

Downsampling::
* Fix downsample action request serialization {es-pull}106919[#106919] (issue: {es-issue}106917[#106917])

EQL::
* Use #addWithoutBreaking when adding a negative number of bytes to the circuit breaker in `SequenceMatcher` {es-pull}107655[#107655]

ES|QL::
* ESQL: Allow reusing BUCKET grouping expressions in aggs {es-pull}107578[#107578]
* ESQL: Disable quoting in FROM command {es-pull}108431[#108431]
* ESQL: Fix MV_DEDUPE when using data from an index {es-pull}107577[#107577] (issue: {es-issue}104745[#104745])
* ESQL: Fix error message when failing to resolve aggregate groupings {es-pull}108101[#108101] (issue: {es-issue}108053[#108053])
* ESQL: Fix treating all fields as MV in COUNT pushdown {es-pull}106720[#106720]
* ESQL: Re-enable logical dependency check {es-pull}105860[#105860]
* ESQL: median, count and `count_distinct` over constants {es-pull}107414[#107414] (issues: {es-issue}105248[#105248], {es-issue}104900[#104900])
* ES|QL fix no-length substring with supplementary (4-byte) character {es-pull}107183[#107183]
* ES|QL: Fix usage of IN operator with TEXT fields {es-pull}106654[#106654] (issue: {es-issue}105379[#105379])
* ES|QL: Improve support for TEXT fields in functions {es-pull}106810[#106810]
* Fix docs generation of signatures for variadic functions {es-pull}107865[#107865]
* [ESQL] Mark `date_diff` as requiring all three arguments {es-pull}108834[#108834] (issue: {es-issue}108383[#108383])

Health::
* Don't stop checking if the `HealthNode` persistent task is present {es-pull}105449[#105449] (issue: {es-issue}98926[#98926])
* Health monitor concurrency fixes {es-pull}105674[#105674] (issue: {es-issue}105065[#105065])

Highlighting::
* Check preTags and postTags params for empty values {es-pull}106396[#106396] (issue: {es-issue}69009[#69009])
* added fix for inconsistent text trimming in Unified Highlighter {es-pull}99961[#99961] (issue: {es-issue}101803[#101803])

Infra/CLI::
* Workaround G1 bug for JDK 22 and 22.0.1 {es-pull}108571[#108571]

Infra/Core::
* Add a check for the same feature being declared regular and historical {es-pull}106285[#106285]
* Fix `AffixSetting.exists` to include secure settings {es-pull}106745[#106745]
* Fix regression in get index settings (human=true) where the version was not displayed in human-readable format {es-pull}107447[#107447]
* Nativeaccess: try to load all located libsystemds {es-pull}108238[#108238] (issue: {es-issue}107878[#107878])
* Update several references to `IndexVersion.toString` to use `toReleaseVersion` {es-pull}107828[#107828] (issue: {es-issue}107821[#107821])
* Update several references to `TransportVersion.toString` to use `toReleaseVersion` {es-pull}107902[#107902]

Infra/Logging::
* Log when update AffixSetting using addAffixMapUpdateConsumer {es-pull}97072[#97072]

Infra/Node Lifecycle::
* Consider `ShardRouting` roles when calculating shard copies in shutdown status {es-pull}106063[#106063]
* Wait indefintely for http connections on shutdown by default {es-pull}106511[#106511]

Infra/Scripting::
* Guard against a null scorer in painless execute {es-pull}109048[#109048] (issue: {es-issue}43541[#43541])
* Painless: Apply true regex limit factor with FIND and MATCH operation {es-pull}105670[#105670]

Ingest Node::
* Catching `StackOverflowErrors` from bad regexes in `GsubProcessor` {es-pull}106851[#106851]
* Fix `uri_parts` processor behaviour for missing extensions {es-pull}105689[#105689] (issue: {es-issue}105612[#105612])
* Remove leading is_ prefix from Enterprise geoip docs {es-pull}108518[#108518]
* Slightly better geoip `databaseType` validation {es-pull}106889[#106889]

License::
* Fix lingering license warning header {es-pull}108031[#108031] (issue: {es-issue}107573[#107573])

Machine Learning::
* Fix NPE in ML assignment notifier {es-pull}107312[#107312]
* Fix `startOffset` must be non-negative error in XLMRoBERTa tokenizer {es-pull}107891[#107891] (issue: {es-issue}104626[#104626])
* Fix the position of spike, dip and distribution changes bucket when the sibling aggregation includes empty buckets {es-pull}106472[#106472]
* Make OpenAI embeddings parser more flexible {es-pull}106808[#106808]

Mapping::
* Dedupe terms in terms queries {es-pull}106381[#106381]
* Extend support of `allowedFields` to `getMatchingFieldNames` and `getAllFields` {es-pull}106862[#106862]
* Fix for raw mapping merge of fields named "properties" {es-pull}108867[#108867] (issue: {es-issue}108866[#108866])
* Handle infinity during synthetic source construction for scaled float field {es-pull}107494[#107494] (issue: {es-issue}107101[#107101])
* Handle pass-through subfields with deep nesting {es-pull}106767[#106767]
* Wrap "Pattern too complex" exception into an `IllegalArgumentException` {es-pull}109173[#109173]

Network::
* Fix HTTP corner-case response leaks {es-pull}105617[#105617]

Search::
* Add `internalClusterTest` for and fix leak in `ExpandSearchPhase` {es-pull}108562[#108562] (issue: {es-issue}108369[#108369])
* Avoid attempting to load the same empty field twice in fetch phase {es-pull}107551[#107551]
* Bugfix: Disable eager loading `BitSetFilterCache` on Indexing Nodes {es-pull}105791[#105791]
* Cross-cluster painless/execute actions should check permissions only on target remote cluster {es-pull}105360[#105360]
* Fix error 500 on invalid `ParentIdQuery` {es-pull}105693[#105693] (issue: {es-issue}105366[#105366])
* Fix range queries for float/half_float fields when bounds are out of type's range {es-pull}106691[#106691]
* Fixing NPE when requesting [_none_] for `stored_fields` {es-pull}104711[#104711]
* Fork when handling remote field-caps responses {es-pull}107370[#107370]
* Handle parallel calls to `createWeight` when profiling is on {es-pull}108041[#108041] (issues: {es-issue}104131[#104131], {es-issue}104235[#104235])
* Harden field-caps request dispatcher {es-pull}108736[#108736]
* Replace `UnsupportedOperationException` with `IllegalArgumentException` for non-existing columns {es-pull}107038[#107038]
* Unable to retrieve multiple stored field values {es-pull}106575[#106575]
* Validate `model_id` is required when using the `learning_to_rank` rescorer {es-pull}107743[#107743]

Security::
* Disable validate when rewrite parameter is sent and the index access control list is non-null {es-pull}105709[#105709]
* Fix field caps and field level security {es-pull}106731[#106731]

Snapshot/Restore::
* Fix double-pausing shard snapshot {es-pull}109148[#109148] (issue: {es-issue}109143[#109143])
* Treat 404 as empty register in `AzureBlobStore` {es-pull}108900[#108900] (issue: {es-issue}108504[#108504])
* `SharedBlobCacheService.maybeFetchRegion` should use `computeCacheFileRegionSize` {es-pull}106685[#106685]

TSDB::
* Flip dynamic mapping condition when create tsid {es-pull}105636[#105636]

Transform::
* Consolidate permissions checks {es-pull}106413[#106413] (issue: {es-issue}105794[#105794])
* Disable PIT for remote clusters {es-pull}107969[#107969]
* Make force-stopping the transform always remove persistent task from cluster state {es-pull}106989[#106989] (issue: {es-issue}106811[#106811])
* Only trigger action once per thread {es-pull}107232[#107232] (issue: {es-issue}107215[#107215])
* [Transform] Auto retry Transform start {es-pull}106243[#106243]

Vector Search::
* Fix multithreading copies in lib vec {es-pull}108802[#108802]
* [8.14] Fix multithreading copies in lib vec {es-pull}108810[#108810]

[[deprecation-8.14.0]]
[float]
=== Deprecations

Mapping::
* Deprecate allowing `fields` in scenarios where it is ignored {es-pull}106031[#106031]

[[enhancement-8.14.0]]
[float]
=== Enhancements

Aggregations::
* Add a `PriorityQueue` backed by `BigArrays` {es-pull}106361[#106361]
* All new `shard_seed` parameter for `random_sampler` agg {es-pull}104830[#104830]

Allocation::
* Add allocation stats {es-pull}105894[#105894]
* Add index forecasts to /_cat/allocation output {es-pull}97561[#97561]

Application::
* [Profiling] Add TopN Functions API {es-pull}106860[#106860]
* [Profiling] Allow to override index settings {es-pull}106172[#106172]
* [Profiling] Speed up serialization of flamegraph {es-pull}105779[#105779]

Authentication::
* Support Profile Activate with JWTs with client authn {es-pull}105439[#105439] (issue: {es-issue}105342[#105342])

Authorization::
* Allow users to get status of own async search tasks {es-pull}106638[#106638]
* [Security Solution] Add `read` permission for third party agent indices for `kibana_system` {es-pull}107046[#107046]

Data streams::
* Add data stream lifecycle to kibana reporting template {es-pull}106259[#106259]

ES|QL::
* Add ES|QL Locate function {es-pull}106899[#106899] (issue: {es-issue}106818[#106818])
* Add ES|QL signum function {es-pull}106866[#106866]
* Add status for enrich operator {es-pull}106036[#106036]
* Add two new OGC functions ST_X and ST_Y {es-pull}105768[#105768]
* Adjust array resizing in block builder {es-pull}106934[#106934]
* Bulk loading enrich fields in ESQL {es-pull}106796[#106796]
* ENRICH support for TEXT fields {es-pull}106435[#106435] (issue: {es-issue}105384[#105384])
* ESQL: Add timers to many status results {es-pull}105421[#105421]
* ESQL: Allow grouping key inside stats expressions {es-pull}106579[#106579]
* ESQL: Introduce expression validation phase {es-pull}105477[#105477] (issue: {es-issue}105425[#105425])
* ESQL: Log queries at debug level {es-pull}108257[#108257]
* ESQL: Regex improvements {es-pull}106429[#106429]
* ESQL: Sum of constants {es-pull}105454[#105454]
* ESQL: Support ST_DISJOINT {es-pull}107007[#107007]
* ESQL: Support partially folding CASE {es-pull}106094[#106094]
* ESQL: Use faster field caps {es-pull}105067[#105067]
* ESQL: extend BUCKET with spans {es-pull}107272[#107272]
* ESQL: perform a reduction on the data node {es-pull}106516[#106516]
* Expand support for ENRICH to full set supported by ES ingest processors {es-pull}106186[#106186] (issue: {es-issue}106162[#106162])
* Introduce ordinal bytesref block {es-pull}106852[#106852] (issue: {es-issue}106387[#106387])
* Leverage ordinals in enrich lookup {es-pull}107449[#107449]
* Serialize big array blocks {es-pull}106373[#106373]
* Serialize big array vectors {es-pull}106327[#106327]
* Specialize serialization for `ArrayVectors` {es-pull}105893[#105893]
* Specialize serialization of array blocks {es-pull}106102[#106102]
* Speed up serialization of `BytesRefArray` {es-pull}106053[#106053]
* Support ST_CONTAINS and ST_WITHIN {es-pull}106503[#106503]
* Support ST_INTERSECTS between geometry column and other geometry or string {es-pull}104907[#104907] (issue: {es-issue}104874[#104874])

Engine::
* Add metric for calculating index flush time excluding waiting on locks {es-pull}107196[#107196]

Highlighting::
* Enable 'encoder' and 'tags_schema' highlighting settings at field level {es-pull}107224[#107224] (issue: {es-issue}94028[#94028])

ILM+SLM::
* Add a flag to re-enable writes on the final index after an ILM shrink action. {es-pull}107121[#107121] (issue: {es-issue}106599[#106599])

Indices APIs::
* Wait forever for `IndexTemplateRegistry` asset installation {es-pull}105985[#105985]

Infra/CLI::
* Enhance search tier GC options {es-pull}106526[#106526]
* Increase KDF iteration count in `KeyStoreWrapper` {es-pull}107107[#107107]

Infra/Core::
* Add pluggable `BuildVersion` in `NodeMetadata` {es-pull}105757[#105757]

Infra/Metrics::
* Infrastructure for metering the update requests {es-pull}105063[#105063]
* `DocumentParsingObserver` to accept an `indexName` to allow skipping system indices {es-pull}107041[#107041]

Infra/Scripting::
* String sha512() painless function {es-pull}99048[#99048] (issue: {es-issue}97691[#97691])

Ingest Node::
* Add support for the 'Anonymous IP' database to the geoip processor {es-pull}107287[#107287] (issue: {es-issue}90789[#90789])
* Add support for the 'Enterprise' database to the geoip processor {es-pull}107377[#107377]
* Adding `cache_stats` to geoip stats API {es-pull}107334[#107334]
* Support data streams in enrich policy indices {es-pull}107291[#107291] (issue: {es-issue}98836[#98836])

Machine Learning::
* Add GET `_inference` for all inference endpoints {es-pull}107517[#107517]
* Added a timeout parameter to the inference API {es-pull}107242[#107242]
* Enable retrying on 500 error response from Cohere text embedding API {es-pull}105797[#105797]

Mapping::
* Make int8_hnsw our default index for new dense-vector fields {es-pull}106836[#106836]

Ranking::
* Add retrievers using the parser-only approach {es-pull}105470[#105470]

Search::
* Add Lucene spanish plural stemmer {es-pull}106952[#106952]
* Add `modelId` and `modelText` to `KnnVectorQueryBuilder` {es-pull}106068[#106068]
* Add a SIMD (Neon) optimised vector distance function for int8 {es-pull}106133[#106133]
* Add transport version for search load autoscaling {es-pull}106377[#106377]
* CCS with `minimize_roundtrips` performs incremental merges of each `SearchResponse` {es-pull}105781[#105781]
* Track ongoing search tasks {es-pull}107129[#107129]

Security::
* Invalidating cross cluster API keys requires `manage_security` {es-pull}107411[#107411]
* Show owner `realm_type` for returned API keys {es-pull}105629[#105629]

Snapshot/Restore::
* Add setting for max connections to S3 {es-pull}107533[#107533]
* Distinguish different snapshot failures by log level {es-pull}105622[#105622]

Stats::
* (API+) CAT Nodes alias for shard header to match CAT Allocation {es-pull}105847[#105847]
* Add total size in bytes to doc stats {es-pull}106840[#106840] (issue: {es-issue}97670[#97670])

TSDB::
* Improve short-circuiting downsample execution {es-pull}106563[#106563]
* Support non-keyword dimensions as routing fields in TSDB {es-pull}105501[#105501]
* Text fields are stored by default in TSDB indices {es-pull}106338[#106338] (issue: {es-issue}97039[#97039])

Transform::
* Check node shutdown before fail {es-pull}107358[#107358] (issue: {es-issue}100891[#100891])
* Do not log error on node restart when the transform is already failed {es-pull}106171[#106171] (issue: {es-issue}106168[#106168])

[[feature-8.14.0]]
[float]
=== New features

Application::
* Allow `typed_keys` for search application Search API {es-pull}108007[#108007]
* [Connector API] Support cleaning up sync jobs when deleting a connector {es-pull}107253[#107253]

ES|QL::
* ESQL: Values aggregation function {es-pull}106065[#106065] (issue: {es-issue}103600[#103600])
* ESQL: allow sorting by expressions and not only regular fields {es-pull}107158[#107158]
* Support ES|QL requests through the `NodeClient::execute` {es-pull}106244[#106244]

Indices APIs::
* Add granular error list to alias action response {es-pull}106514[#106514] (issue: {es-issue}94478[#94478])

Machine Learning::
* Add Cohere rerank to `_inference` service {es-pull}106378[#106378]
* Add support for Azure OpenAI embeddings to inference service {es-pull}107178[#107178]
* Create default word based chunker {es-pull}107303[#107303]
* Text structure endpoints to determine the structure of a list of messages and of an indexed field {es-pull}105660[#105660]

Mapping::
* Flatten object mappings when subobjects is false {es-pull}103542[#103542] (issues: {es-issue}99860[#99860], {es-issue}103497[#103497])

Security::
* Get and Query API Key with profile uid {es-pull}106531[#106531]

Vector Search::
* Adding support for hex-encoded byte vectors on knn-search {es-pull}105393[#105393]

[[upgrade-8.14.0]]
[float]
=== Upgrades

Infra/Core::
* Upgrade jna to 5.12.1 {es-pull}105717[#105717]

Ingest Node::
* Updating the tika version to 2.9.1 in the ingest attachment plugin {es-pull}106315[#106315]

Network::
* Upgrade to Netty 4.1.107 {es-pull}105517[#105517]

Packaging::
* Update bundled JDK to Java 22 (again) {es-pull}108654[#108654]