kibana/x-pack/plugins
Kibana Machine ba5a8fc816
[8.x] [APM][Otel] Use `fields` instead of `_source` on APM queries (#195242) (#196265)
# Backport

This will backport the following commits from `main` to `8.x`:
- [[APM][Otel] Use `fields` instead of `_source` on
APM queries (#195242)](https://github.com/elastic/kibana/pull/195242)

<!--- Backport version: 9.4.3 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sqren/backport)

<!--BACKPORT [{"author":{"name":"Carlos
Crespo","email":"crespocarlos@users.noreply.github.com"},"sourceCommit":{"committedDate":"2024-10-15T09:38:44Z","message":"[APM][Otel]
Use `fields` instead of `_source` on APM queries (#195242)\n\ncloses
https://github.com/elastic/kibana/issues/192606\r\n\r\n##
Summary\r\n\r\nv2 based on the work done in this
PR\r\nhttps://github.com/elastic/kibana/pull/192608 and the suggestion
from\r\nDario https://github.com/elastic/kibana/pull/194424\r\n\r\nThis
PR replaces the _source usage in APM queries with fields to
support\r\nOtel data. The idea is to get rid of existing UI errors we
have and make\r\nsure that otel data is shown correctly in the
UI.\r\n\r\nOne way to check it is using the
[e2e\r\nPoC](https://github.com/elastic/otel-apm-e2e-poc/blob/main/README.md).\r\n\r\n---------\r\n\r\nCo-authored-by:
kibanamachine
<42973632+kibanamachine@users.noreply.github.com>\r\nCo-authored-by:
Elastic Machine
<elasticmachine@users.noreply.github.com>\r\nCo-authored-by: Jenny
<dzheni.pavlova@elastic.co>","sha":"7235ed0425100bbf04ff157d0af7980875473c99","branchLabelMapping":{"^v9.0.0$":"main","^v8.16.0$":"8.x","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:fix","v9.0.0","apm","apm:opentelemetry","backport:prev-minor","ci:project-deploy-observability","Team:obs-ux-infra_services"],"title":"[APM][Otel]
Use `fields` instead of `_source` on APM
queries","number":195242,"url":"https://github.com/elastic/kibana/pull/195242","mergeCommit":{"message":"[APM][Otel]
Use `fields` instead of `_source` on APM queries (#195242)\n\ncloses
https://github.com/elastic/kibana/issues/192606\r\n\r\n##
Summary\r\n\r\nv2 based on the work done in this
PR\r\nhttps://github.com/elastic/kibana/pull/192608 and the suggestion
from\r\nDario https://github.com/elastic/kibana/pull/194424\r\n\r\nThis
PR replaces the _source usage in APM queries with fields to
support\r\nOtel data. The idea is to get rid of existing UI errors we
have and make\r\nsure that otel data is shown correctly in the
UI.\r\n\r\nOne way to check it is using the
[e2e\r\nPoC](https://github.com/elastic/otel-apm-e2e-poc/blob/main/README.md).\r\n\r\n---------\r\n\r\nCo-authored-by:
kibanamachine
<42973632+kibanamachine@users.noreply.github.com>\r\nCo-authored-by:
Elastic Machine
<elasticmachine@users.noreply.github.com>\r\nCo-authored-by: Jenny
<dzheni.pavlova@elastic.co>","sha":"7235ed0425100bbf04ff157d0af7980875473c99"}},"sourceBranch":"main","suggestedTargetBranches":[],"targetPullRequestStates":[{"branch":"main","label":"v9.0.0","branchLabelMappingKey":"^v9.0.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/195242","number":195242,"mergeCommit":{"message":"[APM][Otel]
Use `fields` instead of `_source` on APM queries (#195242)\n\ncloses
https://github.com/elastic/kibana/issues/192606\r\n\r\n##
Summary\r\n\r\nv2 based on the work done in this
PR\r\nhttps://github.com/elastic/kibana/pull/192608 and the suggestion
from\r\nDario https://github.com/elastic/kibana/pull/194424\r\n\r\nThis
PR replaces the _source usage in APM queries with fields to
support\r\nOtel data. The idea is to get rid of existing UI errors we
have and make\r\nsure that otel data is shown correctly in the
UI.\r\n\r\nOne way to check it is using the
[e2e\r\nPoC](https://github.com/elastic/otel-apm-e2e-poc/blob/main/README.md).\r\n\r\n---------\r\n\r\nCo-authored-by:
kibanamachine
<42973632+kibanamachine@users.noreply.github.com>\r\nCo-authored-by:
Elastic Machine
<elasticmachine@users.noreply.github.com>\r\nCo-authored-by: Jenny
<dzheni.pavlova@elastic.co>","sha":"7235ed0425100bbf04ff157d0af7980875473c99"}}]}]
BACKPORT-->

Co-authored-by: Carlos Crespo <crespocarlos@users.noreply.github.com>
2024-10-15 06:27:04 -05:00
..
actions [8.x] [Connectors][GenAI] Inference Service Kibana connector (#189027) (#196035) 2024-10-13 17:21:49 -05:00
aiops [8.x] [ML] Adds ability to toggle visibility for empty fields when choosing an aggregation or field in Anomaly detection, data frame analytics (#186670) (#196180) 2024-10-14 13:14:58 -05:00
alerting [8.x] Update dependency @types/lodash to ^4.17.10 (main) (#194739) (#196234) 2024-10-15 04:11:15 -05:00
banners
canvas [8.x] Update dependency @types/lodash to ^4.17.10 (main) (#194739) (#196234) 2024-10-15 04:11:15 -05:00
cases skip flaky suite (#193482) 2024-10-14 18:04:50 +01:00
cloud [8.x] Allow elasticsearch.publicBaseUrl to be set using an environment variable (#193716) (#193860) 2024-09-24 16:19:34 +02:00
cloud_defend [8.x] [licensing] Remove unnecessary refresh calls (#194499) (#194855) 2024-10-03 12:30:09 -05:00
cloud_integrations [8.x] Clean up &#x60;cloud_chat&#x60; (#194571) (#194818) 2024-10-03 09:12:16 -05:00
cloud_security_posture [8.x] [Cloud Security] Only adding &#x60;safe_posture_type&#x60; to native csp findings (#196064) (#196200) 2024-10-14 15:29:29 -05:00
cross_cluster_replication [8.x] Remove kbn-ace, ace and brace dependencies (#195703) (#195765) 2024-10-11 11:17:21 +01:00
custom_branding
dashboard_enhanced [8.x] chore(tsconfig): uncomment option &#x60;moduleDetection&#x60; (#191834) (#193481) 2024-09-20 05:24:14 -05:00
data_quality [8.x] [Dataset Quality] Introduce Kibana Management Feature (#194825) (#196266) 2024-10-15 06:26:45 -05:00
data_usage [8.x] [DataUsage][Serverless] Data usage metrics page enhancements (#195556) (#196202) 2024-10-14 16:01:38 -05:00
data_visualizer [8.x] [ML] Data visualizer: Add icons for semantic text, sparse vector and dense vector (#196069) (#196238) 2024-10-15 04:47:55 -05:00
discover_enhanced
drilldowns
ecs_data_quality_dashboard [8.x] [Secuity Solution][DQD] add historical results (Phase 1) (#191898) (#195962) 2024-10-11 13:02:33 -05:00
elastic_assistant [8.x] [Security Assistant] Fix error handling on new chat (#195507) (#196215) 2024-10-14 18:54:33 -05:00
embeddable_enhanced [Dashboard] Remove library and drilldown notifications (#190797) 2024-09-09 14:11:15 -07:00
encrypted_saved_objects [8.x] chore(security, eslint): apply platform security-specific rules to all exclusively owned paths. (#195711) (#196010) 2024-10-12 11:19:03 -04:00
enterprise_search [8.x] fix: [Stateful: Indices page] Wrong navigation and announcements for Available indices table (#196141) (#196181) 2024-10-14 13:08:06 -05:00
entity_manager [8.x] [SecuritySolution] Load entity store indices from security solution data view (#195862) (#196209) 2024-10-15 06:14:35 -05:00
event_log [8.x] [Response Ops][Event Log] Updating event log mappings if data stream and index template already exist (#193205) (#193589) 2024-09-20 10:30:32 -05:00
features [8.x] feat: allow plugins to deprecate and replace features and feature privileges (#186800) (#196204) 2024-10-15 10:12:15 +02:00
fields_metadata [8.x] [Fields Metadata] Improve integration fields resolution and caching (#195405) (#196086) 2024-10-14 06:58:01 -05:00
file_upload [8.x] [ML] Fix file upload when pipline is used (#194273) (#194334) 2024-09-27 13:59:57 -05:00
fleet [8.x] Endpoint package policy advanced options for v8.16.0 (#195797) (#196151) 2024-10-14 11:14:46 -05:00
global_search Minimize shared-common everywhere (#188606) 2024-07-29 12:47:46 -06:00
global_search_bar [8.x] [Global Search, Saved Objects Management] Use new parse option to specify recognized fields (#190464) (#193448) 2024-09-19 12:35:12 -05:00
global_search_providers
graph [8.x] Added scope field to features config. (#191634) (#193389) 2024-09-19 10:42:43 -05:00
grokdebugger
index_lifecycle_management [8.x] Update dependency @types/lodash to ^4.17.10 (main) (#194739) (#196234) 2024-10-15 04:11:15 -05:00
index_management [8.x] [Index management] Add locator for deep linking into datastreams flyout (#195299) (#196123) 2024-10-14 08:47:57 -05:00
inference [8.x] [Simulated function calling] specify that only one tool call can be performed at a time (#193556) (#193627) 2024-09-20 14:58:52 -05:00
ingest_pipelines [react@18] More breaking type fixes (should be the last pr) (#192266) 2024-09-12 13:54:18 +02:00
integration_assistant [8.x] [Auto Import] CSV format support (#194386) (#196090) 2024-10-14 07:16:35 -05:00
kubernetes_security Upgrade @testing-library/user-event to latest ^14.5.2 (#189949) 2024-09-10 14:31:27 +02:00
lens [8.x] [Lens] Disable config axis side and color picker when groupid is breakdown and collaseFn enable (#195845) (#196247) 2024-10-15 05:03:48 -05:00
license_api_guard
license_management [8.x] Upgrade EUI to v97.0.0 (#195525) (#196116) 2024-10-14 08:31:39 -05:00
licensing [8.x] [licensing] Remove unnecessary refresh calls (#194499) (#194855) 2024-10-03 12:30:09 -05:00
lists [8.x] [Security Solution][Detection Engine] Avoid creating list items for empty lines in import list API (#192681) (#194470) 2024-09-30 14:37:00 -05:00
logstash [8.x] [HTTP] Set explicit access for &#x60;public&#x60; HTTP APIs 2 (#192579) (#193938) 2024-09-25 04:01:15 -05:00
maps [8.x] Update dependency @types/lodash to ^4.17.10 (main) (#194739) (#196234) 2024-10-15 04:11:15 -05:00
ml [8.x] Update dependency @types/lodash to ^4.17.10 (main) (#194739) (#196234) 2024-10-15 04:11:15 -05:00
monitoring [8.x] Update dependency @types/lodash to ^4.17.10 (main) (#194739) (#196234) 2024-10-15 04:11:15 -05:00
monitoring_collection Migrate codebase to use Object.hasOwn instead of Object.hasOwnProperty (#186829) 2024-08-13 10:30:19 -05:00
notifications docs: updates notifications README (#189930) 2024-08-06 09:42:56 +02:00
observability_solution [8.x] [APM][Otel] Use &#x60;fields&#x60; instead of &#x60;_source&#x60; on APM queries (#195242) (#196265) 2024-10-15 06:27:04 -05:00
osquery [8.x] [HTTP/OAS] Include Security Solution domain OAS to production docs (#194132) (#195221) 2024-10-07 09:29:06 -07:00
painless_lab Additional validation for painless test (#190226) 2024-08-13 17:13:42 +03:00
remote_clusters [8.x] [Remote clusters] Per cluster status call (#194420) (#195290) 2024-10-07 13:04:58 -05:00
reporting [8.x] [Reporting] Improvements to reporting diagnostics (#191790) (#195225) 2024-10-07 07:39:30 -05:00
rollup [8.x] chore(tsconfig): uncomment option &#x60;moduleDetection&#x60; (#191834) (#193481) 2024-09-20 05:24:14 -05:00
rule_registry [8.x] Execution type field (#195884) (#196152) 2024-10-14 11:20:53 -05:00
runtime_fields Upgrade prettier dependencies (#188032) 2024-07-24 17:29:05 +01:00
saved_objects_tagging [8.x] Added scope field to features config. (#191634) (#193389) 2024-09-19 10:42:43 -05:00
screenshotting [8.x] [Reporting] update puppeteer to version 23.3.1 (#192345) (#193357) 2024-09-19 08:10:51 -05:00
search_assistant [8.x] [Search Assistant] Use scopes to modify behavior contextually (#195785) (#196014) 2024-10-12 10:42:43 -05:00
search_connectors [8.x] [Search] Update search integrations (#195628) (#196058) 2024-10-14 12:59:15 +02:00
search_homepage [8.x] [Search][Homepage] Remove usage (#194870) (#195137) 2024-10-04 15:16:52 -05:00
search_indices [8.x] [Onboarding] only update the index details page when plugin is enabled (#196077) (#196121) 2024-10-14 09:02:07 -05:00
search_inference_endpoints [8.x] [Search] Delete flow inference endpoint UI (#193642) (#196154) 2024-10-14 11:20:09 -05:00
search_notebooks [8.x] search_notebooks: update notebooks Oct 1, 2024 (8.16) (#194603) (#194747) 2024-10-02 13:36:19 -05:00
search_playground [8.x] [Epic] AI Insights + Assistant - Add &quot;Other&quot; option to the existing OpenAI Connector dropdown list (#8936) (#194831) (#195688) 2024-10-10 01:56:19 +02:00
searchprofiler [8.x] [Search profiler] Migrate ace to monaco (#195343) (#195724) 2024-10-10 13:01:25 +02:00
security [8.x] feat: allow plugins to deprecate and replace features and feature privileges (#186800) (#196204) 2024-10-15 10:12:15 +02:00
security_solution [8.x] [SecuritySolution] Load entity store indices from security solution data view (#195862) (#196209) 2024-10-15 06:14:35 -05:00
security_solution_ess [8.x] [Security Solution] Onboarding redesign (#192247) (#195979) 2024-10-11 16:24:14 -05:00
security_solution_serverless [8.x] [Security Solution] Onboarding redesign (#192247) (#195979) 2024-10-11 16:24:14 -05:00
serverless
serverless_observability [8.x] Remember tab choice between logs explorer and discover (#194930) (#196068) 2024-10-14 06:16:05 -05:00
serverless_search [8.x] [Search][Onboarding] Enable search indices &amp; gate with a feature flag (#195802) (#195972) 2024-10-11 14:04:10 -05:00
session_view [8.x] Update dependency @types/lodash to ^4.17.10 (main) (#194739) (#196234) 2024-10-15 04:11:15 -05:00
snapshot_restore Upgrade EUI to v95.9.0 (#190752) 2024-08-30 17:47:17 -07:00
spaces [8.x] feat: allow plugins to deprecate and replace features and feature privileges (#186800) (#196204) 2024-10-15 10:12:15 +02:00
stack_alerts [8.x] Update dependency @types/lodash to ^4.17.10 (main) (#194739) (#196234) 2024-10-15 04:11:15 -05:00
stack_connectors [8.x] [Connectors][GenAI] Inference Service Kibana connector (#189027) (#196035) 2024-10-13 17:21:49 -05:00
task_manager [8.x] [Response Ops][Task Manager] Stop polling on Kibana shutdown (#195415) (#196159) 2024-10-14 11:59:27 -05:00
telemetry_collection_xpack [8.x] [Epic] AI Insights + Assistant - Add &quot;Other&quot; option to the existing OpenAI Connector dropdown list (#8936) (#194831) (#195688) 2024-10-10 01:56:19 +02:00
threat_intelligence [Security Solution] remove old and skipped Threat Intelligence Cypress tests (#191166) 2024-09-12 08:59:56 -05:00
timelines [Security Solution][Alert details] - finish cleanup of old event_details folder (#190119) 2024-08-28 10:47:57 -05:00
transform [8.x] [ML] Transforms: Pagination in the source documents data grid fix (#196119) (#196163) 2024-10-14 12:00:51 -05:00
translations [8.x] [Observability Onboarding] Update onboarding landing page (#194565) (#195329) 2024-10-15 04:32:49 -05:00
triggers_actions_ui [8.x] Upgrade EUI to v97.0.0 (#195525) (#196116) 2024-10-14 08:31:39 -05:00
upgrade_assistant [react@18] More breaking type fixes (should be the last pr) (#192266) 2024-09-12 13:54:18 +02:00
watcher [8.x] [Watcher] Fix code scanning alert (#194564) (#194913) 2024-10-04 05:01:56 -05:00