Commit graph

4827 commits

Author SHA1 Message Date
Kurt
8e7799ae7a
Removing experimental for the FIPS mode config (#200734)
## Summary

Closes https://github.com/elastic/kibana/issues/200718

Remove the `experimental` from the fipsMode config path

## Release note

Kibana's FIPS mode is no longer considered experimental

## FIPS Pipeline for this branch

https://buildkite.com/elastic/kibana-fips/builds/281
2024-11-19 15:23:20 -05:00
Pierre Gayvallet
455c781c6d
[LLM tasks] Add product documentation retrieval task (#194379)
## Summary

Close https://github.com/elastic/kibana/issues/193473
Close https://github.com/elastic/kibana/issues/193474

This PR utilize the documentation packages that are build via the tool
introduced by https://github.com/elastic/kibana/pull/193847, allowing to
install them in Kibana and expose documentation retrieval as an LLM task
that AI assistants (or other consumers) can call.

Users can now decide to install the Elastic documentation from the
assistant's config screen, which will expose a new tool for the
assistant, `retrieve_documentation` (only implemented for the o11y
assistant in the current PR, shall be done for security as a follow up).

For more information, please refer to the self-review.

## General architecture

<img width="1118" alt="Screenshot 2024-10-17 at 09 22 32"
src="https://github.com/user-attachments/assets/3df8c30a-9ccc-49ab-92ce-c204b96d6fc4">

## What this PR does

Adds two plugin:
- `productDocBase`: contains all the logic related to product
documentation installation, status, and search. This is meant to be a
"low level" components only responsible for this specific part.
- `llmTasks`: an higher level plugin that will contain various LLM tasks
to be used by assistants and genAI consumers. The intent is not to have
a single place to put all llm tasks, but more to have a default place
where we can introduce new tasks from. (fwiw, the `nlToEsql` task will
probably be moved to that plugin).

- Add a `retrieve_documentation` tool registration for the o11y
assistant
- Add a component on the o11y assistant configuration page to install
the product doc

(wiring the feature to the o11y assistant was done for testing purposes
mostly, any addition / changes / enhancement should be done by the
owning team - either in this PR or as a follow-up)

## What is NOT included in this PR:

- Wire product base feature to the security assistant (should be done by
the owning team as a follow-up)
  - installation
  - utilization as tool

- FTR tests: this is somewhat blocked by the same things we need to
figure out for https://github.com/elastic/kibana-team/issues/1271

## Screenshots 

### Installation from o11y assistant configuration page

<img width="1476" alt="Screenshot 2024-10-17 at 09 41 24"
src="https://github.com/user-attachments/assets/31daa585-9fb2-400a-a2d1-5917a262367a">

### Example of output

#### Without product documentation installed 

<img width="739" alt="Screenshot 2024-10-10 at 09 59 41"
src="https://github.com/user-attachments/assets/993fb216-6c9a-433f-bf44-f6e383d20d9d">

#### With product documentation installed

<img width="718" alt="Screenshot 2024-10-10 at 09 55 38"
src="https://github.com/user-attachments/assets/805ea4ca-8bc9-4355-a434-0ba81f8228a9">

---------

Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
Co-authored-by: Alex Szabo <alex.szabo@elastic.co>
Co-authored-by: Matthias Wilhelm <matthias.wilhelm@elastic.co>
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2024-11-19 08:28:26 -06:00
Jeramy Soucy
742ae9fd2a
Surface Kibana security route deprecations in Upgrade Assistant (#199656)
Closes #197389

## Summary

Uses the `deprecated` route configuration option on all Kibana Security
"v1" endpoints. This will surface deprecation information in the Upgrade
Assistant.

## Related PRs
- https://github.com/elastic/kibana/pull/50695 - `7.6.0`, deprecated
    - `/api/security/v1/me`
    - `/api/security/v1/logout`
    - `/api/security/v1/oidc/implicit`
    - `/api/security/v1/oidc` (POST)
- https://github.com/elastic/kibana/pull/53886 - `7.6.0`, deprecated
`/api/security/v1/oidc` (GET)
- https://github.com/elastic/kibana/pull/47929 - `8.0.0`, dropped
`/api/security/v1/saml` (`breaking` release note)
- https://github.com/elastic/kibana/pull/106665 - restored
`/api/security/v1/saml` but warned as deprecated (no release note)

## Testing
1.  Start ES & Kibana in trial license mode
2. Make several calls to one or more of the deprecated endpoints
3. Navigate to `Stack Management`->`Upgrade Assistant`
4. Click on Kibana warnings
<img width="1003" alt="Screenshot 2024-11-18 at 10 01 10 AM"
src="https://github.com/user-attachments/assets/da44af13-57eb-4ffd-a507-e423eb767a11">
5. Confirm the called endpoints are displayed as warnings in the Upgrade
Assistant
<img width="1274" alt="Screenshot 2024-11-18 at 9 59 34 AM"
src="https://github.com/user-attachments/assets/4c054fbe-6838-48cf-8b1b-8c161252db0f">

## Previous release notes 
### v7.6.0

https://www.elastic.co/guide/en/kibana/7.6/release-notes-7.6.0.html#deprecation-7.6.0
https://www.elastic.co/guide/en/kibana/7.6/breaking-changes-7.6.html
The deprecations are not listed in the release notes or breaking changes
notes.

### v8.0.0

https://www.elastic.co/guide/en/kibana/current/release-notes-8.0.0-alpha1.html#rest-api-changes
SAML endpoint deprecation only appears in the 8.0.0-alpha1 release
notes, and was reverted in 8.0.0-alpha2

# Release note
See `docs/upgrade-notes.asciidoc` in file changes

# Follow-up
A follow-up PR must be created to create and backfill the docLinks.

---------

Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
2024-11-19 09:54:40 +01:00
Jesus Wahrman
7cb5b4d3cc
[doc] Allow copying as curl for saved object rollback instructions (#200187)
## Summary

Changed the doc file so it allows to copy as curl.

[Issue](https://github.com/elastic/kibana/issues/198490)

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2024-11-18 10:04:20 +01:00
wajihaparvez
8ede68b7ec
[Docs] Update Known Issues (#200240)
## Summary

Fixed some typos and updated sentence structure
2024-11-14 21:29:56 +00:00
wajihaparvez
20953fcb6f
[Docs] Add breaking change to release notes (#200065)
## Summary

Adding a Kibana-related breaking change found in the Security release
notes.
2024-11-14 17:02:01 +00:00
Jeramy Soucy
76664a27a9
Update legacy url aliases developer documentation (#199969)
Closes #176164

## Summary

Updates the legacy URL aliases developer documentation to cover the two
applicable scenarios where legacy URL aliases would be generated.
Formerly, the document was only concerned with saved object namespace
type migrations, but aliases can now also be generated when copying or
importing saved objects.
2024-11-14 09:26:58 +01:00
Joe Reuter
20e023b500
Kibana known issues of 8.16.0 (#200088)
Fresh version of https://github.com/elastic/kibana/pull/199995

Known issues of 8.16.0

- https://github.com/elastic/kibana/issues/199902
- https://github.com/elastic/kibana/issues/199892
- https://github.com/elastic/kibana/issues/199891

FYI @paulb-elastic, @consulthys, @vinaychandrasekhar 

Paul suggested to involve @lcawl & @colleenmcginnis 

I would invite the owners of those issues to expand/edit the proposed
text and add workarounds if any

---------

Co-authored-by: Luca Belluccini <luca.belluccini@elastic.co>
2024-11-13 22:43:18 +01:00
Chris Cowan
b86dc8102a
[Streams] Introducing the new Streams plugin (#198713)
## Summary

This PR introduces the new experimental "Streams" plugin into the Kibana
project. The Streams project aims to simplify workflows around dealing
with messy logs in Elasticsearch. Our current offering is either
extremely opinionated with integrations or leaves the user alone with
the high flexibility of Elasticsearch concepts like index templates,
component templates and so on, which make it challenging to configure
everything correctly for good performance and controlling search speed
and cost.

### Scope of PR
- Provides an API for the user to "enable" the streams framework which
creates the "root" entity `logs` with all the backing Elasticsearch
assets
- Provides an API for the user to "fork" a stream
- Provides an API for the user to "read" a stream and all of it's
Elasticsearch assets.
- Provides an API for the user to upsert a stream (and implicitly child
streams that are mentioned)
- Part of this API is placing grok and disscect processing steps as well
as fields to the mapping
- Implements the Stream Naming Schema (SNS) which uses dots to express
the index patterns and stream IDs. Example: `logs.nginx.errors`
- The APIs will fully manage the `index_template`, `component_template`,
and `ingest_pipelines`.

### Out of scope
- Integration tests (coming in a follow-up)

### Reviewer Notes
- I haven't implemented tests beyond a unit test for converting the
filter conditions to Painless. I wanted to get a PR up so we can start
iterating on the interface and functionality before we invest in
testing.
- You might need to add `server.versioned.versionResolution: oldest` to
your `config/kibana.dev.yaml` to play with the requests below in the
Kibana "Dev console".

### Example API Calls

Enable the root stream (and set the mapping for the internal `.streams`
index)
```
POST kbn:/api/streams/_enable
```

Read the root entity "logs"
```
GET kbn:/api/streams/logs
```

Fork the "root" entity "logs" and create "logs.nginx" based on a
condition
```
POST kbn:/api/streams/logs/_fork
{
  "stream": {
    "id": "logs.nginx",
    "children": [],
    "processing": [],
    "fields": [],
  },
  "condition": {
    "field": "log.logger",
    "operator": "eq",
    "value": "nginx_proxy"
  }
}
```

Fork the entity "logs.nginx" and create "logs.nginx.errors" based on a
condition
```
POST kbn:/api/streams/logs.nginx/_fork
{
  "stream": {
    "id": "logs.nginx.error",
    "children": [],
   "processing": [],
   "fields": [],
  },
  "condition": {
    "or": [
      { "field": "log.level", "operator": "eq", "value": "error" },
      { "field": "log.level", "operator": "eq", "value": "ERROR" }
    ]
  }
}
```

Set some processing on a stream and map the generated field
```
PUT kbn:/api/streams/logs.nginx
{
    "children": [],
    "processing": [
       { "config": { "type": "grok", "patterns": ["^%{IP:ip} – –"], "field": "message" } }
    ],
    "fields": [
       { "name": "ip", "type": "ip" }
    ],
  }
}
```

Field definitions are checked for both descendants and ancestors for
incompatibilities to ensure they stay additive.

If children are defined in the `PUT /api/streams/<name>` API,
sub-streams are created implicitly. If a stream is `PUT`, it's added to
the parent as well with a condition that is never true (can be edited
subsequently).

`POST /api/streams/_resync` can be used to re-sync all streams from
their meta data in case the Elasticsearch objects got messed up by some
external change - not sure whether we want to keep that.


Follow-ups

* API integration tests 
* Check read permissions on data streams to determine whether a user is
allowed to read certain streams

---------

Co-authored-by: Joe Reuter <johannes.reuter@elastic.co>
Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
2024-11-13 11:52:59 +01:00
Shahzad
90b14e2ba9
Remove release notes for missing PR !! (#199878)
## Summary

This PR https://github.com/elastic/kibana/pull/196109 was never
back-ported to 8.16.0 !!
2024-11-13 10:49:56 +01:00
Lisa Cawley
517063d0a4
[DOCS] Remove inference connector docs (#198633) 2024-11-12 11:56:37 -06:00
Liam Thompson
d6b8f9b619
[DOCS] Search AI assistant (#199602) 2024-11-12 10:21:31 +00:00
wajihaparvez
b781c4eec4
[Docs] Add section for assigning colors to terms (#199241)
## Summary

Added a section with instructions for assigning colors to terms in a
table. The technical preview warning will be removed in GA.

Rel: https://github.com/elastic/kibana/pull/189895
Closes: [#559](https://github.com/elastic/platform-docs-team/issues/559)

---------

Co-authored-by: florent-leborgne <florent.leborgne@elastic.co>
2024-11-11 20:59:39 +00:00
florent-leborgne
d6f5824d1c
[Docs] Fix collapsibles in RNs (#199508)
This PR fixes some formatting in the release notes and upgrade notes
2024-11-08 16:27:03 +00:00
florent-leborgne
3d763498b8
[Docs] Discover docs updates (#198423)
This PR updates the first few pages of the Discover docs:
- Splits most of the content of the parent page into a child page to
match with the structure of the Dashboards docs
- Refocuses some of the content so that it looks generally applicable to
users and their data rather than a sample data-based tutorial
- Adds missing content flagged in
https://github.com/elastic/kibana/issues/192149
- Adds some content updates specific to 8.16 flagged in
https://github.com/elastic/platform-docs-team/issues/500 (I still need
to figure out what's the best way to document ES|QL stuff)

Rel: https://github.com/elastic/platform-docs-team/issues/500
Closes: https://github.com/elastic/kibana/issues/192149 
Closes: https://github.com/elastic/kibana/issues/162265
Closes: https://github.com/elastic/kibana/issues/187417

Note: While there may be more missing features that we want to document,
let's first get these updates in.

Note2: If you're wondering where to preview the changes, find the
preview link in the Github actions comment and navigate to the "master"
version of the Kibana guide.

---------

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
Co-authored-by: Matthias Wilhelm <ankertal@gmail.com>
Co-authored-by: Julia Rechkunova <julia.rechkunova@gmail.com>
Co-authored-by: Davis McPhee <davismcphee@hotmail.com>
2024-11-08 12:12:05 +01:00
florent-leborgne
8e7fb7a77e
[Docs] Update nav instructions and sample data installation to accommodate for the solution views (#199163)
This PR:
- updates navigation instructions to accommodate for the navigation
changes related to solution views.
- updates instructions for adding sample data to rely on the
integrations page instead of the home page, that only exists with the
classic solution view
- updates references to the home page to avoid confusing users using one
of the new solution views

Closes: https://github.com/elastic/platform-docs-team/issues/529
Closes: https://github.com/elastic/platform-docs-team/issues/540
2024-11-08 11:10:32 +01:00
florent-leborgne
cd7447db36
[Docs] Update Kibana ESQL docs (#199371)
This PR updates ESQL docs currently in the Kibana guide. I'll do another
PR to the Elasticsearch docs to update the docs there as well.

Rel: https://github.com/elastic/platform-docs-team/issues/552
2024-11-08 10:35:25 +01:00
Catherine Liu
c1e430b868
[Canvas] Remove expression lifecycle docs (#199006)
## Summary

Closes https://github.com/elastic/kibana/issues/193475.

This removes outdated Canvas expression docs that describes capabilities
of the expression that are no longer true.


### Checklist

Delete any items that are not applicable to this PR.

- [ ] Any text added follows [EUI's writing
guidelines](https://elastic.github.io/eui/#/guidelines/writing), uses
sentence case text and includes [i18n
support](https://github.com/elastic/kibana/blob/main/packages/kbn-i18n/README.md)
- [ ]
[Documentation](https://www.elastic.co/guide/en/kibana/master/development-documentation.html)
was added for features that require explanation or tutorials
- [ ] [Unit or functional
tests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)
were updated or added to match the most common scenarios
- [ ] [Flaky Test
Runner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1) was
used on any tests changed
- [ ] Any UI touched in this PR is usable by keyboard only (learn more
about [keyboard accessibility](https://webaim.org/techniques/keyboard/))
- [ ] Any UI touched in this PR does not create any new axe failures
(run axe in browser:
[FF](https://addons.mozilla.org/en-US/firefox/addon/axe-devtools/),
[Chrome](https://chrome.google.com/webstore/detail/axe-web-accessibility-tes/lhdoppojpmngadmnindnejefpokejbdd?hl=en-US))
- [ ] If a plugin configuration key changed, check if it needs to be
allowlisted in the cloud and added to the [docker
list](https://github.com/elastic/kibana/blob/main/src/dev/build/tasks/os_packages/docker_generator/resources/base/bin/kibana-docker)
- [ ] This renders correctly on smaller devices using a responsive
layout. (You can test this [in your
browser](https://www.browserstack.com/guide/responsive-testing-on-local-server))
- [ ] This was checked for [cross-browser
compatibility](https://www.elastic.co/support/matrix#matrix_browsers)


### Risk Matrix

Delete this section if it is not applicable to this PR.

Before closing this PR, invite QA, stakeholders, and other developers to
identify risks that should be tested prior to the change/feature
release.

When forming the risk matrix, consider some of the following examples
and how they may potentially impact the change:

| Risk | Probability | Severity | Mitigation/Notes |

|---------------------------|-------------|----------|-------------------------|
| Multiple Spaces&mdash;unexpected behavior in non-default Kibana Space.
| Low | High | Integration tests will verify that all features are still
supported in non-default Kibana Space and when user switches between
spaces. |
| Multiple nodes&mdash;Elasticsearch polling might have race conditions
when multiple Kibana nodes are polling for the same tasks. | High | Low
| Tasks are idempotent, so executing them multiple times will not result
in logical error, but will degrade performance. To test for this case we
add plenty of unit tests around this logic and document manual testing
procedure. |
| Code should gracefully handle cases when feature X or plugin Y are
disabled. | Medium | High | Unit tests will verify that any feature flag
or plugin combination still results in our service operational. |
| [See more potential risk
examples](https://github.com/elastic/kibana/blob/main/RISK_MATRIX.mdx) |


### For maintainers

- [ ] This was checked for breaking API changes and was [labeled
appropriately](https://www.elastic.co/guide/en/kibana/master/contributing.html#_add_your_labels)
- [ ] This will appear in the **Release Notes** and follow the
[guidelines](https://www.elastic.co/guide/en/kibana/master/contributing.html#kibana-release-notes-process)
2024-11-07 13:30:42 -08:00
Christiane (Tina) Heiligers
0df2e98381
Changes deprecated SO HTTP APIs deprecation field to object (#197936)
fix https://github.com/elastic/kibana/issues/197721.

The route deprecation field changed from a boolean to an object, where
the object contains information that is used in deprecation issues that
the Upgrade Assistant shows.

This PR makes the necessary changes in the deprecated Saved Objects HTTP
APIs.

This PR also includes a release notes entry for the API deprecations
that was missing.
![Screenshot 2024-10-29 at 12 01
29](https://github.com/user-attachments/assets/5c47c697-fbae-4b2e-8c6c-cd4701a667df)

### Checklist

- [x] Any text added follows [EUI's writing
guidelines](https://elastic.github.io/eui/#/guidelines/writing), uses
sentence case text and includes [i18n
support](https://github.com/elastic/kibana/blob/main/packages/kbn-i18n/README.md)
- [x]
[Documentation](https://www.elastic.co/guide/en/kibana/master/development-documentation.html)
was added for features that require explanation or tutorials
- [x] [Unit or functional
tests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)
were updated or added to match the most common scenarios


### How to test this:

- Pull PR, run es against a trial license and start kibana as usual.
- Make a curl request to Kibana to get the config saved object: 

```
curl --location 'localhost:5601/abc/api/saved_objects/config/9.0.0' \
--header 'Content-Type: application/json' \
--header 'Accept-Encoding: gzip, deflate, br' \
--header 'kbn-xsrf: kibana' \
--header 'Kbn-Version: 9.0.0' \
--header 'Authorization: Basic ZWxhc3RpYzpjaGFuZ2VtZQ=='
```

- Navigate to Upgrade Assistant and observe Kibana has at least 1
deprecation warning.
- View Kibana's warnings, you should see a warning entry for `The "GET
/api/saved_objects/{type}/{id}" route is deprecated`

![Screenshot 2024-11-06 at 16 26
26](https://github.com/user-attachments/assets/3b6a5644-3e5e-403e-a0f6-015686675b9f)

- click on the deprecation and you should see more detail about the
deprecated API that's been used in the flyout:

![Screenshot 2024-11-06 at 16 26
44](https://github.com/user-attachments/assets/696aaf8f-fb6b-4c61-bc3c-b3745f85059a)

- resolve the deprecation warning
- Kibana should continue to issue requests to the deprecated SO HTTP
APIs because these APIs have not been removed yet.


### Risk Matrix

| Risk | Probability | Severity | Mitigation/Notes |

|---------------------------|-------------|----------|-------------------------|
| End user concern from the deprecation warning that says the routes
have been deprecated | Low | Low | The APIs have been deprecated since
8.7 and recommends using public APIs instead. |

### For maintainers

- [x] This will appear in the **Release Notes** and follow the
[guidelines](https://www.elastic.co/guide/en/kibana/master/contributing.html#kibana-release-notes-process)

---------

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
2024-11-07 14:49:05 -06:00
Julian Gernun
953d877df0
[Response Ops][Connectors] Refactor Jira Connector to use latest API only (#197787)
## Summary

Jira Cloud and Datacenter work using the same API urls. In this PR we
remove the calls to the capabilities API which was being used to know
the API url we needed to hit

To test it:
- Create Jira Cloud and Datacenter connectors
- Test all use cases related to them

Related to https://github.com/elastic/kibana/issues/189017

## Research Work

**getCapabilities, createIncident and getIncident** are always the same,
therefore ignored for the rest of this document

- getCapabilities: `/rest/capabilities`
- createIncident: `/rest/api/2/issue`
- getIncident: `/rest/api/2/issue`

## API links

- Cloud:
https://developer.atlassian.com/cloud/jira/platform/rest/v2/intro/#version
- DC: https://docs.atlassian.com/software/jira/docs/api/REST/9.17.0/

### Expected API urls based on the API links

- Get issue types

- Cloud: `GET /rest/api/2/issue/createmeta/{projectIdOrKey}/issuetypes`
  - DC:`GET /rest/api/2/issue/createmeta/{projectIdOrKey}/issuetypes`

- Get fields by issue type
- Cloud: `GET
/rest/api/2/issue/createmeta/{projectIdOrKey}/issuetypes/{issueTypeId}`
- DC:
`GET /rest/api/2/issue/createmeta/{projectIdOrKey}/issuetypes/{issueTypeId}`

### API we hit

- Get issue types

- Cloud `GET
/rest/api/2/issue/createmeta?projectKeys=ROC&expand=projects.issuetypes.fields`
(variable name we are using is `getIssueTypesOldAPIURL`)
- DC `GET /rest/api/2/issue/createmeta/RES/issuetypes` (variable name is
`getIssueTypesUrl`)

- Get fields by issue type
- Cloud `GET
/rest/api/2/issue/createmeta?projectKeys=ROC&issuetypeIds={issueTypeId}&expand=projects.issuetypes.fields`
(variable name is `getIssueTypeFieldsOldAPIURL`)
- DC `GET /rest/api/2/issue/createmeta/RES/issuetypes/{issueTypeId}`
(variable name is `getIssueTypeFieldsUrl`)

#### Analysed use cases to retrieve API urls we hit

- created a case with JIRA Cloud as Connector
- did a connector test with JIRA Cloud as connector
- created a case with JIRA DC as connector
- did a connector test with JIRA DC as connector

### Conclusions

- We are not using the right endpoints for Cloud, we should update them
to use the same endpoints.

---------

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
Co-authored-by: Christos Nasikas <christos.nasikas@elastic.co>
Co-authored-by: adcoelho <antonio.coelho@elastic.co>
Co-authored-by: Antonio <antoniodcoelho@gmail.com>
Co-authored-by: Lisa Cawley <lcawley@elastic.co>
2024-11-07 11:47:29 +01:00
Shahzad
d25a2b442a
[Synthetics] Refactor bulk delete monitor and params routes !! (#195420)
## Summary

Refactor bulk delete monitor and params routes !! 

We need to remove usage for body from DELETE route.

### Params

Params can be bulk delete now with POST request to
`/params/_bulk_delete` endpoint

### Monitors
Monitors can be bulk delete now with POST request to
`/monitors/_bulk_delete` endpoint
2024-11-07 10:51:56 +01:00
wajihaparvez
bab2c2a497
[Docs] 8.15.4 release notes (#198565)
## Summary

Adding a section for 8.15.4 release notes.

---------

Co-authored-by: Florent Le Borgne <florent.leborgne@elastic.co>
Co-authored-by: Liam Thompson <32779855+leemthompo@users.noreply.github.com>
2024-11-06 15:01:34 -05:00
Lisa Cawley
14a1a92a42
[DOCS] Add alerting performance enhancements to 8.16 release notes (#199043)
## Summary

This PR adds https://github.com/elastic/kibana/issues/188194 to the
8.16.0 Kibana release notes.
It also fixes a formatting issue.

### Preview


https://kibana_bk_199043.docs-preview.app.elstc.co/guide/en/kibana/master/release-notes-8.16.0.html
2024-11-06 06:23:23 -05:00
florent-leborgne
d5e9939f6b
[Docs] 8.16 release highlights - what's new page (#198343)
This PR adds the release highlights for Kibana 8.16.0

Closes: https://github.com/elastic/platform-docs-team/issues/501

![Whats New Guide
(2)](https://github.com/user-attachments/assets/ce61261b-ca23-4fe6-89cd-6c5c6fb843b6)
<img width="445" alt="image"
src="https://github.com/user-attachments/assets/22b68b77-4e52-4395-8079-1c8d2602e8db">
<img width="439" alt="image"
src="https://github.com/user-attachments/assets/59bebfcb-aa19-442c-9209-b945c48c5aa2">
2024-11-05 16:41:56 +01:00
florent-leborgne
33c8b1b300
[Docs] Adds 8.16.0 release notes (#198166)
This PR adds release notes for Kibana 8.16.0

It also adds new deprecations to the Upgrade notes file.

There are many entries so here's a list of the sections that have been
edited and are ready for review so far:

- [x] AGPL license
- [x] Alerting @lcawl 
- [x] Dashboards and visualizations
- [x] Data ingestion and Fleet @kilfoyle 
- [x] Discover
- [x] Elastic Observability solution @bmorelli25 
- [x] Elastic Search solution @leemthompo 
- [x] Elastic Security solution
- [x] Kibana platform
- [x] Kibana security
- [x] Machine Learning @szabosteve @leemthompo 
- [x] Management

Closes: https://github.com/elastic/platform-docs-team/issues/502

---------

Co-authored-by: István Zoltán Szabó <istvan.szabo@elastic.co>
Co-authored-by: David Kilfoyle <41695641+kilfoyle@users.noreply.github.com>
Co-authored-by: Liam Thompson <32779855+leemthompo@users.noreply.github.com>
Co-authored-by: Giorgos Bamparopoulos <gbamparop@gmail.com>
Co-authored-by: Brandon Morelli <bmorelli25@gmail.com>
Co-authored-by: lcawl <lcawley@elastic.co>
2024-11-05 16:41:28 +01:00
Lisa Cawley
8cbe61b1b9
[DOCS] Fix links to aggregation-based visualizations (#198854)
## Summary

This PR fixes the following broken links that occur when we change
"current" to 8.16 in https://github.com/elastic/docs/pull/3104:

```
INFO:build_docs:  /tmp/docsbuild/target_repo/html/en/kibana/8.10/release-notes-8.7.0.html contains broken links to:
INFO:build_docs:   - en/kibana/current/add-aggregation-based-visualization-panels.html
INFO:build_docs:  /tmp/docsbuild/target_repo/html/en/kibana/8.11/release-notes-8.7.0.html contains broken links to:
INFO:build_docs:   - en/kibana/current/add-aggregation-based-visualization-panels.html
INFO:build_docs:  /tmp/docsbuild/target_repo/html/en/kibana/8.12/release-notes-8.7.0.html contains broken links to:
INFO:build_docs:   - en/kibana/current/add-aggregation-based-visualization-panels.html
INFO:build_docs:  /tmp/docsbuild/target_repo/html/en/kibana/8.13/release-notes-8.7.0.html contains broken links to:
INFO:build_docs:   - en/kibana/current/add-aggregation-based-visualization-panels.html
INFO:build_docs:  /tmp/docsbuild/target_repo/html/en/kibana/8.14/release-notes-8.7.0.html contains broken links to:
INFO:build_docs:   - en/kibana/current/add-aggregation-based-visualization-panels.html
INFO:build_docs:  /tmp/docsbuild/target_repo/html/en/kibana/8.15/release-notes-8.7.0.html contains broken links to:
INFO:build_docs:   - en/kibana/current/add-aggregation-based-visualization-panels.html
INFO:build_docs:  /tmp/docsbuild/target_repo/html/en/kibana/8.16/breaking-changes-summary.html contains broken links to:
INFO:build_docs:   - en/kibana/current/add-aggregation-based-visualization-panels.html
INFO:build_docs:  /tmp/docsbuild/target_repo/html/en/kibana/8.16/release-notes-8.7.0.html contains broken links to:
INFO:build_docs:   - en/kibana/current/add-aggregation-based-visualization-panels.html
INFO:build_docs:  /tmp/docsbuild/target_repo/html/en/kibana/8.7/release-notes-8.7.0.html contains broken links to:
INFO:build_docs:   - en/kibana/current/add-aggregation-based-visualization-panels.html
INFO:build_docs:  /tmp/docsbuild/target_repo/html/en/kibana/8.8/release-notes-8.7.0.html contains broken links to:
INFO:build_docs:   - en/kibana/current/add-aggregation-based-visualization-panels.html
INFO:build_docs:  /tmp/docsbuild/target_repo/html/en/kibana/8.9/release-notes-8.7.0.html contains broken links to:
INFO:build_docs:   - en/kibana/current/add-aggregation-based-visualization-panels.html
INFO:build_docs:  /tmp/docsbuild/target_repo/html/en/kibana/8.x/breaking-changes-summary.html contains broken links to:
INFO:build_docs:   - en/kibana/current/add-aggregation-based-visualization-panels.html
INFO:build_docs:  /tmp/docsbuild/target_repo/html/en/kibana/8.x/release-notes-8.7.0.html contains broken links to:
INFO:build_docs:   - en/kibana/current/add-aggregation-based-visualization-panels.html
INFO:build_docs:  /tmp/docsbuild/target_repo/html/en/kibana/current/breaking-changes-summary.html contains broken links to:
INFO:build_docs:   - en/kibana/current/add-aggregation-based-visualization-panels.html
INFO:build_docs:  /tmp/docsbuild/target_repo/html/en/kibana/current/release-notes-8.7.0.html contains broken links to:
INFO:build_docs:   - en/kibana/current/add-aggregation-based-visualization-panels.html
INFO:build_docs:  /tmp/docsbuild/target_repo/html/en/kibana/master/breaking-changes-summary.html contains broken links to:
INFO:build_docs:   - en/kibana/current/add-aggregation-based-visualization-panels.html
INFO:build_docs:  /tmp/docsbuild/target_repo/html/en/kibana/master/release-notes-8.7.0.html contains broken links to:
INFO:build_docs:   - en/kibana/current/add-aggregation-based-visualization-panels.html
```

NOTE: The backport PRs for 8.8 and 8.7 will need to be edited to use
version-specific URLs since the content in those branches are re-used in
https://www.elastic.co/guide/en/elastic-stack/8.7/kibana-breaking-changes.html,
for example.
2024-11-05 12:22:27 +01:00
Alexi Doak
9efe20e1e1
[ResponseOps] Remove 7.x deprecated kibana.yml settings (#198435)
Resolves https://github.com/elastic/kibana/issues/194622

## Summary

Removes the following deprecated configuration settings:

- `xpack.actions.customHostSettings.ssl.rejectUnauthorized`
- `xpack.actions.whitelistedHosts`
- `xpack.actions.rejectUnauthorized`
- `xpack.actions.proxyRejectUnauthorizedCertificates`
- `xpack.alerts.healthCheck`
- `xpack.alerts.invalidateApiKeysTask.interval`
- `xpack.alerts.invalidateApiKeysTask.removalDelay`
- `xpack.alerting.defaultRuleTaskTimeout`

---------

Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
2024-11-04 11:47:52 -08:00
kosabogi
e945fc93c5
[ML] Updates references to apps and pages in ML-related guides (#198308)
### Overview

This PR updates all app and page references to align with the new style
guide guidelines.

### Related issue

https://github.com/elastic/search-docs-team/issues/205

### Preview

Machine learning
AIOps Labs

---------

Co-authored-by: florent-leborgne <florent.leborgne@elastic.co>
2024-11-04 12:04:15 +01:00
wajihaparvez
be51fac02f
[Docs] Update dashboard docs for interactive managed dashboard popover (#198226)
## Summary

Added a Duplicate dashboards page for the general duplicating process
and then mentioned the new popover for duplicating managed dashboards.
Linked to this page from other relevant mentions.
2024-10-31 19:02:58 +00:00
István Zoltán Szabó
dc8322a46f
[DOCS] Fine-tunes inference connector and action docs (#198345) 2024-10-30 17:12:53 +01:00
Julia Rechkunova
75195b4155
[Discover] Update docs to remove discover:showLegacyFieldTopValues (#197981)
## Summary

This PR updates docs as a followup for
https://github.com/elastic/kibana/pull/155503


### Checklist

- [x]
[Documentation](https://www.elastic.co/guide/en/kibana/master/development-documentation.html)
was added for features that require explanation or tutorials

Co-authored-by: Davis McPhee <davis.mcphee@elastic.co>
2024-10-30 04:45:06 -05:00
Larry Gregory
7ab51231e3
Fix documentation for session lifespan default (#198065)
This pull request includes an update to the
`docs/settings/security-settings.asciidoc` file to clarify the default
session lifespan settings for different installation environments.

Documentation update:

*
[`docs/settings/security-settings.asciidoc`](diffhunk://#diff-97a4c4e3696b33b246f55ddd794608530b693f0a7a66ae1361a32b67c7461523L204-R204):
Clarified that the default session lifespan is 30 days for on-prem
installations and 24 hours for Elastic Cloud installations.
2024-10-28 18:01:56 +00:00
Lisa Cawley
02fab7248d
[OpenAPI][DOCS] Add descriptions, examples, responses for role APIs (#195527)
Co-authored-by: Elena Shostak <165678770+elena-shostak@users.noreply.github.com>
2024-10-25 10:13:57 -07:00
Shahzad
0ff9a8a9d9
[Synthetics] Fixes partial updates for params and params viewing (#195866)
## Summary

Fixes https://github.com/elastic/kibana/issues/167781

In docs we says that only key/value pairs are required, but in actual
edit, that means rest of the data was being lost on edits

Allow partial updates to params edit API !!

This PR makes sure prev objects is fetched and merged with new data
hence allowing partial updates !!

We are also allowing the ability to view value of the secret once it's
saved via API !!

### Value is hidden
Param value will not be visible unless user is `super_user` or
`kibana_admin`, though user can assign new value.

---------

Co-authored-by: Justin Kambic <jk@elastic.co>
2024-10-25 17:06:52 +02:00
wajihaparvez
7ceaf32fa4
[Docs] Update Dashboard docs for chart switch redesign in 8.16.0 (#197543)
## Summary

Updated visuals in Dashboard docs for chart switch redesign and related
changes.

Closes: [#538](https://github.com/elastic/platform-docs-team/issues/538)
Rel: #187475
2024-10-24 17:55:01 -04:00
florent-leborgne
762903e31c
[Docs] Update community plugins documentation (#197569)
This PR recreates [@aakash742's
PR](https://github.com/elastic/kibana/pull/196497) to add a note about
Elastic not providing support for community plugins

---------

Co-authored-by: akashsingh <55509676+aakash742@users.noreply.github.com>
2024-10-24 23:12:23 +02:00
Sander Philipse
26ec293f07
[AI Assistant] Set scope and rename to Observability and Search (#196322)
## Summary

This renames the Observability AI Assistant in some places to AI
Assistant for Observability and Search. It also makes the scope
multi-valued on both sides.

---------

Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
2024-10-24 13:13:43 +02:00
florent-leborgne
68b3267ca2
[Docs] Update spaces docs with new solution view and permissions settings (#195648)
This PR updates the Spaces stateful docs with updates brought to spaces
configuration in 8.16.

Other more general docs changes related to the introduction of solution
views will be addressed in separate PRs (for example
https://github.com/elastic/platform-docs-team/issues/529 and
https://github.com/elastic/platform-docs-team/issues/530)

Closes: https://github.com/elastic/platform-docs-team/issues/463
2024-10-21 11:06:03 +02:00
Lisa Cawley
2656e5a4ff
[DOCS][OpenAPI] Add descriptions, examples, tags, responses for space APIs (#195333)
Co-authored-by: Elena Shostak <165678770+elena-shostak@users.noreply.github.com>
2024-10-18 14:03:06 -05:00
Lukas Olson
d23b409ff9
Add search session deprecation to release notes (#194052)
## Summary

As part of the Search Session deprecation, we need this listed in the
8.15.x release notes.

---------

Co-authored-by: Lisa Cawley <lcawley@elastic.co>
Co-authored-by: Florent Le Borgne <florent.leborgne@elastic.co>
2024-10-17 11:34:02 -07:00
florent-leborgne
d87a38f6cc
[Docs] Resize image for dashboard usage (#195914)
This PR is a small fix to resize an image in the Dashboards docs to make
it look better and not blurry
2024-10-15 19:25:49 +02:00
florent-leborgne
db2bd318a3
[Docs] Add release notes for 8.15.3 (#196083)
This PR adds release notes for Kibana 8.15.3.

Rel: https://github.com/elastic/dev/issues/2833
Closes: https://github.com/elastic/platform-docs-team/issues/535

---------

Co-authored-by: David Kilfoyle <41695641+kilfoyle@users.noreply.github.com>
2024-10-15 16:15:00 +00:00
natasha-moore-elastic
f0f1775632
[DOCS ]Direct users to new API reference site (#195909)
## Summary

Contributes to
https://github.com/elastic/security-docs-internal/issues/48.

Add callouts to the asciidoc Osquery API docs to direct users to the new
API reference site, in preparation for retiring the asciidoc API docs.

NOTE: The api-kibana variable is defined in version-specific files. In
[8.15.asciidoc](873ec2c47f/shared/versions/stack/8.15.asciidoc (L74))
and
[8.x.asciidoc](873ec2c47f/shared/versions/stack/8.x.asciidoc (L75)),
the variable points to the [v8
branch](https://www.elastic.co/docs/api/doc/kibana/v8) of the API
reference, which currently doesn't include Security API docs. The v8
branch is derived from the "current" Kibana branch, which is currently
8.15. This likely means that we can only backport the callouts to 8.16
once 8.16 becomes the "current" docs version.

Preview: [Osquery manager
API](https://kibana_bk_195909.docs-preview.app.elstc.co/guide/en/kibana/master/osquery-manager-api.html)
and all its child pages
2024-10-15 16:29:05 +01:00
Quentin Pradet
920d782392
[Console] Remove unused spec-to-console package (#193426)
Closes https://github.com/elastic/kibana/issues/163333

## Summary

It was superseded by generate-console-definitions.

### For maintainers

- [ ] This was checked for breaking API changes and was [labeled
appropriately](https://www.elastic.co/guide/en/kibana/master/contributing.html#kibana-release-notes-process)

---------

Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
Co-authored-by: Elena Stoeva <59341489+ElenaStoeva@users.noreply.github.com>
2024-10-15 10:04:54 -05:00
Liam Thompson
589f746ebd
[DOCS] Search landing page updates (#196131) 2024-10-14 15:53:21 +02:00
James Gowdy
923c450c1b
[ML] Adds ML tasks to the kibana audit log (#195120)
Adds a new `MlAuditLogger` service for logging calls to elasticsearch in
kibana's audit log.
Not all calls are logged, only ones which make changes to ML jobs or
trained models, e.g. creating, deleting, starting, stopping etc.

Calls to the es client are wrapped in a logging function so successes
and failures can be caught and logged.

the audit log can be enabed by adding this to the kibana yml or dev.yml
file
`xpack.security.audit.enabled: true`

An example log entry (NDJSON formatted to make it readable):
```
{
  "event": {
    "action": "ml_start_ad_datafeed",
    "type": [
      "change"
    ],
    "category": [
      "database"
    ],
    "outcome": "success"
  },
  "labels": {
    "application": "elastic/ml"
  },
  "user": {
    "id": "u_mGBROF_q5bmFCATbLXAcCwKa0k8JvONAwSruelyKA5E_0",
    "name": "elastic",
    "roles": [
      "superuser"
    ]
  },
  "kibana": {
    "space_id": "default",
    "session_id": "U6HQCDkk+fAEUCXs7i4qM2/MZITPxE02pp8o7h09P68="
  },
  "trace": {
    "id": "4f1b616b-8535-43e1-8516-32ea9fe76d19"
  },
  "client": {
    "ip": "127.0.0.1"
  },
  "http": {
    "request": {
      "headers": {
        "x-forwarded-for": "127.0.0.1"
      }
    }
  },
  "service": {
    "node": {
      "roles": [
        "background_tasks",
        "ui"
      ]
    }
  },
  "ecs": {
    "version": "8.11.0"
  },
  "@timestamp": "2024-10-11T09:07:47.933+01:00",
  "message": "Starting anomaly detection datafeed datafeed-11aaaa",
  "log": {
    "level": "INFO",
    "logger": "plugins.security.audit.ecs"
  },
  "process": {
    "pid": 58305,
    "uptime": 100.982390291
  },
  "transaction": {
    "id": "77c14aadc6901324"
  }
}
```

---------

Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
2024-10-14 11:37:56 +01:00
kosabogi
94ee8d598f
Updates file upload formats in Kibana guide (#195880)
### Overview

This PR updates the **Upload a file** section in the **Add data** page
to reflect the changes to the supported file formats in the Data
Visualizer.

### Related issue: 


https://github.com/elastic/search-docs-team/issues/189#issuecomment-2399079270

### Preview
2024-10-14 10:48:36 +02:00
Yuliia Naumenko
288d41d61e
[Connectors][GenAI] Inference Service Kibana connector (#189027)
## Summary
Resolves https://github.com/elastic/kibana/issues/188043

This PR adds new connector which is define integration with Elastic
Inference Endpoint via [Inference
APIs](https://www.elastic.co/guide/en/elasticsearch/reference/current/inference-apis.html)
The lifecycle of the Inference Endpoint are managed by the connector
registered handlers:

- `preSaveHook` -
[create](https://www.elastic.co/guide/en/elasticsearch/reference/current/put-inference-api.html)
new Inference Endpoint in the connector create mode (`isEdit === false`)
and
[delete](https://www.elastic.co/guide/en/elasticsearch/reference/current/delete-inference-api.html)+[create](https://www.elastic.co/guide/en/elasticsearch/reference/current/put-inference-api.html)
in the connector edit mode (`isEdit === true`)
- `postSaveHook` - check if the connector SO was created/updated and if
not removes Inference Endpoint from preSaveHook
- `postDeleteHook` -
[delete](https://www.elastic.co/guide/en/elasticsearch/reference/current/delete-inference-api.html)
Inference Endpoint if connector was deleted.

In the Kibana Stack Management Connectors, its represented with the new
card (Technical preview badge):

<img width="1261" alt="Screenshot 2024-09-27 at 2 11 12 PM"
src="https://github.com/user-attachments/assets/dcbcce1f-06e7-4d08-8b77-0ba4105354f8">

To simplify the future integration with AI Assistants, the Connector
consists from the two main UI parts: provider selector and required
provider settings, which will be always displayed
<img width="862" alt="Screenshot 2024-10-07 at 7 59 09 AM"
src="https://github.com/user-attachments/assets/87bae493-c642-479e-b28f-6150354608dd">

and Additional options, which contains optional provider settings and
Task Type configuration:

<img width="861" alt="Screenshot 2024-10-07 at 8 00 15 AM"
src="https://github.com/user-attachments/assets/2341c034-6198-4731-8ce7-e22e6c6fb20f">


subActions corresponds to the different taskTypes Inference API
supports. Each of the task type has its own Inference Perform params.
Currently added:

- completion & completionStream
- rerank
- text_embedding
- sparse_embedding

Follow up work:

1. Collapse/expand Additional options, when the connector flyout/modal
has AI Assistant as a context (path through the extending context
implementation on the connector framework level)
2. Add support for additional params for Completion subAction to be able
to path functions
3. Add support for tokens usage Dashboard, when inference API will
include the used tokens count in the response
4. Add functionality and UX for migration from existing specific AI
connectors to the Inference connector with proper provider and
completion task
5. Integrate Connector with the AI Assistants

---------

Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
Co-authored-by: István Zoltán Szabó <istvan.szabo@elastic.co>
Co-authored-by: Liam Thompson <32779855+leemthompo@users.noreply.github.com>
Co-authored-by: Steph Milovic <stephanie.milovic@elastic.co>
2024-10-13 15:39:09 -05:00
Jorge Sanz
ad8cec13b6
[Docs][Maps] Update EMS Server instructions (#195419)
## Summary

Small improvements to the Elastic Maps Service documentation:

* fixes the reference to the Docker image to pull
* adds details about using `cosign` to verify the image pulled 
* updates the screenshot to a more recent UI.
2024-10-10 21:02:23 +02:00
Ignacio Rivas
d86ce77217
Remove kbn-ace, ace and brace dependencies (#195703) 2024-10-10 14:16:42 +02:00