kibana/docs/osquery/manage-integration.asciidoc
Melissa Burpo b57ee29b66
Osquery 8.3 updates (#134965)
* note that query history list shows past 30 days

* revise query timeout note

* describe new saved queries available out of the box

* update images for UI changes in 8.3

* add osquery FAQ

* revise per team feedback

* simplify version check query

* add clarification about version updates

* describe how to enable the curl table

* fix link

* fix code block

* Apply suggestions from code review

Co-authored-by: gchaps <33642766+gchaps@users.noreply.github.com>

* address pr feedback

Co-authored-by: gchaps <33642766+gchaps@users.noreply.github.com>
2022-06-24 14:02:54 -05:00

145 lines
6.3 KiB
Text

[[manage-osquery-integration]]
== Manage the integration
[float]
=== System requirements
* {fleet-guide}/fleet-overview.html[Fleet] is enabled on your cluster, and
one or more {fleet-guide}/elastic-agent-installation.html[Elastic Agents] is enrolled.
* The https://docs.elastic.co/en/integrations/osquery_manager[*Osquery Manager*] integration
has been added and configured
for an agent policy through Fleet.
This integration supports x64 architecture on Windows, MacOS, and Linux platforms,
and ARM64 architecture on Linux.
[NOTE]
=========================
* The original {filebeat-ref}/filebeat-module-osquery.html[Filebeat Osquery module]
and the https://docs.elastic.co/en/integrations/osquery[Osquery]
integration collect logs from self-managed Osquery deployments.
The *Osquery Manager* integration manages Osquery deployments
and supports running and scheduling queries from {kib}.
* *Osquery Manager* cannot be integrated with an Elastic Agent in standalone mode.
=========================
[float]
=== Customize Osquery sub-feature privileges
Depending on your https://www.elastic.co/subscriptions[subscription level],
you can further customize the sub-feature privileges
for *Osquery Manager*. These include options to grant specific access for running live queries,
running saved queries, saving queries, and scheduling packs. For example,
you can create roles for users who can only run live or saved queries, but who cannot save or schedule queries.
This is useful for teams who need in-depth and detailed control.
[float]
[[osquery-custom-config]]
=== Customize Osquery configuration
experimental[] By default, all Osquery Manager integrations share the same osquery configuration. However, you can customize how Osquery is configured by editing the Osquery Manager integration for each agent policy
you want to adjust. The custom configuration is then applied to all agents in the policy.
This powerful feature allows you to configure
https://osquery.readthedocs.io/en/stable/deployment/file-integrity-monitoring[File Integrity Monitoring], https://osquery.readthedocs.io/en/stable/deployment/process-auditing[Process auditing],
and https://osquery.readthedocs.io/en/stable/deployment/configuration/#configuration-specification[others].
[IMPORTANT]
=========================
* Take caution when editing this configuration. The changes you make are distributed to all agents in the policy.
* Take caution when editing `packs` using the Advanced *Osquery config* field.
Any changes you make to `packs` from this field are not reflected in the UI on the Osquery *Packs* page in {kib}, however, these changes are deployed to agents in the policy.
While this allows you to use advanced Osquery functionality like pack discovery queries, you do lose the ability to manage packs defined this way from the Osquery *Packs* page.
=========================
. From the {kib} main menu, click *Fleet*, then the *Agent policies* tab.
. Click the name of the agent policy where you want to adjust the Osquery configuration. The configuration changes you make only apply to the policy you select.
. Click the name of the *Osquery Manager* integration, or add the integration first if the agent policy does not yet have it.
. From the *Edit Osquery Manager integration* page, expand the *Advanced* section.
. Edit the *Osquery config* JSON field to apply your preferred Osquery configuration. Note the following:
* The field may already have content if you have scheduled packs for this agent policy. To keep these packs scheduled, do not remove the `packs` section.
* Refer to the https://osquery.readthedocs.io/en/stable/[Osquery documentation] for configuration options.
* Some fields are protected and cannot be set. A warning is displayed with details about which fields should be removed.
* (Optional) To load a full configuration file, drag and drop an Osquery `.conf` file into the area at the bottom of the page.
. Click *Save integration* to apply the custom configuration to all agents in the policy.
+
As an example, the following configuration disables two tables.
+
```ts
{
"options": {
"disable_tables":"file,process_envs"
}
}
```
[float]
[[enable-curl-table]]
==== Enabling the `curl` table
By default, the https://osquery.io/schema/#curl[curl table] is disabled.
If preferred, you can enable it using the Advanced *Osquery config*.
*Why is the `curl` table disabled?*
When you query the https://osquery.io/schema/#curl[curl table], this results in an HTTP request.
The query results include the response to the request. As a simple example, if you run the query
`SELECT * FROM curl WHERE url='https://www.elastic.co/';`, the `result` field contains the
webpage content.
This table can be misused in some environments, for example, when used to issue HTTP requests
to an AWS metadata service or to services on your internal network.
Out of an abundance of caution, we have opted to disable access to this table by default.
However, if you need access to the table for your own monitoring purposes, you can enable it
as needed.
*How to enable the `curl` table:*
For each agent policy where you want to allow `curl` table queries, edit the
Osquery Manager integration to add the following Advanced *Osquery config*:
```ts
{
"options": {
"enable_tables":"curl"
}
}
```
[float]
=== Upgrade Osquery versions
The https://github.com/osquery/osquery/releases[Osquery version] available on an Elastic Agent
is associated to the version of Osquery Beat on the Agent.
To get the latest version of Osquery Beat,
{fleet-guide}/upgrade-elastic-agent.html[upgrade your Elastic Agent].
[float]
=== Debug issues
If you encounter issues with *Osquery Manager*, find the relevant logs for {elastic-agent}
and Osquerybeat in the agent directory. Refer to the {fleet-guide}/installation-layout.html[Fleet Installation layout] to find the log file location for your OS.
```ts
../data/elastic-agent-*/logs/elastic-agent-json.log-*
../data/elastic-agent-*/logs/default/osquerybeat-json.log
```
To get more details in the logs, change the agent logging level to debug:
. Open the main menu, and then select **Fleet**.
. Select the agent that you want to debug.
. On the **Logs** tab, change the **Agent logging level** to **debug**, and then click **Apply changes**.
+
`agent.logging.level` is updated in `fleet.yml`, and the logging level is changed to `debug`.