kibana/config
Tim Sullivan 2f038e1ba7
[Serverless/Reporting] use 3m reporting poll interval for report job cleanup (#170787)
Monitoring of task consumption has shown the `reports:monitor` task
takes an aggressively high amount of cycles from Kibana Task Manager.
This impacts the throughput of alerts.

This first step is a serverless-only config change to give an immediate
increase in overall task throughput.

It's safe to lower this polling frequency: **the impact is limited to
the responsiveness of retries** when a report job is found to be timed
out. Long-term, the plan will be to tune other parts of the code:
https://github.com/elastic/kibana/issues/170462

## Testing
1. Adjust the Dev mode settings to match a value set in production. Add
this to `config/kibana.dev.yml`:
    ```
xpack.reporting.capture.maxAttempts: 3 # usually in Dev mode, this is
set to 1
    ```

2. Start the scripts in different terminal windows to run Elasticsearch
and Kibana dev servers
    ```
    yarn es serverless
    ---------------
    yarn serverless
    ```
3. Open a search in Discover that covers about 4,000 hits and request a
CSV export using the Share menu.
4. Monitor the Kibana server logs and wait until the background job
begins. Restart the server while the job is executing (saving a file in
code under `packages/` or `server/` will trigger a restart).
5. Around 3 minutes after restart, the report job will get a re-attempt

Compare this behavior vs in non-serverless, where a report job will get
a re-attempt around 3 seconds after restart.
2023-11-08 11:41:07 -07:00
..
kibana.yml [Unified Search] Move autocomplete logic to unified search plugin (#129977) 2022-04-22 11:02:56 +05:00
node.options [node] Enable openssl legacy provider (#163190) 2023-08-30 11:51:10 -07:00
README.md Fix config stacking order (#158827) 2023-06-05 15:15:07 +02:00
serverless.es.yml [cloud plugin] Expose serverless.projectType (#170527) 2023-11-06 09:54:42 -07:00
serverless.oblt.yml [cloud plugin] Expose serverless.projectType (#170527) 2023-11-06 09:54:42 -07:00
serverless.security.yml [cloud plugin] Expose serverless.projectType (#170527) 2023-11-06 09:54:42 -07:00
serverless.yml [Serverless/Reporting] use 3m reporting poll interval for report job cleanup (#170787) 2023-11-08 11:41:07 -07:00

as work on serverless picks up we will add config values to these files that define how Kibana will run in "serverless" modes. To start Kibana locally with this configuration, pass --serverless={mode} or run yarn serverless-{mode}

valid modes are currently: es, oblt, and security

configuration is applied in the following order, later values override

  1. serverless.yml (serverless configs go first)
  2. serverless.{mode}.yml (serverless configs go first)
  3. base config, in this preference order:
  • my-config.yml(s) (set by --config)
  • env-config.yml (described by env.KBN_CONFIG_PATHS)
  • kibana.yml (default @ env.KBN_PATH_CONF/kibana.yml)
  1. kibana.dev.yml
  2. serverless.dev.yml
  3. serverless.{mode}.dev.yml