kibana/x-pack/test/monitoring_api_integration/utils
Tre 63c3ef4808
[Es Archiver][Load Action] New Overridable Batch Size + Concurrency (#174631)
Adding new defaults for the stream batch size and concurrency.

Now, the default batch size is increased from 300 to 5000.
The default concurrency is set to 4.

## Summary of Performance Characteristics
Using a list of over 70 archives from within the repo, we've benchmarked
the speed before changing the performance characteristics, and after.

One champion example is the
`x-pack/test/functional/es_archives/getting_started/shakespeare`
archive.
It's load time decreased from **~2.5 minutes**, to less than **18
seconds**, in a serverless environment.

There are a little over a handful where the time actually got worse, but
most are only milliseconds slower.
None are a full second slower.


---------

Co-authored-by: Timothy Sullivan <tsullivan@elastic.co>
Co-authored-by: Matthias Wilhelm <matthias.wilhelm@elastic.co>
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2024-01-26 14:42:16 +00:00
..
lifecycle_methods.ts [Es Archiver][Load Action] New Overridable Batch Size + Concurrency (#174631) 2024-01-26 14:42:16 +00:00
test_runner.ts