github-mirrors/kibana
1
0
Fork 0
mirror of https://github.com/elastic/kibana.git synced 2025-04-24 01:38:56 -04:00
Code Issues Projects Releases Packages Wiki Activity

[Data Forge] Restore queue.drain() (#188603)

Browse source 
This PR is a follow up to #187901 – It restores the `await
queue.drain()` function call in the `createEvents()` method. Without the
`queue.drain()` call, the script will run out of memory when indexing
more than 24 hours of data because it will generate events faster than
the queue can drain them and eventually run out of memory.
This commit is contained in:
Chris Cowan 2024-07-18 08:44:33 -06:00 • committed by GitHub
parent 7b1dd6143d
commit 76f329dfb1
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 1 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

1
x-pack/packages/kbn-data-forge/src/lib/create_events.ts
View file

@ -117,6 +117,7 @@ export async function createEvents(
.flat();
}
await queue.push(events);
await queue.drain();
} else {
logger.info({ took: 0, latency: 0, indexed: 0 }, 'Indexing 0 documents.');
}