mirror of
https://github.com/elastic/kibana.git
synced 2025-06-27 18:51:07 -04:00
7d20301289
Implements a huggingface dataset loader for RAG evals - see [x-pack/platform/packages/shared/kbn-ai-tools-cli/src/hf_dataset_loader/README.md](https://github.com/dgieselaar/kibana/blob/hf-dataset-loader/x-pack/platform/packages/shared/kbn-ai-tools-cli/src/hf_dataset_loader/README.md). Additionally, a `@kbn/cache-cli` tool was added that allows tooling authors to cache to disk (possibly remote storage later). Used o3 for finding datasets on HuggingFace and doing an initial pass on a line-by-line dataset processor ([see conversation](https://chatgpt.com/share/6853e49a-e870-8000-9c65-f7a5a3a72af0)) Libraries added: - `cache-manager`, `cache-manager-fs-hash`, `keyv`, `@types/cache-manager-fs-hash`: caching libraries and plugins. could not find any existing caching libraries in the repo. - `@huggingface/hub`: api client for HF. --------- Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com> Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com> |
||
|---|---|---|
| .. | ||
| ai-assistant | ||
| ai-infra | ||
| alerting-rule-utils | ||
| file-upload | ||
| file-upload-common | ||
| index-lifecycle-management/index_lifecycle_management_common_shared | ||
| index-management/index_management_shared_types | ||
| kbn-ai-assistant | ||
| kbn-ai-tools-cli | ||
| kbn-alerting-comparators | ||
| kbn-apm-types | ||
| kbn-cloud-security-posture/common | ||
| kbn-content-packs-schema | ||
| kbn-data-forge | ||
| kbn-elastic-assistant | ||
| kbn-elastic-assistant-common | ||
| kbn-elastic-assistant-shared-state | ||
| kbn-entities-schema | ||
| kbn-event-stacktrace | ||
| kbn-inference-cli | ||
| kbn-inference-endpoint-ui-common | ||
| kbn-inference-tracing | ||
| kbn-key-value-metadata-table | ||
| kbn-kibana-api-cli | ||
| kbn-langchain | ||
| kbn-profiler-cli | ||
| kbn-sample-parser | ||
| kbn-search-index-documents | ||
| kbn-slo-schema | ||
| kbn-streams-schema | ||
| logs-overview | ||
| ml | ||
| onechat | ||
| security | ||