Commit graph

4 commits

Author SHA1 Message Date
James Gowdy
3177b037d7
[ML] File upload: Adds support for PDF files (#186956)
Also txt, rtf, doc, docx, xls, xlsx, ppt, pptx, odt, ods, and odp.

Adds the ability to automatically add a semantic text field to the
mappings and a `copy_to` processor to duplicate the field. This is
needed for the mappings generated for the attachment processor which
adds a nested `attachment.content` field which cannot be used as a
semantic text field.

After a successful import, a link to Search's Playground app is shown.
Navigating there lets the user instantly query the newly uploaded file.


https://github.com/user-attachments/assets/09b20a5f-0e02-47fa-885e-0ed21374cc60

---------

Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
Co-authored-by: Liam Thompson <32779855+leemthompo@users.noreply.github.com>
2024-08-22 11:14:59 +01:00
James Gowdy
8d353a6dd0
[ML] File upload doc count chart (#173210)
Adds a doc count chart to the file upload which shows the progress of
doc ingestion.

Adds a new endpoint to the file upload plugin with is used to predict
the full time range of the index based on the first and last docs read
from the file. This allows us to draw the full time range on the chart
and see the docs appearing as the progress increases.


f45565bf-e25d-4e46-9dfd-3def72ddb63d

---------

Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
2024-01-22 13:25:15 +00:00
Nathan Reese
9a3c508184
[file upload] use index exists API for /internal/file_upload/index_exists route (#98471)
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-05-05 07:59:29 -06:00
Nathan Reese
81b46931f8
[file_upload] add has_import_permission route (#95190)
* [file_upload] add has_import_permission route

* remove ml hasImportPermissions

* fix tsconfig path

* tslint

* review feedback

* make pipeline check optional since geojson upload does not use pipeline

* ts cleanup

* make geojson permission failure message actionable

* revert privilege change in functional test

* add global_index_pattern_management_all permission to functional test

* rename hasPipeline to checkHasManagePipeline

* add api integration test

* tslint

* revert change to es_search_source

* simpilify error message when users can't create index pattern

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
2021-03-30 07:48:07 -06:00