Fixes#135319
Adds a new section to the
[Troubleshooting](https://www.elastic.co/guide/en/kibana/current/maps-troubleshooting.html)
addressing how to improve geospatial datasets locally before working
with Kibana Maps File Upload to increase the chances of a successful
operation.
* Converting a dataset into a GeoJSON or Shapefile with ogr2ogr
* Transforming a dataset into WGS84 with ogr2ogr
* Exploding a multigeometry dataset into parts with ogr2ogr
* Reducing the precision of a dataset with ogr2ogr
* Simplifying region datasets with mapshaper
* Options to clean invalid geometries with ogr2ogr and mapshaper
---------
Co-authored-by: Nick Peihl <nickpeihl@gmail.com>
Related to #174716
* Adds an intro paragraph mentioning the three options regarding EMS and
limited connectivity: set up a firewall, disable it fully, or install
Elastic Maps Server.
* Adds a reference to the Elastic Stack air-gapped guide.
Co-authored-by: Brandon Morelli <brandon.morelli@elastic.co>
Fixes#167484
Updates the [asset tracking
tutorial](https://www.elastic.co/guide/en/kibana/current/asset-tracking-tutorial.html)
with the following improvements:
* From #167484, @Danouchka contributed improvements to the way the
Elasticsearch assets are defined to work with Elastic Agent
* Moved some content to use the Kibana Console to generate assets,
instead of going through all the UI elements
* Updated references to the data that tracks not only Portland buses but
also trains and light trains
* Replaces the alert to use the Index connector
* Adds a new section on visualizing the alerts
* Images updated to Kibana 8.11 UI
Fixes#129751
## Summary
Extends the EMS documentation to detail request and response headers the
browser sends to EMS resources and includes also a minimal `curl`
command to request the response headers for same resource as well.
I tried to edit this in a way it does not take the whole page but happy
to hear feedback or ideas on how to make this easier to digest.
27e83a5f-4d01-47a8-af2c-3739576bf56e
Also, I am not sure if this is something worth adding to our release
notes 🤔
Fixes#127289
## Summary
Updates the asset tracking tutorial docs with considerations for running
in production.
For a better demo experience the tutorial uses a 5 second interval for
rule checking, but a very low interval can be problematic for running in
production.
I'm suggesting backporting these doc changes to 8.3 which the first
release to have a **Circuit breakers** section in
https://www.elastic.co/guide/en/kibana/8.3/alerting-production-considerations.html
that is most relevant to the added note in this PR.
---------
Co-authored-by: gchaps <33642766+gchaps@users.noreply.github.com>
Fixes https://github.com/elastic/kibana/issues/152495
<img width="500" alt="Screen Shot 2023-03-06 at 12 46 41 PM"
src="https://user-images.githubusercontent.com/373691/223216940-0b41a775-cbf4-424d-ab89-6c1a3b8a4c14.png">
Running Kibana in an offline environment without setting
`map.includeElasticMapsService: false` is an anti-pattern and leads to
lens and maps visualizations delaying initialization while waiting for
EMS connection. This PR ensures there is proper console notification.
Better messaging should point users to the correct resolution of setting
`map.includeElasticMapsService: false`.
The PR does not resolve the timeout issue. Not going to resolve the
timeout issue since running in an offline environment without setting
`map.includeElasticMapsService: false` is not supported.
---------
Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
…p Service
Adding some text to help clear out confusion by users reading the
`EMS_PATH_CONF` env variable as a host env var, instead of a env
variable inside the docker container. Also, mentioning the `-e` docker
flag that can be used on the docker command to start up the service.
## Summary
Summarize your PR. If it involves visual changes include a screenshot or
gif.
### Checklist
Delete any items that are not applicable to this PR.
- [ ] Any text added follows [EUI's writing
guidelines](https://elastic.github.io/eui/#/guidelines/writing), uses
sentence case text and includes [i18n
support](https://github.com/elastic/kibana/blob/main/packages/kbn-i18n/README.md)
- [ ]
[Documentation](https://www.elastic.co/guide/en/kibana/master/development-documentation.html)
was added for features that require explanation or tutorials
- [ ] [Unit or functional
tests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)
were updated or added to match the most common scenarios
- [ ] Any UI touched in this PR is usable by keyboard only (learn more
about [keyboard accessibility](https://webaim.org/techniques/keyboard/))
- [ ] Any UI touched in this PR does not create any new axe failures
(run axe in browser:
[FF](https://addons.mozilla.org/en-US/firefox/addon/axe-devtools/),
[Chrome](https://chrome.google.com/webstore/detail/axe-web-accessibility-tes/lhdoppojpmngadmnindnejefpokejbdd?hl=en-US))
- [ ] If a plugin configuration key changed, check if it needs to be
allowlisted in the cloud and added to the [docker
list](https://github.com/elastic/kibana/blob/main/src/dev/build/tasks/os_packages/docker_generator/resources/base/bin/kibana-docker)
- [ ] This renders correctly on smaller devices using a responsive
layout. (You can test this [in your
browser](https://www.browserstack.com/guide/responsive-testing-on-local-server))
- [ ] This was checked for [cross-browser
compatibility](https://www.elastic.co/support/matrix#matrix_browsers)
### Risk Matrix
Delete this section if it is not applicable to this PR.
Before closing this PR, invite QA, stakeholders, and other developers to
identify risks that should be tested prior to the change/feature
release.
When forming the risk matrix, consider some of the following examples
and how they may potentially impact the change:
| Risk | Probability | Severity | Mitigation/Notes |
|---------------------------|-------------|----------|-------------------------|
| Multiple Spaces—unexpected behavior in non-default Kibana Space.
| Low | High | Integration tests will verify that all features are still
supported in non-default Kibana Space and when user switches between
spaces. |
| Multiple nodes—Elasticsearch polling might have race conditions
when multiple Kibana nodes are polling for the same tasks. | High | Low
| Tasks are idempotent, so executing them multiple times will not result
in logical error, but will degrade performance. To test for this case we
add plenty of unit tests around this logic and document manual testing
procedure. |
| Code should gracefully handle cases when feature X or plugin Y are
disabled. | Medium | High | Unit tests will verify that any feature flag
or plugin combination still results in our service operational. |
| [See more potential risk
examples](https://github.com/elastic/kibana/blob/main/RISK_MATRIX.mdx) |
### For maintainers
- [ ] This was checked for breaking API changes and was [labeled
appropriately](https://www.elastic.co/guide/en/kibana/master/contributing.html#kibana-release-notes-process)
* updated tutorial to use Filebeat and Datastreams rather than Logstash and a static index
* Fixed pipeline issue when inCongestion is null the pipeline fails. Now if null its set as false
* Fixed pipeline issue when inCongestion is null the pipeline fails. Now if null its set as false
* Corrected minor mistakes in docs
* Changed trimet.vehicleID from int to keyword
* Update docs/maps/asset-tracking-tutorial.asciidoc
Co-authored-by: Nick Peihl <nick.peihl@elastic.co>
* Update docs/maps/asset-tracking-tutorial.asciidoc
Co-authored-by: Nick Peihl <nick.peihl@elastic.co>
* Update docs/maps/asset-tracking-tutorial.asciidoc
Co-authored-by: Nick Peihl <nick.peihl@elastic.co>
* Update docs/maps/asset-tracking-tutorial.asciidoc
Co-authored-by: Nick Peihl <nick.peihl@elastic.co>
Co-authored-by: Nick Peihl <nick.peihl@elastic.co>
* updated tutorial to use Filebeat and Datastreams rather than Logstash and a static index
* Fixed pipeline issue when inCongestion is null the pipeline fails. Now if null its set as false
* Fixed pipeline issue when inCongestion is null the pipeline fails. Now if null its set as false
* Corrected minor mistakes in docs
* Update docs/maps/asset-tracking-tutorial.asciidoc
Co-authored-by: gchaps <33642766+gchaps@users.noreply.github.com>
* Update docs/maps/asset-tracking-tutorial.asciidoc
Co-authored-by: gchaps <33642766+gchaps@users.noreply.github.com>
* Update docs/maps/asset-tracking-tutorial.asciidoc
Co-authored-by: gchaps <33642766+gchaps@users.noreply.github.com>
* Update docs/maps/asset-tracking-tutorial.asciidoc
Co-authored-by: gchaps <33642766+gchaps@users.noreply.github.com>
* Update docs/maps/asset-tracking-tutorial.asciidoc
Co-authored-by: gchaps <33642766+gchaps@users.noreply.github.com>
* Update docs/maps/asset-tracking-tutorial.asciidoc
Co-authored-by: gchaps <33642766+gchaps@users.noreply.github.com>
* Update docs/maps/asset-tracking-tutorial.asciidoc
Co-authored-by: gchaps <33642766+gchaps@users.noreply.github.com>
* Update docs/maps/asset-tracking-tutorial.asciidoc
Co-authored-by: gchaps <33642766+gchaps@users.noreply.github.com>
* Update docs/maps/asset-tracking-tutorial.asciidoc
Co-authored-by: gchaps <33642766+gchaps@users.noreply.github.com>
* Update docs/maps/asset-tracking-tutorial.asciidoc
* Update docs/maps/asset-tracking-tutorial.asciidoc
* Update docs/maps/asset-tracking-tutorial.asciidoc
Co-authored-by: gchaps <33642766+gchaps@users.noreply.github.com>
* [maps] Vector tile inspector adapter
* empty prompt
* add layer select
* tile request view
* show gridTile es path and body
* show error message
* hits request
* tab with editor
* clean up
* open in console
* do not track same tile multiple times
* remove layer from vector tile inspector when layer is removed
* refactor tile request generation
* show path in inspector
* requests view callout
* remove duplicated server side code
* remove unused files
* fix map_actions test
* open requests view when getting requests from inspector
* only show view when adapter is present
* fix open in console link not matching tile request
* tslint
* fix search sessions functional test
* update trouble shooting docs
* use bold in docs
* fix tiles at zoom level 0
* revert changes to mb_map
* include path when copying to clipboard
* clear inspector when layer type changes
* tslint fix
* clean-up
* update callout copy
* empty prompt copy
* copy updates
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
Adds support for users to upload their own SVG icons for styling geo_points or clusters in Elastic Maps.
Because Elastic Maps uses WebGL, dynamic styling requires rendering SVG icons as monochromatic PNGs using a Signed Distance Function algorithm. As a result, highly detailed designs and any color definitions in SVGs uploaded to Maps are not retained. Monochromatic SVG icons work best.
Custom icons are appended to the map saved object and are not accessible in other maps. Using the custom icon in another map requires creating a copy of the existing map or uploading the icon to the new map. Custom icons can be added, edited, or deleted in Map Settings. Custom icons can also be added from within the Icon select menu.
* [maps] shapefile importer
* render importer editor
* shapefile_editor
* break geojson_importer into abstract class
* start shapefile_importer _readNext
* parse shapefile
* getProgress
* comments
* set table row count
* hide shapefile editor once all files selected
* i18n fixes
* validate sidecar file names match .shp name
* rename JsonUploadAndParse to GeoUploadWizard
* eslint
* tslint
* fix getFileNameWithoutExt
* backout i18n changes
* reset i18n files to main
* revert to main zh-CN.json
* i18n updates
* use geoJsonCleanAndValidate to clean features from all geo importers
* update docs
* doc refinement
* tslint fix for loaders
* eslint
* shapefile upload functional test
* geoFileUploadPageObject
* add geojson functional test with geoFileUpload page object
* replace old workflow functional tests with new ones based on geoFileUplad page object
* tslint and eslint
* eslint
* fix jest test
* use smaller chunks to avoid timeout in CI
* try without geojson test
* try small geojson file in CI
* point.json
* do not use copy to clipboard, does not work in CI
* eslint
* more linting
* add retry
* one more thing for functional tests
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
* [DOCS] Fixes inconsistency with role management link
* Update docs/redirects.asciidoc
Co-authored-by: Lisa Cawley <lcawley@elastic.co>
Co-authored-by: Lisa Cawley <lcawley@elastic.co>
* tmp
* tmp
* tmp
* tmp
* tmp
* use es naming
* typo
* organize files for clarity
* plugin for hits
* tmp
* initial styling
* more boilerplate
* tmp
* temp
* add size support
* remove junk
* tooltip
* edits
* too many features
* rename for clarity
* typing
* tooltip improvements
* icon
* callouts
* align count handling
* typechecks
* i18n
* tmp
* type fixes
* linting
* convert to ts and disable option
* readd test dependencies
* typescheck
* update yarn lock
* fix typecheck
* update snapshot
* fix snapshot
* fix snapshot
* fix snapshot
* fix snapshot
* fix test
* fix tests
* fix test
* add key
* fix integration test
* move test
* use centroid placement
* more text fixes
* more test fixes
* Remove top terms aggregations when switching to super fine resolution (#114667)
* [Maps] MVT metrics
* remove js file
* updateSourceProps
* i18n cleanup
* mvt labels
* remove isPointsOnly from IVectorSource interface
* move get_centroid_featues to vector_layer since its no longer used in server
* labels
* warn users when selecting scaling type that does not support term joins
* clean up scaling_form
* remove IField.isCountable method
* move pluck code from common to dynamic_style_property
* move convert_to_geojson to es_geo_grid_source folder
* remove getMbFeatureIdPropertyName from IVectorLayer
* clean up cleanTooltipStateForLayer
* use euiWarningColor for too many features outline
* update jest snapshots and eslint fixes
* update docs for incomplete data changes
* move tooManyFeatures MB layer definition from VectorLayer to TiledVectorLayer, clean up VectorSource interface
* remove commented out filter in tooltip_control add api docs for getMbLayerIds and getMbTooltipLayerIds
* revert changing getSourceTooltipContent to getSourceTooltipConfigFromGeoJson
* replace DEFAULT_MAX_RESULT_WINDOW with loading maxResultWindow as data request
* clean up
* eslint
* remove unused constants from Kibana MVT implemenation and tooManyFeaturesImage
* add better should method for tiled_vector_layer.getCustomIconAndTooltipContent jest test
* fix tooltips not being displayed for super-fine clusters and grids
* fix check in getFeatureId for es_Search_sources only
* eslint, remove __kbn_metadata_feature__ filter from mapbox style expects
* remove geoFieldType paramter for tile API
* remove searchSessionId from MVT url since its no longer used
* tslint
* vector tile scaling option copy update
* fix getTile and getGridTile API integration tests
* remove size from _mvt request body, size provided in query
* eslint, fix test expect
* stablize jest test
* track total hits for _mvt request
* track total hits take 2
* align vector tile copy
* eslint
* revert change to EsSearchSource._loadTooltipProperties with regards to handling undefined _index. MVT now provides _index
* clean up
* only send metric aggregations to mvt/getGridTile endpoint
* update snapshot, update getGridTile URLs in tests
* update request URL for getGridTile
* eslint
Co-authored-by: Nathan Reese <reese.nathan@gmail.com>
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
* [Maps] Update search docs to clarify how to disable global search, global time filter, and global refresh for layers
* clean up
* make timeslider icon smaller
* use more common headers
* clean up
* review feedback
* global time consistency
* remove links
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
* [sample data] update web log geo.src field to match country code of geo.coordinates
* fix functional tests
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
