Free and Open, Distributed, RESTful Search Engine
Find a file
2024-01-05 18:20:28 -05:00
.buildkite [ci] Add/update docs for .buildkite dir and PR pipeline generator (#103936) (#103939) 2024-01-04 17:05:30 -05:00
.ci Bump versions after 7.17.16 release 2023-12-13 10:48:34 -05:00
.github Update CODEOWNER paths for Stack Monitoring mappings (#99428) 2023-09-12 14:11:30 +02:00
.idea Don't apply IntelliJ illegal module dependency inspection to test code (#101977) (#101981) 2023-11-09 13:25:48 -05:00
benchmarks ESQL: Build tracked block in EVAL (#100268) (#100279) 2023-10-04 11:21:05 -04:00
build-conventions Disable incremental compilation in CI environments (#103346) (#103351) 2023-12-12 14:15:51 -08:00
build-tools Disable incremental compilation in CI environments (#103346) (#103351) 2023-12-12 14:15:51 -08:00
build-tools-internal Fix thirdparty audit checks on Java 22 (#104010) (#104012) 2024-01-05 18:20:28 -05:00
client Unmute RestClientMultipleHostsIntegTests.testCancelAsyncRequests (#101592) (#101594) 2023-10-31 07:04:32 -04:00
dev-tools Add convenience script for pruning old dev branch CI jobs 2022-08-24 09:59:38 -07:00
distribution Update IronBank docker image base to ubi:9.3 (#102721) (#103076) 2023-12-06 14:00:28 -05:00
docs Mention missing files in corruption troubleshooting docs (#103962) (#103968) 2024-01-05 06:03:09 -05:00
gradle Update gradle wrapper to 8.5 (#102154) (#102835) 2023-11-30 17:25:02 -05:00
libs ESQL: Track blocks (#100025) 2023-09-28 13:17:08 -04:00
licenses Keep low level rest client under Apache 2 software license (#68694) 2021-02-08 11:13:31 -08:00
modules Wrap painless explain error (#103151) (#103235) 2023-12-09 09:50:47 -05:00
plugins Fix :plugins:repository-hdfs:forbiddenApisJavaRestTest (#102983) (#103036) 2023-12-06 03:12:29 -05:00
qa Increase timeout in MixedClusterClientYamlTestSuiteIT (#100585) (#102852) 2023-12-01 06:39:17 -05:00
rest-api-spec Log more information in debug when synonyms fail updates (#102946) (#103020) 2023-12-05 16:48:03 -05:00
server Revert change (#90674) (#103865) (#103933) 2024-01-04 13:13:13 -05:00
test Fix :plugins:repository-hdfs:forbiddenApisJavaRestTest (#102983) (#103036) 2023-12-06 03:12:29 -05:00
x-pack Backport mute to 8.11 (#103993) 2024-01-05 10:45:47 -05:00
.backportrc.json Bump versions after 8.11.3 release 2023-12-12 10:54:25 -05:00
.dir-locals.el Go back to 140 column limit in .dir-locals.el 2017-04-14 08:50:53 -06:00
.editorconfig SQL: Fix FORMAT function to better comply with Microsoft SQL Server specification (#86225) 2022-05-18 12:03:00 +02:00
.git-blame-ignore-revs Update .git-blame-ignore-revs 2023-04-04 10:05:42 +01:00
.gitattributes Assert no carriage returns in release notes test samples (#77238) 2021-09-07 20:45:23 +01:00
.gitignore Merge pull request ESQL-915 from elastic/main 2023-03-23 01:15:39 -04:00
branches.json Remove 8.9 branch for CI configuration 2023-09-13 08:06:15 -07:00
build.gradle Disable BWC tests in encryption at rest CI job (#100784) (#100786) 2023-10-12 20:01:23 -04:00
BUILDING.md Twe (#97960) 2023-07-26 05:24:00 -04:00
catalog-info.yaml [buildkite] Re-enable platform-support periodic pipelines (#99552) 2023-09-13 16:21:28 -04:00
CHANGELOG.md In the field capabilities API, re-add support for fields in the request body (#88972) 2022-08-04 13:44:50 -04:00
CONTRIBUTING.md Remove uuids from TransportVersion constants (#99500) 2023-09-13 10:12:53 -07:00
gradle.properties Suppress gradle welcome messages (#102898) (#102910) 2023-12-04 12:08:19 +01:00
gradlew Update gradle wrapper to 8.4 (#99856) (#102828) 2023-11-30 15:14:10 -05:00
gradlew.bat Update Gradle Wrapper to 7.6.1 (#89796) (#92241) (#94122) 2023-02-24 11:48:08 -05:00
LICENSE.txt Update sources with new SSPL+Elastic-2.0 license headers 2021-02-02 16:10:53 -08:00
NOTICE.txt Remove Joda dependency (#79007) 2021-10-13 17:37:31 -07:00
README.asciidoc [Docs] Link to elasticsearch-labs from README (#98969) 2023-08-29 12:56:38 +02:00
REST_API_COMPATIBILITY.md [8.11] [DOCS] Update tech preview copy (#101606) (#101616) 2023-10-31 11:25:18 -04:00
settings.gradle Update gradle wrapper to 8.5 (#102154) (#102835) 2023-11-30 17:25:02 -05:00
TESTING.asciidoc Add yaml test debugging tip (#99341) 2023-09-08 11:03:33 +02:00
TRACING.md Rename TracerPlugin to TelemetryPlugin (#99735) 2023-09-22 13:35:36 +02:00
Vagrantfile Introduce ES_JAVA_HOME (#68954) 2021-02-17 12:41:23 -05:00

= Elasticsearch

Elasticsearch is a distributed, RESTful search engine optimized for speed and relevance on production-scale workloads. You can use Elasticsearch to perform real-time search over massive datasets for applications including:

* Vector search
* Full-text search
* Logs
* Metrics
* Application performance monitoring (APM)
* Security logs


\... and more!

To learn more about Elasticsearch's features and capabilities, see our
https://www.elastic.co/products/elasticsearch[product page].

[[get-started]]
== Get started

The simplest way to set up Elasticsearch is to create a managed deployment with
https://www.elastic.co/cloud/as-a-service[Elasticsearch Service on Elastic
Cloud].

If you prefer to install and manage Elasticsearch yourself, you can download
the latest version from 
https://www.elastic.co/downloads/elasticsearch[elastic.co/downloads/elasticsearch].

=== Run Elasticsearch locally

//// 
IMPORTANT: This content is replicated in the Elasticsearch guide. 
If you make changes, you must also update setup/set-up-local-dev-deployment.asciidoc.
////

To try out Elasticsearch on your own machine, we recommend using Docker
and running both Elasticsearch and Kibana.
Docker images are available from the https://www.docker.elastic.co[Elastic Docker registry].

NOTE: Starting in Elasticsearch 8.0, security is enabled by default. 
The first time you start Elasticsearch, TLS encryption is configured automatically, 
a password is generated for the `elastic` user, 
and a Kibana enrollment token is created so you can connect Kibana to your secured cluster.

For other installation options, see the
https://www.elastic.co/guide/en/elasticsearch/reference/current/install-elasticsearch.html[Elasticsearch installation documentation].

**Start Elasticsearch**

. Install and start https://www.docker.com/products/docker-desktop[Docker
Desktop]. Go to **Preferences > Resources > Advanced** and set Memory to at least 4GB.

. Start an Elasticsearch container:
+
----
docker network create elastic
docker pull docker.elastic.co/elasticsearch/elasticsearch:{version} <1>
docker run --name elasticsearch --net elastic -p 9200:9200 -p 9300:9300 -e "discovery.type=single-node" -t docker.elastic.co/elasticsearch/elasticsearch:{version}
----
<1> Replace {version} with the version of Elasticsearch you want to run.
+
When you start Elasticsearch for the first time, the generated `elastic` user password and
Kibana enrollment token are output to the terminal.
+
NOTE: You might need to scroll back a bit in the terminal to view the password 
and enrollment token.

. Copy the generated password and enrollment token and save them in a secure 
location. These values are shown only when you start Elasticsearch for the first time.
You'll use these to enroll Kibana with your Elasticsearch cluster and log in.

**Start Kibana**

Kibana enables you to easily send requests to Elasticsearch and analyze, visualize, and manage data interactively.

. In a new terminal session, start Kibana and connect it to your Elasticsearch container:
+
----
docker pull docker.elastic.co/kibana/kibana:{version} <1>
docker run --name kibana --net elastic -p 5601:5601 docker.elastic.co/kibana/kibana:{version}
----
<1> Replace {version} with the version of Kibana you want to run.
+
When you start Kibana, a unique URL is output to your terminal.

. To access Kibana, open the generated URL in your browser.

  .. Paste the enrollment token that you copied when starting
  Elasticsearch and click the button to connect your Kibana instance with Elasticsearch.

  .. Log in to Kibana as the `elastic` user with the password that was generated
  when you started Elasticsearch.

**Send requests to Elasticsearch**

You send data and other requests to Elasticsearch through REST APIs. 
You can interact with Elasticsearch using any client that sends HTTP requests, 
such as the https://www.elastic.co/guide/en/elasticsearch/client/index.html[Elasticsearch
language clients] and https://curl.se[curl]. 
Kibana's developer console provides an easy way to experiment and test requests. 
To access the console, go to **Management > Dev Tools**.

**Add data**

You index data into Elasticsearch by sending JSON objects (documents) through the REST APIs.  
Whether you have structured or unstructured text, numerical data, or geospatial data, 
Elasticsearch efficiently stores and indexes it in a way that supports fast searches. 

For timestamped data such as logs and metrics, you typically add documents to a
data stream made up of multiple auto-generated backing indices.

To add a single document to an index, submit an HTTP post request that targets the index. 

----
POST /customer/_doc/1
{
  "firstname": "Jennifer",
  "lastname": "Walters"
}
----

This request automatically creates the `customer` index if it doesn't exist, 
adds a new document that has an ID of 1, and 
stores and indexes the `firstname` and `lastname` fields.

The new document is available immediately from any node in the cluster. 
You can retrieve it with a GET request that specifies its document ID:

----
GET /customer/_doc/1
----

To add multiple documents in one request, use the `_bulk` API.
Bulk data must be newline-delimited JSON (NDJSON). 
Each line must end in a newline character (`\n`), including the last line.

----
PUT customer/_bulk
{ "create": { } }
{ "firstname": "Monica","lastname":"Rambeau"}
{ "create": { } }
{ "firstname": "Carol","lastname":"Danvers"}
{ "create": { } }
{ "firstname": "Wanda","lastname":"Maximoff"}
{ "create": { } }
{ "firstname": "Jennifer","lastname":"Takeda"}
----

**Search**

Indexed documents are available for search in near real-time. 
The following search matches all customers with a first name of _Jennifer_ 
in the `customer` index.

----
GET customer/_search
{
  "query" : {
    "match" : { "firstname": "Jennifer" }  
  }
}
----

**Explore**

You can use Discover in Kibana to interactively search and filter your data.
From there, you can start creating visualizations and building and sharing dashboards.

To get started, create a _data view_ that connects to one or more Elasticsearch indices,
data streams, or index aliases.

. Go to **Management > Stack Management > Kibana > Data Views**.
. Select **Create data view**.
. Enter a name for the data view and a pattern that matches one or more indices, 
such as _customer_. 
. Select **Save data view to Kibana**.  

To start exploring, go to **Analytics > Discover**.

[[upgrade]]
== Upgrade

To upgrade from an earlier version of Elasticsearch, see the
https://www.elastic.co/guide/en/elasticsearch/reference/current/setup-upgrade.html[Elasticsearch upgrade
documentation].

[[build-source]]
== Build from source

Elasticsearch uses https://gradle.org[Gradle] for its build system.

To build a distribution for your local OS and print its output location upon
completion, run:
----
./gradlew localDistro
----

To build a distribution for another platform, run the related command:
----
./gradlew :distribution:archives:linux-tar:assemble
./gradlew :distribution:archives:darwin-tar:assemble
./gradlew :distribution:archives:windows-zip:assemble
----

To build distributions for all supported platforms, run:
----
./gradlew assemble
----

Distributions are output to `distribution/archives`.

To run the test suite, see xref:TESTING.asciidoc[TESTING].

[[docs]]
== Documentation

For the complete Elasticsearch documentation visit
https://www.elastic.co/guide/en/elasticsearch/reference/current/index.html[elastic.co].

For information about our documentation processes, see the
xref:docs/README.asciidoc[docs README].

[[examples]]
== Examples and guides

The https://github.com/elastic/elasticsearch-labs[`elasticsearch-labs`] repo contains executable Python notebooks, sample apps, and resources to test out Elasticsearch for vector search, hybrid search and generative AI use cases.


[[contribute]]
== Contribute

For contribution guidelines, see xref:CONTRIBUTING.md[CONTRIBUTING]. 

[[questions]]
== Questions? Problems? Suggestions?

* To report a bug or request a feature, create a
https://github.com/elastic/elasticsearch/issues/new/choose[GitHub Issue]. Please
ensure someone else hasn't created an issue for the same topic.

* Need help using Elasticsearch? Reach out on the
https://discuss.elastic.co[Elastic Forum] or https://ela.st/slack[Slack]. A
fellow community member or Elastic engineer will be happy to help you out.