Commit graph

558 commits

Author SHA1 Message Date
Iraklis Psaroudakis
d61e9dce10
Correct docs tcp retries timeout (#102968) (#103044)
Closes #102788
2023-12-20 06:20:47 -05:00
Iraklis Psaroudakis
522439b4cf
Fix Windows tcpretries as well (#103048) (#103051)
In previous PR #102968 fixed the Linux value but not the Windows one.

Relates #102788
2023-12-06 08:47:55 -05:00
David Turner
72afc2e314 Bring-your-own JDK docs improvements (#96404)
- Bury these docs a little more, there's no need for them to be on the landing page for "Set up Elasticsearch".

- Clarify the responsibilities for JDK updates.
2023-06-01 08:46:33 +01:00
Ryan Ernst
71c7534731
Suggest systemd override file instead of unit file for tmpdir (#93211) (#93215)
The systemd unit file is part of the Elasticsearch package and should
not be edited. Instead, we recommend creating a service override file.
This commit tweaks the docs for setting tmp dir with systemd to use the
override file instead of editing the unit file.

relates #93121
2023-01-24 17:11:56 -05:00
David Turner
a4374feacc
Document how to set ES_TMPDIR in the service file (#93121) (#93135)
Today we suggest that users set `ES_TMPDIR` using `export`, which only
works if you're running things directly from the shell. Yet most users
encountering `ES_TMPDIR` problems seem to on RHEL and trying to run
things via `systemd`, for whom the `export` suggestion doesn't work.

This commit adds to the docs a suggestion of how to adjust the `systemd`
service file to set the appropriate environment variable.

Relates #80651
2023-01-23 03:46:43 -05:00
David Turner
79de60cab6
Adjust docs for new systemd startup timeout (#91648) (#91653)
The docs introduced in #91333 apply to older versions in which the `systemd`
startup timeout was 75s by default, but in #91338 we extended the `systemd`
startup timeout to 900s from 8.7.0 and 7.17.8 onwards. This commit adjusts the
docs to match.
2022-11-17 09:34:15 -05:00
David Turner
36f5425f45 Add docs about TimeoutStartSec in systemd (#91333)
Adds a short note about the effects of `TimeoutStartSec` in older
`systemd` versions.
2022-11-17 12:13:15 +00:00
Przemyslaw Gomulka
4bb61196eb
[doc] update deprecation logging (#83723) (#86856)
more details on how to disable deprecation logging
2022-05-17 10:30:17 -04:00
Nicole Albee
7cf7ba07c4
[doc] Update to include API for checking JVM pointers (#86360) (#86485)
* [doc] Add information for how to find if compressed ordinary object pointers is in use using the REST APIs.

* Update docs/reference/setup/advanced-configuration.asciidoc

Co-authored-by: Nikola Grcevski <6207777+grcevski@users.noreply.github.com>

Co-authored-by: Nikola Grcevski <6207777+grcevski@users.noreply.github.com>

Co-authored-by: Nikola Grcevski <6207777+grcevski@users.noreply.github.com>
2022-05-05 14:56:43 -04:00
David Turner
e7ffa050ed
More docs re. removing cluster.initial_master_nodes (#85948) (#85981)
Ensures that on every page of the docs that mentions
`cluster.initial_master_nodes` also mentions that this setting must be
removed after bootstrapping completes.
2022-04-19 03:13:32 -04:00
Nik Everett
17f5cc87bd
Backport doc fixes to 7.17 (#84722)
* Update painless-reindex-context.asciidoc (#84444) (#84712)

ctx['op'] should be set to 'noop', not 'none' when specifying no
operation.

Elasticsearch error when using 'none':

```json
{
  "error" : {
    "root_cause" : [
      {
        "type" : "illegal_argument_exception",
        "reason" : "Operation type [none] not allowed, only [noop, index, delete] are allowed"
      }
    ],
    "type" : "illegal_argument_exception",
    "reason" : "Operation type [none] not allowed, only [noop, index, delete] are allowed"
  },
  "status" : 400
}
```

Co-authored-by: jalvar08 <jeovanny.alvarez@gmail.com>

* [DOCS] Update install instructions for Debian/Ubuntu (#84645) (#84714)

The use of `apt-key` is deprecated and will no longer be available after
Debian 11 and Ubuntu 22.04. This updates the installation instructions
for Debian-based distributions.

Closes #84644

Co-authored-by: er0k <er0k@users.noreply.github.com>

* Fix some typos in plugins & reference docs (#84667) (#84717)

This pull request removes a few instances of duplicate words or
punctuation and erroneous spelling from the docs.

Co-authored-by: Abele Mălan <6689720+AbeleMM@users.noreply.github.com>

Co-authored-by: jalvar08 <jeovanny.alvarez@gmail.com>
Co-authored-by: er0k <er0k@users.noreply.github.com>
Co-authored-by: Abele Mălan <6689720+AbeleMM@users.noreply.github.com>
2022-03-07 14:04:12 -05:00
David Turner
db654f3e18
Note libffi error message in tmpdir docs (#83662) (#83670)
In #80617 we upgraded to a version of JNA which would report the message
`Failed to allocate closure` if the temp dir for `libffi` did not permit
executables (rather than crashing with a segfault). This commit extends
the docs to mention this message.
2022-02-08 12:49:00 -05:00
Adam Locke
9d0be14f54
Clarify commands shown for "permanently" setting max_map_count (#82345) (#83229)
* Clarify commands shown for "permanently" setting max_map_count

The current text shows a grep, which of course does not set the value at all.  I've clarified why it's offered (to CHECK the value).

I've also moved the command for setting the value temporarily to above that discussion, to make it more clear to readers that that's what it does.

* Reorder commands, add headings, and fix typos

Co-authored-by: Adam Locke <adam.locke@elastic.co>

Co-authored-by: Charlie Arehart <charlie@carehart.org>
2022-01-27 13:48:09 -05:00
Adam Locke
438bb6a6bd
[DOCS] Add note to that log4j customization is outside the support scope (#82668) (#83113)
* [docs] Add note to Elasticsearch logging that log4j customization is out of support scope

* Update language for default logging recommendation

Co-authored-by: Adam Locke <adam.locke@elastic.co>

Co-authored-by: Quin Hoxie <qhoxie@gmail.com>
Co-authored-by: Adam Locke <adam.locke@elastic.co>

Co-authored-by: Toby Sutor <55087308+toby-sutor@users.noreply.github.com>
Co-authored-by: Quin Hoxie <qhoxie@gmail.com>
2022-01-25 18:56:57 -05:00
Adam Locke
24e6b552d1
[7.17] [DOCS] Remove unused tag from rolling restart docs (#82967) (#82978)
* [DOCS] Remove unused tag from rolling restart docs (#82967)

# Conflicts:
#	docs/reference/setup/restart-cluster.asciidoc

* Adding the stop_indexing tag back, which is still used in 7.x

* Adding step that went missing
2022-01-24 14:47:50 -05:00
Rory Hunter
a1bf57fbbb Mention bind-mounting plugins dir in Docker docs (#82622)
Closes #69533.

The Docker docs mention bind-mounting the `config`, `data` and
`logs` directories when using an arbitrary UID / GID, but they fail
to mention that the `plugins` dir must also be mounted in order to
install plugins.
2022-01-24 17:13:36 +00:00
James Rodewig
f7dd3db685
[DOCS] Remove duplicated text (#82637) (#82882)
(cherry picked from commit 376e500e9c)

Co-authored-by: Daeho Ro <lamanus@outlook.kr>
2022-01-20 12:49:16 -05:00
James Rodewig
8feb6c54aa
[DOCS] Re-add cluster settings precedence (#82738) (#82748)
Adds some tags and an include statement to re-add cluster settings precedence information to the cluster update settings API page. This should aid with discoverability.

Closes https://github.com/elastic/elasticsearch/issues/82634

Relates to https://github.com/elastic/elasticsearch/pull/79579

(cherry picked from commit e21a9a0711)
2022-01-18 13:24:55 -05:00
James Rodewig
bf4c62e67d
[DOCS] Remove Windows MSI installer package (#81952)
After 7.16.2, we'll no longer produce Windows MSI installer packages for Elasticsearch. These packages were previously released in beta and didn't receive widespread adoption.

### Changes:

* Adds a related 7.17 breaking change.
* Adds a related 7.16 deprecation.
* Removes the MSI installation instructions.
* Removes references to the MSI installer.

I plan to port the applicable changes to 8.1 (main), 8.0, 7.17, and 7.16. In the 7.16 ports, I'll leave in the MSI install docs and add related deprecation notes to them instead.
2021-12-20 13:33:06 -05:00
James Rodewig
e3a049e393
[DOCS] Remove configuration management tools (#81938) (#81951)
Removes a section covering configuration management tools from the
installation instructions.

After 7.16.2, Elastic will no longer maintain these tools. Previously,
the tools were only supported on a "best effort" basis.
2021-12-20 11:44:01 -05:00
István Zoltán Szabó
72509415e1
[7.16][DOCS] Changes HLRC Client links. (#81513) 2021-12-08 12:56:47 +01:00
James Rodewig
19fb52f98c Fix typo 2021-11-18 08:44:27 -05:00
Philipp Krenn
820f45d9f0
[DOCS] Change Docker quickstart to only bind to localhost (#80812)
Under the [wrong circumstances](https://twitter.com/gnyman/status/1441073513457233928) our quickstart will expose Elasticsearch and Kibana to the internet, which is rather surprising and what we avoid with our other defaults / setups.
[Discussed](https://twitter.com/gnyman/status/1441119091645812742) [multiple](https://twitter.com/xeraa/status/1441164987049803787) [times](https://twitter.com/hmoffatt/status/1461067219647885315), we should explicitly bind to localhost to avoid such surprises. Those who know Docker reasonably well will be able to change it without problems and those who don't know Docker are probably better off like this.

Co-authored-by: James Rodewig <40268737+jrodewig@users.noreply.github.com>
2021-11-18 08:38:03 -05:00
James Rodewig
39397f9462
[DOCS] Un-deprecate transient cluster settings (#80766)
#80556 reverted the deprecation of transient cluster settings. This replaces deprecation language in the docs with a warning/recommendation to avoid transient settings.

Closes #80557
2021-11-16 15:47:23 -05:00
James Rodewig
c13cd213bc
[DOCS] Overhaul snapshot and restore docs (#79081) (#80733)
Makes several changes to consolidate snapshot and backup-related docs.

Highlights:

* Adds info about supported ESS snapshot repository types
* Adds docs for Kibana's Snapshot and Restore feature
* Combines tutorial pages related to taking and managing snapshots
* Consolidates explanations of the snapshot process
* Incorporates SLM into the snapshot tutorial
* Removes duplicate "back up a cluster" pages
2021-11-15 13:23:48 -05:00
David Turner
9acb783b93
Set LIBFFI_TMPDIR at startup (#80651) (#80699)
* Set LIBFFI_TMPDIR at startup (#80651)

Today if `libffi` cannot allocate pages of memory which are both
writeable and executable then it will attempt to write code to a
temporary file. Elasticsearch configures itself a suitable temporary
directory for use by JNA but by default `libffi` won't find this
directory and will try various other places. In certain configurations,
none of the other places that `libffi` tries are suitable. With older
versions of JNA this would result in a `SIGSEGV`; since #80617 the JVM
will exit with an exception.

With this commit we use the `LIBFFI_TMPDIR` environment variable to
configure `libffi` to use the same directory as JNA for its temporary
files if they are needed.

Closes #18272
Closes #73309
Closes #74545
Closes #77014
Closes #77053
Relates #77285

Co-authored-by: Rory Hunter <roryhunter2@gmail.com>

* Fix incorrect SSL usage

Co-authored-by: Rory Hunter <roryhunter2@gmail.com>
2021-11-15 09:45:48 -05:00
Rory Hunter
4f17b3db51 Use almalinux as the Docker base image (#80524)
Closes #76681. Our approach to using `scratch` for building Docker
images has caused problems at Docker Hub. Fix this situation by
removing the whole process of using scratch and instead bases the
default distribution on `almalinux:8.4-minimal`. Alma Linux is
binary-compatible with RHEL, and therefore very similar to UBI.
2021-11-10 13:42:02 +00:00
James Rodewig
07ac8818b6
[DOCS] Remove testenv annotations from doc snippet tests (#80023) (#80458)
Removes `testenv` annotations and related code. These annotations originally let you skip x-pack snippet tests in the docs. However, that's no longer possible.

Relates to #79309, #31619
# Conflicts:
#	docs/reference/ml/df-analytics/apis/get-trained-model-deployment-stats.asciidoc
#	docs/reference/ml/df-analytics/apis/infer-trained-model-deployment.asciidoc
#	docs/reference/ml/df-analytics/apis/put-trained-model-definition-part.asciidoc
#	docs/reference/ml/df-analytics/apis/put-trained-model-vocabulary.asciidoc
#	docs/reference/ml/df-analytics/apis/start-trained-model-deployment.asciidoc
#	docs/reference/ml/df-analytics/apis/stop-trained-model-deployment.asciidoc
#	docs/reference/slm/apis/slm-delete.asciidoc
#	docs/reference/slm/apis/slm-execute-retention.asciidoc
#	docs/reference/slm/apis/slm-execute.asciidoc
#	docs/reference/slm/apis/slm-get-status.asciidoc
#	docs/reference/slm/apis/slm-get.asciidoc
#	docs/reference/slm/apis/slm-start.asciidoc
#	docs/reference/slm/apis/slm-stats.asciidoc
#	docs/reference/slm/apis/slm-stop.asciidoc
#	docs/reference/sql/endpoints/client-apps/tableau-desktop.asciidoc
#	docs/reference/sql/endpoints/client-apps/tableau-server.asciidoc
2021-11-05 19:41:54 -04:00
James Rodewig
b9cbe956e2
[DOCS] Docker configs should set network.host to 0.0.0.0 (#80042) (#80455)
The `elasticsearch.yml` file that ships with our Docker image includes the
`network.host: 0.0.0.0` setting by default. If a user bind-mounts a custom
config file, it should include this setting to ensure Elasticsearch is reachable.

Closes #77937.
2021-11-05 18:48:40 -04:00
Adam Locke
f7334219e1
[DOCS] Fix HOSTNAME quotes (#80115) (#80296)
error: export HOSTNAME=“host1,host2"

Co-authored-by: Kyle.K.Zhao <13636814471@163.com>
2021-11-03 14:14:29 -04:00
James Rodewig
ff0b01ce40
[DOCS] Add transient settings migration guide (#80091)
Changes:

* Adds a transient settings migration guide to the 7.16 docs.
* Updates the related deprecation docs to link to the guide.

Closes #80055 

Relates to #79167.
2021-11-03 09:06:12 -04:00
James Rodewig
d3fa9b7592
[DOCS] Fix formatting for Docker mem lock example (#79963) (#79967)
This places the example in a code snippet block rather than just using monospace.
2021-10-27 17:43:47 -04:00
Adam Locke
d96a13a801
[DOCS] Add missing system config entry (#79830) (#79841)
* [DOCS] Add missing system config entry

* Save and commit my actual changes
2021-10-26 12:15:37 -04:00
James Rodewig
fb7d61bb54 [DOCS] Minor grammar fix 2021-10-26 12:14:30 -04:00
James Rodewig
3f264ba21b
[DOCS] Update ESS best practice for dynamic cluster settings (#79579) (#79839)
Changes:

* Updates a tip in the configuration docs to point Cloud users to the [edit user settings](https://www.elastic.co/guide/en/cloud/current/ec-add-user-settings.html) feature.
* Removes some duplicate content from the cluster update settings API docs.

Relates to https://github.com/elastic/cloud/pull/90394

Co-authored-by: David Kilfoyle <41695641+kilfoyle@users.noreply.github.com>

Co-authored-by: David Kilfoyle <41695641+kilfoyle@users.noreply.github.com>
2021-10-26 12:08:01 -04:00
David Turner
71a5b00074
Expand warning about modifying data path contents (#79649) (#79656)
Today we have a short note in one place in the docs saying not to touch
the contents of the data path. This commit expands the warning to
describe more precisely what is forbidden, and to give some more detail
of the consequences, and also duplicates the warning to the other
location that documents the `path.data` setting.
2021-10-21 16:39:57 -04:00
Nikola Grcevski
8512037aaa
[7.x] Deprecation of transient cluster settings (#78794) (#79288)
This PR changes uses of transient cluster settings to
persistent cluster settings.

The PR also deprecates the transient settings usage.

Relates to #49540
2021-10-15 19:06:33 -04:00
Przemyslaw Gomulka
d8a6a7af1f
Setting to disable x-opaque-id in logs throttling backport(#78911) (#78982)
Introduces a setting cluster.deprecation_indexing.x_opaque_id_used.enabled to disable use of
x-opaque-id in RateLimitingFilter. This will be used for deprecation
logs indexing and will not affect logging to files (it uses different
instance of RateLimitingFilter with this flag enabled by default)

Changes the indices backing a deprecation log data stream to be hidden.

Refactors DeprecationHttpIT to be more reliable

relates #76292
closes #77936

backport #78911
2021-10-12 14:25:57 +02:00
James Rodewig
cc3396e76b
[DOCS] Re-add docs for multiple data paths (MDP) (#78342) (#78384)
We deprecated support for multiple data paths (MDP) in 7.13. However,
we won't remove support until after 8.0.

Changes:

* Reverts PR #72267, which removed MDP docs
* Removes a related item from the 8.0 breaking changes.
2021-09-28 09:40:02 -04:00
Przemyslaw Gomulka
7b028645aa
[doc] Improve documentation for deprecation logging (#78326) (#78330)
adding a section on WARN messages

relates #77030
2021-09-27 11:07:10 -04:00
Przemyslaw Gomulka
4ef3a58a46
Change default deprecation logger level to CRITICAL backport(#77030) (#77482)
This commit changes default deprecation logger level to CRITICAL, where default means deprecations emitted by DeprecationLogger#critical method.
It also introduces WARN deprecations which are emitted by DeprecationLogger#warn Those log lines emitted at WARN are meant to indicate that a functionality is deprecated but will not break at next major version.
relates #76754
2021-09-27 13:43:16 +02:00
Adam Locke
2174b4642d
[DOCS] Update remote cluster docs (#77043) (#78212)
* [DOCS] Update remote cluster docs

* Add files, rename files, write new stuff

* Plethora of changes

* Add test and update snippets

* Redirects, moved files, and test updates

* Moved file to x-pack for tests

* Remove older CCS page and add redirects

* Cleanup, link updates, and some rewrites

* Update image

* Incorporating user feedback and rewriting much of the remote clusters page

* More changes from review feedback

* Numerous updates, including request examples for CCS and Kibana

* More changes from review feedback

* Minor clarifications on security for remote clusters

* Incorporate review feedback

Co-authored-by: Yang Wang <ywangd@gmail.com>

* Some review feedback and some editorial changes

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
Co-authored-by: Yang Wang <ywangd@gmail.com>
# Conflicts:
#	docs/reference/modules/network.asciidoc
#	docs/reference/modules/remote-clusters.asciidoc
#	x-pack/docs/en/security/ccs-clients-integrations/cross-cluster.asciidoc
#	x-pack/docs/en/security/ccs-clients-integrations/index.asciidoc

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2021-09-23 12:13:03 +02:00
István Zoltán Szabó
e426ce8673
[DOCS] Fixes broken links. (#78233) 2021-09-23 10:36:41 +02:00
James Rodewig
a6a9ea2fb0
[DOCS] Fix ESS install lead-in (#77887) (#77890)
Replaces the hard-coded ESS lead-in with the docs attribute.

Previously, this copy omitted Microsoft Azure. This ensures these docs are better maintained.
2021-09-16 12:18:42 -04:00
James Rodewig
586fe11cf4
[DOCS] Re-add KEYSTORE_PASSWORD example to Docker install docs (#77588) (#77590)
PR #77155 updated the keystore instructions for Docker. However, it removed an
example that included the `KEYSTORE_PASSWORD` env variable.

This replaces a docker compose example with the original example from PR #51123.

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2021-09-10 17:58:40 -04:00
James Rodewig
633cfec6aa
[DOCS] Fix keystore creation instructions for Docker (#77155) (#77559)
Currently, our Docker install docs instruct users to directly bind-mount the `elasticsearch.keystore` file. This can lead to errors:

* If the keystore file doesn't already exist, Docker's `-v` flag will create `elasticsearch.keystore` as a directory. This will block the creation of the keystore file.
* To add or update secure settings, the container needs access to other files in the `config` directory, such as `keystore.tmp`.

This updates the Docker install docs to instruct users to bind-mount the `config` directory rather than `elasticsearch.keystore`. It also adds troubleshooting tips for errors related to the keystore.

Co-authored-by: James Rodewig <40268737+jrodewig@users.noreply.github.com>

Co-authored-by: Stef Nestor <steffanie.nestor@gmail.com>
2021-09-10 11:20:53 -04:00
David Turner
6d81038c09 Clarify 'runs in the foreground' (#76709)
Users following the installation guide sometimes get stuck, reporting
that Elasticsearch has "hung" after running `./bin/elasticsearch`
because it doesn't exit, it just sits there in the foreground waiting
for something to happen. We do say that it "runs in the foreground" in
the docs but that's not clear enough, maybe folks expect it to declare
it started up successfully or to open a browser window for them or
something.

This commit expands the docs to clarify what users should expect from
running Elasticsearch from the command line and what they should do
next.
2021-09-06 12:29:38 +01:00
Rory Hunter
ed33dafeb7 Change env var prefix in Docker settings support (#76192)
Closes #76148. Previously, in #74327, we added support for setting
Elasticsearch settings in the Docker image via environment variables.
However there are scenarios e.g in Kubernetes where it is easy to
accidentally define environment variables that the ES startup process
rejects.

Work around this by using the more explicit env var prefix
`ES_SETTING_`.
2021-08-09 10:15:22 +01:00
James Rodewig
6d622afa89
[DOCS] Correct docs for deprecation logging (#75361) (#75461)
By default, `logger.deprecation.level` logs messages at the `DEPRECATION` level. This updates
and reorganizes the related docs.

Co-authored-by: James Rodewig <40268737+jrodewig@users.noreply.github.com>

Co-authored-by: Robin Clarke <robin.clarke@elastic.co>
2021-07-19 11:10:15 -04:00
Rory Hunter
f3b25f43c5 Accept settings in snake case in Docker image (#74327)
Closes #74036. Since some orchestration platforms forbid periods in
environment variable names, allow Docker users to pass settings to ES
using an alternative name scheme. For example:

    bootstrap.memory_lock

...becomes:

    ES_BOOTSTRAP_MEMORY__LOCK

The setting name is uppercased, prefixed, all underscores are converted
to double underscores, and all periods are converted to underscores.
2021-07-09 19:59:42 +01:00