kibana/test
Dzmitry Lemechko 23decee29e
[8.8] Update ftr services to handle occasional WebDriverError (#157283) (#157326)
# Backport

This will backport the following commits from `main` to `8.8`:
- [Update ftr services to handle occasional WebDriverError
(#157283)](https://github.com/elastic/kibana/pull/157283)

<!--- Backport version: 8.9.7 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sqren/backport)

<!--BACKPORT [{"author":{"name":"Dzmitry
Lemechko","email":"dzmitry.lemechko@elastic.co"},"sourceCommit":{"committedDate":"2023-05-10T18:00:44Z","message":"Update
ftr services to handle occasional WebDriverError (#157283)\n\n##
Summary\r\n\r\nStarting with Chrome v113 we noticed that
`_area_chart.ts` suite became\r\nflaky #156821 failing
with\r\n`WebDriverError: unknown error: unhandled inspector
error:\r\n{\"code\":-32000,\"message\":\"No node with given id
found\"}`\r\nUpdating chromedriver to v113 did not solve the issue and
more tests\r\nstarted to fail with the same error.\r\n\r\nIt happens
occasionally when driver returns unhandled error instead
of\r\nStaleElementReferenceException. This PR adds the error to
the\r\n`RETRY_ON_ERRORS` list, so that FTR can search for the element
again and\r\nre-try the action on it:\r\n\r\n```\r\n │ debg
getVisibleText:
elementId=29C3E81151C86107290DD8F020524333_element_290\r\n │ debg
Chromedriver issue #4440, WebElementWrapper.getVisibleText:
WebDriverError: unknown error: unhandled inspector error:
{\"code\":-32000,\"message\":\"No node with given id found\"}\r\n │
(Session info: chrome=113.0.5672.63)\r\n │ debg current
ElementID=29C3E81151C86107290DD8F020524333_element_290\r\n │ debg new
ElementID=29C3E81151C86107290DD8F020524333_element_293\r\n │ debg
Searching again for the element 'By(css selector,
[data-test-subj=\"visEditorInterval\"] + .euiFormErrorText)', 2 attempts
left\r\n │ debg getVisibleText:
elementId=29C3E81151C86107290DD8F020524333_element_293\r\n └- ✓ pass
(1.8s)\r\n```\r\n\r\nThere is no need to use `Retry` service,
`WebDriverWrapper.retryCall`\r\nshould handle the issue.\r\n\r\nFlaky
test runner 100x for Vis Editor
config:\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/2236\r\nFlaky
test runner 100x for Cases
config:\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/2237\r\n\r\nAnd
2 more
100x:\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/2239\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/2237","sha":"7f4ceb1d302cf24411c1b82030b882e87a8616dd","branchLabelMapping":{"^v8.9.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","v8.7.2","v8.9.0","v8.8.1"],"number":157283,"url":"https://github.com/elastic/kibana/pull/157283","mergeCommit":{"message":"Update
ftr services to handle occasional WebDriverError (#157283)\n\n##
Summary\r\n\r\nStarting with Chrome v113 we noticed that
`_area_chart.ts` suite became\r\nflaky #156821 failing
with\r\n`WebDriverError: unknown error: unhandled inspector
error:\r\n{\"code\":-32000,\"message\":\"No node with given id
found\"}`\r\nUpdating chromedriver to v113 did not solve the issue and
more tests\r\nstarted to fail with the same error.\r\n\r\nIt happens
occasionally when driver returns unhandled error instead
of\r\nStaleElementReferenceException. This PR adds the error to
the\r\n`RETRY_ON_ERRORS` list, so that FTR can search for the element
again and\r\nre-try the action on it:\r\n\r\n```\r\n │ debg
getVisibleText:
elementId=29C3E81151C86107290DD8F020524333_element_290\r\n │ debg
Chromedriver issue #4440, WebElementWrapper.getVisibleText:
WebDriverError: unknown error: unhandled inspector error:
{\"code\":-32000,\"message\":\"No node with given id found\"}\r\n │
(Session info: chrome=113.0.5672.63)\r\n │ debg current
ElementID=29C3E81151C86107290DD8F020524333_element_290\r\n │ debg new
ElementID=29C3E81151C86107290DD8F020524333_element_293\r\n │ debg
Searching again for the element 'By(css selector,
[data-test-subj=\"visEditorInterval\"] + .euiFormErrorText)', 2 attempts
left\r\n │ debg getVisibleText:
elementId=29C3E81151C86107290DD8F020524333_element_293\r\n └- ✓ pass
(1.8s)\r\n```\r\n\r\nThere is no need to use `Retry` service,
`WebDriverWrapper.retryCall`\r\nshould handle the issue.\r\n\r\nFlaky
test runner 100x for Vis Editor
config:\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/2236\r\nFlaky
test runner 100x for Cases
config:\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/2237\r\n\r\nAnd
2 more
100x:\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/2239\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/2237","sha":"7f4ceb1d302cf24411c1b82030b882e87a8616dd"}},"sourceBranch":"main","suggestedTargetBranches":["8.7","8.8"],"targetPullRequestStates":[{"branch":"8.7","label":"v8.7.2","labelRegex":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"main","label":"v8.9.0","labelRegex":"^v8.9.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/157283","number":157283,"mergeCommit":{"message":"Update
ftr services to handle occasional WebDriverError (#157283)\n\n##
Summary\r\n\r\nStarting with Chrome v113 we noticed that
`_area_chart.ts` suite became\r\nflaky #156821 failing
with\r\n`WebDriverError: unknown error: unhandled inspector
error:\r\n{\"code\":-32000,\"message\":\"No node with given id
found\"}`\r\nUpdating chromedriver to v113 did not solve the issue and
more tests\r\nstarted to fail with the same error.\r\n\r\nIt happens
occasionally when driver returns unhandled error instead
of\r\nStaleElementReferenceException. This PR adds the error to
the\r\n`RETRY_ON_ERRORS` list, so that FTR can search for the element
again and\r\nre-try the action on it:\r\n\r\n```\r\n │ debg
getVisibleText:
elementId=29C3E81151C86107290DD8F020524333_element_290\r\n │ debg
Chromedriver issue #4440, WebElementWrapper.getVisibleText:
WebDriverError: unknown error: unhandled inspector error:
{\"code\":-32000,\"message\":\"No node with given id found\"}\r\n │
(Session info: chrome=113.0.5672.63)\r\n │ debg current
ElementID=29C3E81151C86107290DD8F020524333_element_290\r\n │ debg new
ElementID=29C3E81151C86107290DD8F020524333_element_293\r\n │ debg
Searching again for the element 'By(css selector,
[data-test-subj=\"visEditorInterval\"] + .euiFormErrorText)', 2 attempts
left\r\n │ debg getVisibleText:
elementId=29C3E81151C86107290DD8F020524333_element_293\r\n └- ✓ pass
(1.8s)\r\n```\r\n\r\nThere is no need to use `Retry` service,
`WebDriverWrapper.retryCall`\r\nshould handle the issue.\r\n\r\nFlaky
test runner 100x for Vis Editor
config:\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/2236\r\nFlaky
test runner 100x for Cases
config:\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/2237\r\n\r\nAnd
2 more
100x:\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/2239\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/2237","sha":"7f4ceb1d302cf24411c1b82030b882e87a8616dd"}},{"branch":"8.8","label":"v8.8.1","labelRegex":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}]
BACKPORT-->
2023-05-10 13:50:57 -07:00
..
accessibility [Dashboard Usability] Unified dashboard settings (#153862) 2023-03-31 09:52:51 -04:00
analytics [8.8] [EBT] Resize event flakiness (#156184) (#156688) 2023-05-04 07:11:11 -07:00
api_integration [8.8] [Enterprise Search] Add Jira, Confluence, Sharepoint connectors (#157167) (#157259) 2023-05-10 06:23:56 -07:00
common [Shared UX] Adoption of Shared UX Route component (#150357) 2023-02-14 19:25:04 +00:00
examples [8.8] skip failing test (#156802) (#156819) 2023-05-05 04:11:39 -07:00
functional [8.8] Update ftr services to handle occasional WebDriverError (#157283) (#157326) 2023-05-10 13:50:57 -07:00
harden Add test to ensure security related eslint rules are applied (#151434) 2023-02-24 16:48:11 +01:00
health_gateway [packages] migrate all plugins to packages (#148130) 2023-02-08 21:06:50 -06:00
interactive_setup_api_integration [packages] migrate all plugins to packages (#148130) 2023-02-08 21:06:50 -06:00
interactive_setup_functional Move real plugins out of 'fixtures' dirs (#148756) 2023-01-12 12:38:49 -07:00
interpreter_functional [packages] migrate all plugins to packages (#148130) 2023-02-08 21:06:50 -06:00
node_roles_functional [Migrations] Add migrator node role (#151978) 2023-02-27 06:49:31 -07:00
package Adds base implementation of the Kibana Health Gateway. (#141172) 2022-11-07 09:14:42 -07:00
plugin_functional [Dashboard] fix custom time ranges not applied to panel until global query context changes (#155458) 2023-04-26 07:02:59 -06:00
scripts [Security Solution] Side navigation package (#152924) 2023-03-10 18:14:56 +01:00
server_integration [packages] migrate all plugins to packages (#148130) 2023-02-08 21:06:50 -06:00
ui_capabilities/newsfeed_err [ftr] automatically determine config run order (#130983) 2022-05-04 17:05:58 -05:00
tsconfig.json Split the .kibana saved objects index into multiple indices (#154888) 2023-04-25 09:43:42 +02:00