[scalability testing] skip unloading archives after journey (#151476)

## Summary

Sometimes scalability testing might make Kibana not responding and it
causes after hook with unloading kbn archives to
[fail](https://buildkite.com/elastic/kibana-apis-capacity-testing/builds/241#01865418-2579-4559-bd4e-432c48a2104d):

```
2023-02-15T08:33:37.825Z proc [scalability-tests]  proc [gatling: test] Simulation org.kibanaLoadTest.simulation.generic.GenericJourney completed in 268 seconds
2023-02-15T08:38:06.749Z proc [scalability-tests]  proc [gatling: test] java.lang.reflect.InvocationTargetException
2023-02-15T08:41:06.006Z proc [scalability-tests]  proc [gatling: test] 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2023-02-15T08:41:06.006Z proc [scalability-tests]  proc [gatling: test] 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
2023-02-15T08:41:06.006Z proc [scalability-tests]  proc [gatling: test] 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2023-02-15T08:41:06.006Z proc [scalability-tests]  proc [gatling: test] 	at java.base/java.lang.reflect.Method.invoke(Method.java:568)
2023-02-15T08:41:06.006Z proc [scalability-tests]  proc [gatling: test] 	at io.gatling.plugin.util.ForkMain.runMain(ForkMain.java:67)
2023-02-15T08:41:06.006Z proc [scalability-tests]  proc [gatling: test] 	at io.gatling.plugin.util.ForkMain.main(ForkMain.java:35)
2023-02-15T08:41:06.006Z proc [scalability-tests]  proc [gatling: test] Caused by: java.lang.RuntimeException: Login request failed: org.apache.http.NoHttpResponseException: localhost:5620 failed to respond
2023-02-15T08:41:06.006Z proc [scalability-tests]  proc [gatling: test] 	at org.kibanaLoadTest.helpers.KbnClient.getCookie(KbnClient.scala:72)
2023-02-15T08:41:06.006Z proc [scalability-tests]  proc [gatling: test] 	at org.kibanaLoadTest.helpers.KbnClient.getClientAndConnectionManager(KbnClient.scala:50)
2023-02-15T08:41:06.006Z proc [scalability-tests]  proc [gatling: test] 	at org.kibanaLoadTest.helpers.KbnClient.unload(KbnClient.scala:139)
2023-02-15T08:41:06.006Z proc [scalability-tests]  proc [gatling: test] 	at org.kibanaLoadTest.simulation.generic.GenericJourney.$anonfun$new$5(GenericJourney.scala:153)
2023-02-15T08:41:06.007Z proc [scalability-tests]  proc [gatling: test] 	at org.kibanaLoadTest.simulation.generic.GenericJourney.$anonfun$new$5$adapted(GenericJourney.scala:153)
2023-02-15T08:41:06.007Z proc [scalability-tests]  proc [gatling: test] 	at org.kibanaLoadTest.simulation.generic.GenericJourney.$anonfun$testDataLoader$2(GenericJourney.scala:47)
2023-02-15T08:41:06.007Z proc [scalability-tests]  proc [gatling: test] 	at org.kibanaLoadTest.simulation.generic.GenericJourney.$anonfun$testDataLoader$2$adapted(GenericJourney.scala:46)
2023-02-15T08:41:06.007Z proc [scalability-tests]  proc [gatling: test] 	at scala.collection.ArrayOps$.foreach$extension(ArrayOps.scala:1321)
2023-02-15T08:41:06.007Z proc [scalability-tests]  proc [gatling: test] 	at org.kibanaLoadTest.simulation.generic.GenericJourney.testDataLoader(GenericJourney.scala:46)
2023-02-15T08:41:06.007Z proc [scalability-tests]  proc [gatling: test] 	at org.kibanaLoadTest.simulation.generic.GenericJourney.$anonfun$new$4(GenericJourney.scala:154)
2023-02-15T08:41:06.007Z proc [scalability-tests]  proc [gatling: test] 	at io.gatling.core.scenario.Simulation.$anonfun$params$18(Simulation.scala:176)
2023-02-15T08:41:06.007Z proc [scalability-tests]  proc [gatling: test] 	at io.gatling.core.scenario.Simulation.$anonfun$params$18$adapted(Simulation.scala:176)
2023-02-15T08:41:06.007Z proc [scalability-tests]  proc [gatling: test] 	at scala.collection.immutable.List.foreach(List.scala:333)
2023-02-15T08:41:06.007Z proc [scalability-tests]  proc [gatling: test] 	at io.gatling.core.scenario.Simulation.$anonfun$params$17(Simulation.scala:176)
2023-02-15T08:41:06.007Z proc [scalability-tests]  proc [gatling: test] 	at io.gatling.app.Runner.run(Runner.scala:62)
2023-02-15T08:41:06.007Z proc [scalability-tests]  proc [gatling: test] 	at io.gatling.app.Gatling$.start(Gatling.scala:89)
2023-02-15T08:41:06.007Z proc [scalability-tests]  proc [gatling: test] 	at io.gatling.app.Gatling$.fromArgs(Gatling.scala:51)
2023-02-15T08:41:06.007Z proc [scalability-tests]  proc [gatling: test] 	at io.gatling.app.Gatling$.main(Gatling.scala:39)
2023-02-15T08:41:06.007Z proc [scalability-tests]  proc [gatling: test] 	at io.gatling.app.Gatling.main(Gatling.scala)
2023-02-15T08:41:06.007Z proc [scalability-tests]  proc [gatling: test] 	... 6 more
```

The journey is marked as failed though we actually got the metrics. This
PR add flag to Gatling runner command that skips running cleanup on
journey teardown.
This commit is contained in:
Dzmitry Lemechko 2023-02-22 12:25:48 +01:00 committed by GitHub
parent 26bd714af8
commit 5c8bf9a94c
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23

View file

@ -83,6 +83,8 @@ export async function ScalabilityTestRunner(
`-Dgatling.core.outputDirectoryBaseName=${gatlingReportBaseDir}`,
'-Dgatling.simulationClass=org.kibanaLoadTest.simulation.generic.GenericJourney',
`-DjourneyPath=${scalabilityJsonPath}`,
// skip unloading kbn/es archives on journey finish since we shutdown instances anyway
`-DskipCleanupOnTeardown=true`,
],
cwd: gatlingProjectRootPath,
env: {