[scout] use project deps as global hooks for parallel tests (#211409)

## Summary

Currently we are using `globalSetup` [script in configuration
file](https://playwright.dev/docs/test-global-setup-teardown#option-2-configure-globalsetup-and-globalteardown)
to ingest Elasticsearch data before running the tests in parallel
against the same ES/Kibana instances.

This approach doesn't work well when you need to adjust `globalSetup`
logic based on specific condition, e.g. configuration file defining
where servers are hosted, its credentials, etc.

Not only global hook, but `ScoutConfig` fixture expects an argument to
define where servers configuration is defined:


cd502acea1/packages/kbn-scout/src/playwright/fixtures/worker/core_fixtures.ts (L65-L75)

`testInfo` is how Playwright exposes currently running configuration in
a form of `project` interface:
[projects](https://playwright.dev/docs/test-projects) can be used to
group tests, e.g. for specific envs or browsers.

Unfortunately `testInfo` is not exposed in global scripts, because in
Playwright project design `globalSetup` scripts are run before multiple
projects and projects can have its own `setup` hooks via
[dependencies](https://playwright.dev/docs/test-global-setup-teardown#option-1-project-dependencies):

```
    {
      name: 'setup',
      testMatch: /global.setup\.ts/,
    },
    {
      name: 'local',
      use: { ...devices['Desktop Chrome'], configName: 'local' },
      dependencies: 'setup',
    },
``` 

We already use project API to get `serversConfigDir` path, where we plan
to store local and cloud server configurations. This PR proposes to
define projects as `local` and `cloud` (maybe even separate `cloud-mki`,
`cloud-ech`) as a way to provide playwright information about servers
configuration.

Advantages:
1. we can re-use existing fixtures as-is, without adding custom exported
helper functions for ES data ingestion
2. project dependency is displayed as `setup` in Playwright report
3. way better and simpler design for consumers:
```
import { globalSetupHook } from '@kbn/scout';

globalSetupHook('Ingest data to Elasticsearch', async ({ esArchiver, log }) => {
  // add archives to load, if needed
  const archives = [
    testData.ES_ARCHIVES.LOGSTASH,
  ];

  log.debug('[setup] loading test data (only if indexes do not exist)...');
  for (const archive of archives) {
    await esArchiver.loadIfNeeded(archive);
  }
});
```
4. it is supported by VSCode Playwright plugin
<img width="1271" alt="Screenshot 2025-02-17 at 11 26 12"
src="https://github.com/user-attachments/assets/ba7eeb38-d39d-4785-9c11-18647599ec4a"
/>

I find it extremely useful because you don't need to change env var when
you want to switch b/w local or cloud run, all the configurations are
loaded automatically and you just tick the checkbox!

Disadvantages:
1. it is important to run `playwright test` with `--project` flag to use
the proper configuration
2. we have to define how `projects` are used for local and cloud
configuration, and make sure it meets requirements of multiple teams. We
can expose a way to pass custom project definitions in
`createPlaywrightConfig` function, but it might complicate the support
effort when every Team has too many custom projects.
3. `project` term is something we can't change and might be confusing
4. Since it is a Playwright feature, we might not have consistency with
API tests runner under Scout

For reviewers: 

Playing with it locally might give a better understanding about the
pros/cons, especially with IDE playwright plugin installed.

Running servers with tests:
```
node scripts/scout.js run-tests --serverless=oblt --testTarget=local --config x-pack/platform/plugins/private/discover_enhanced/ui_tests/playwright.config.ts

node scripts/scout.js run-tests --serverless=oblt --config x-pack/platform/plugins/private/discover_enhanced/ui_tests/playwright.config.ts
```

Running test only requires passing `project` argument:

```
npx playwright test --project=local --config x-pack/platform/plugins/private/discover_enhanced/ui_tests/playwright.config.ts

npx playwright test --project=local --config x-pack/platform/plugins/private/discover_enhanced/ui_tests/parallel.playwright.config.ts
```

---------

Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
Co-authored-by: jennypavlova <jennypavlova94@gmail.com>

.eslintrc.js

@@ -1471,7 +1471,8 @@ module.exports = {
         'playwright/no-slowed-test': 'error',
         'playwright/no-standalone-expect': 'error',
         'playwright/no-unsafe-references': 'error',
-        'playwright/no-wait-for-selector': 'warn',
+        'playwright/no-useless-await': 'error',
+        'playwright/no-wait-for-selector': 'error',
         'playwright/max-nested-describe': ['error', { max: 1 }],
         'playwright/missing-playwright-await': 'error',
         'playwright/prefer-comparison-matcher': 'error',

src/platform/packages/private/kbn-scout-reporting/src/helpers/cli_processing.test.ts

@@ -12,10 +12,19 @@ import { getRunTarget, stripRunCommand } from './cli_processing';
 describe('cli_processing', () => {
   describe('stripRunCommand', () => {
     it(`should return the correct run command when started with 'npx'`, () => {
-      const argv = ['npx', 'playwright', 'test', '--config', 'path/to/config', '--grep=@svlSearch'];
+      const argv = [
+        'npx',
+        'playwright',
+        'test',
+        '--config',
+        'path/to/config',
+        '--project',
+        'local',
+        '--grep=@svlSearch',
+      ];
 
       expect(stripRunCommand(argv)).toBe(
-        'npx playwright test --config path/to/config --grep=@svlSearch'
+        'npx playwright test --config path/to/config --project local --grep=@svlSearch'
       );
     });
 
@@ -26,11 +35,13 @@ describe('cli_processing', () => {
         'test',
         '--config',
         'path/to/config',
+        '--project',
+        'local',
         '--grep=@svlSearch',
       ];
 
       expect(stripRunCommand(argv)).toBe(
-        'npx playwright test --config path/to/config --grep=@svlSearch'
+        'npx playwright test --config path/to/config --project local --grep=@svlSearch'
       );
     });
 

src/platform/packages/shared/kbn-scout/README.md

@@ -186,9 +186,11 @@ If the servers are already running, you can execute tests independently using ei
 - Command Line: Use the following command to run tests:
 
 ```bash
-npx playwright test --config <plugin-path>/ui_tests/playwright.config.ts
+npx playwright test --config <plugin-path>/ui_tests/playwright.config.ts --project local
 ```
 
+We use `project` flag to define test target, where tests to be run: local servers or Elastic Cloud. Currently we only support local servers.
+
 ### Contributing
 
 We welcome contributions to improve and extend `kbn-scout`. This guide will help you get started, add new features, and align with existing project standards.

src/platform/packages/shared/kbn-scout/index.ts

@@ -12,11 +12,10 @@ export {
   expect,
   test,
   spaceTest,
+  globalSetupHook,
   tags,
   createPlaywrightConfig,
   createLazyPageObject,
-  ingestTestDataHook,
-  ingestSynthtraceDataHook,
 } from './src/playwright';
 export type {
   ScoutPlaywrightOptions,

src/platform/packages/shared/kbn-scout/src/playwright/config/create_config.test.ts

@@ -64,7 +64,8 @@ describe('createPlaywrightConfig', () => {
     expect(config.timeout).toBe(60000);
     expect(config.expect?.timeout).toBe(10000);
     expect(config.outputDir).toBe('./output/test-artifacts');
-    expect(config.projects![0].name).toEqual('chromium');
+    expect(config.projects).toHaveLength(1);
+    expect(config.projects![0].name).toEqual('local');
   });
 
   it('should return a Playwright configuration with Scout reporters', () => {
@@ -96,12 +97,17 @@ describe('createPlaywrightConfig', () => {
     ]);
   });
 
-  it(`should override 'workers' count in Playwright configuration`, () => {
+  it(`should override 'workers' count and add 'setup' project dependency`, () => {
     const testDir = './my_tests';
     const workers = 2;
 
     const config = createPlaywrightConfig({ testDir, workers });
     expect(config.workers).toBe(workers);
+
+    expect(config.projects).toHaveLength(2);
+    expect(config.projects![0].name).toEqual('setup');
+    expect(config.projects![1].name).toEqual('local');
+    expect(config.projects![1]).toHaveProperty('dependencies', ['setup']);
   });
 
   it('should generate and cache runId in process.env.TEST_RUN_ID', () => {

src/platform/packages/shared/kbn-scout/src/playwright/config/create_config.ts

@@ -27,9 +27,34 @@ export function createPlaywrightConfig(options: ScoutPlaywrightOptions): Playwri
     process.env.TEST_RUN_ID = runId;
   }
 
+  const scoutProjects: PlaywrightTestConfig<ScoutTestOptions>['projects'] = [
+    {
+      name: 'local',
+      use: { ...devices['Desktop Chrome'], configName: 'local' },
+    },
+  ];
+
+  /**
+   * For parallel tests, we need to add a setup project that runs before the tests project.
+   */
+  if (options.workers && options.workers > 1) {
+    const parentProject = scoutProjects.find((p) => p.use?.configName);
+
+    scoutProjects.unshift({
+      name: 'setup',
+      use: parentProject?.use ? { ...parentProject.use } : {},
+      testMatch: /global.setup\.ts/,
+    });
+
+    scoutProjects.forEach((project) => {
+      if (project.name !== 'setup') {
+        project.dependencies = ['setup'];
+      }
+    });
+  }
+
   return defineConfig<ScoutTestOptions>({
     testDir: options.testDir,
-    globalSetup: options.globalSetup,
     /* Run tests in files in parallel */
     fullyParallel: false,
     /* Fail the build on CI if you accidentally left test.only in the source code. */
@@ -47,6 +72,7 @@ export function createPlaywrightConfig(options: ScoutPlaywrightOptions): Playwri
     ],
     /* Shared settings for all the projects below. See https://playwright.dev/docs/api/class-testoptions. */
     use: {
+      // 'configName' is not defined by default to enforce using '--project' flag when running the tests
       testIdAttribute: 'data-test-subj',
       serversConfigDir: SCOUT_SERVERS_ROOT,
       [VALID_CONFIG_MARKER]: true,
@@ -70,24 +96,6 @@ export function createPlaywrightConfig(options: ScoutPlaywrightOptions): Playwri
 
     outputDir: './output/test-artifacts', // For other test artifacts (screenshots, videos, traces)
 
-    /* Configure projects for major browsers */
-    projects: [
-      {
-        name: 'chromium',
-        use: { ...devices['Desktop Chrome'] },
-      },
-
-      // {
-      //   name: 'firefox',
-      //   use: { ...devices['Desktop Firefox'] },
-      // },
-    ],
-
-    /* Run your local dev server before starting the tests */
-    // webServer: {
-    //   command: 'npm run start',
-    //   url: 'http://127.0.0.1:3000',
-    //   reuseExistingServer: !process.env.CI,
-    // },
+    projects: scoutProjects,
   });
 }

src/platform/packages/shared/kbn-scout/src/playwright/fixtures/parallel_run_fixtures.ts

@@ -8,7 +8,13 @@
  */
 
 import { mergeTests } from 'playwright/test';
-import { apiFixtures, coreWorkerFixtures, scoutSpaceParallelFixture } from './worker';
+import {
+  apiFixtures,
+  coreWorkerFixtures,
+  esArchiverFixture,
+  scoutSpaceParallelFixture,
+  synthtraceFixture,
+} from './worker';
 import type {
   ApiParallelWorkerFixtures,
   EsClient,
@@ -52,3 +58,10 @@ export interface ScoutParallelWorkerFixtures extends ApiParallelWorkerFixtures {
   esClient: EsClient;
   scoutSpace: ScoutSpaceParallelFixture;
 }
+
+export const globalSetup = mergeTests(
+  coreWorkerFixtures,
+  esArchiverFixture,
+  synthtraceFixture,
+  apiFixtures
+);

src/platform/packages/shared/kbn-scout/src/playwright/fixtures/worker/core_fixtures.ts

@@ -66,10 +66,15 @@ export const coreWorkerFixtures = base.extend<
    */
   config: [
     ({ log }, use, workerInfo) => {
-      const configName = 'local';
       const projectUse = workerInfo.project.use as ScoutTestOptions;
+      if (!projectUse.configName) {
+        throw new Error(
+          `Failed to read the 'configName' property. Make sure to run tests with '--project' flag and target enviroment (local or cloud),
+          e.g. 'npx playwright test --project local --config <path_to_Playwright.config.ts>'`
+        );
+      }
       const serversConfigDir = projectUse.serversConfigDir;
-      const configInstance = createScoutConfig(serversConfigDir, configName, log);
+      const configInstance = createScoutConfig(serversConfigDir, projectUse.configName, log);
 
       use(configInstance);
     },

src/platform/packages/shared/kbn-scout/src/playwright/fixtures/worker/synthtrace.ts

@@ -8,7 +8,13 @@
  */
 
 import { Readable } from 'stream';
-import type { ApmFields, Fields, InfraDocument, OtelDocument } from '@kbn/apm-synthtrace-client';
+import type {
+  ApmFields,
+  Fields,
+  InfraDocument,
+  OtelDocument,
+  SynthtraceGenerator,
+} from '@kbn/apm-synthtrace-client';
 import Url from 'url';
 import type { SynthtraceEsClient } from '@kbn/apm-synthtrace/src/lib/shared/base_client';
 import {
@@ -17,10 +23,9 @@ import {
   getOtelSynthtraceEsClient,
 } from '../../../common/services/synthtrace';
 import { coreWorkerFixtures } from './core_fixtures';
-import type { SynthtraceEvents } from '../../global_hooks/synthtrace_ingestion';
 
 interface SynthtraceFixtureEsClient<TFields extends Fields> {
-  index: (events: SynthtraceEvents<TFields>) => Promise<void>;
+  index: (events: SynthtraceGenerator<TFields>) => Promise<void>;
   clean: SynthtraceEsClient<TFields>['clean'];
 }
 
@@ -34,15 +39,12 @@ const useSynthtraceClient = async <TFields extends Fields>(
   client: SynthtraceEsClient<TFields>,
   use: (client: SynthtraceFixtureEsClient<TFields>) => Promise<void>
 ) => {
-  const index = async (events: SynthtraceEvents<TFields>) =>
+  const index = async (events: SynthtraceGenerator<TFields>) =>
     await client.index(Readable.from(Array.from(events).flatMap((event) => event.serialize())));
 
   const clean = async () => await client.clean();
 
   await use({ index, clean });
-
-  // cleanup function after all tests have ran
-  await client.clean();
 };
 
 export const synthtraceFixture = coreWorkerFixtures.extend<{}, SynthtraceFixture>({

src/platform/packages/shared/kbn-scout/src/playwright/global_hooks/synthtrace_ingestion.ts

@@ -65,6 +65,9 @@ const getSynthtraceClient = (
   }
 };
 
+/**
+ * @deprecated Use `globalSetupHook` and synthtrace fixtures instead
+ */
 export async function ingestSynthtraceDataHook(config: FullConfig, data: SynthtraceIngestionData) {
   const log = getLogger();
 

src/platform/packages/shared/kbn-scout/src/playwright/index.ts

@@ -7,7 +7,7 @@
  * License v3.0 only", or the "Server Side Public License, v 1".
  */
 
-import { scoutFixtures, scoutParallelFixtures } from './fixtures';
+import { scoutFixtures, scoutParallelFixtures, globalSetup } from './fixtures';
 
 // Scout core fixtures: worker & test scope
 export const test = scoutFixtures;
@@ -15,6 +15,8 @@ export const test = scoutFixtures;
 // Scout core 'space aware' fixtures: worker & test scope
 export const spaceTest = scoutParallelFixtures;
 
+export const globalSetupHook = globalSetup;
+
 export { createPlaywrightConfig } from './config';
 export { createLazyPageObject } from './page_objects/utils';
 export { expect } from './expect';

src/platform/packages/shared/kbn-scout/src/playwright/runner/flags.test.ts

@@ -72,6 +72,7 @@ describe('parseTestFlags', () => {
     expect(result).toEqual({
       mode: 'serverless=oblt',
       configPath: '/path/to/config',
+      testTarget: 'local',
       headed: false,
       esFrom: undefined,
       installDir: undefined,
@@ -82,6 +83,7 @@ describe('parseTestFlags', () => {
   it(`should parse with correct config and stateful flags`, async () => {
     const flags = new FlagsReader({
       config: '/path/to/config',
+      testTarget: 'local',
       stateful: true,
       logToFile: false,
       headed: true,
@@ -93,10 +95,41 @@ describe('parseTestFlags', () => {
     expect(result).toEqual({
       mode: 'stateful',
       configPath: '/path/to/config',
+      testTarget: 'local',
       headed: true,
       esFrom: 'snapshot',
       installDir: undefined,
       logsDir: undefined,
     });
   });
+
+  it(`should throw an error with incorrect '--testTarget' flag`, async () => {
+    const flags = new FlagsReader({
+      config: '/path/to/config',
+      testTarget: 'a',
+      stateful: true,
+      logToFile: false,
+      headed: true,
+      esFrom: 'snapshot',
+    });
+
+    await expect(parseTestFlags(flags)).rejects.toThrow(
+      'invalid --testTarget, expected one of "local", "cloud"'
+    );
+  });
+
+  it(`should throw an error with incorrect '--testTarget' flag set to 'cloud'`, async () => {
+    const flags = new FlagsReader({
+      config: '/path/to/config',
+      testTarget: 'cloud',
+      stateful: true,
+      logToFile: false,
+      headed: true,
+      esFrom: 'snapshot',
+    });
+    validatePlaywrightConfigMock.mockResolvedValueOnce();
+    await expect(parseTestFlags(flags)).rejects.toThrow(
+      'Running tests against Cloud / MKI is not supported yet'
+    );
+  });
 });

src/platform/packages/shared/kbn-scout/src/playwright/runner/flags.ts

@@ -19,6 +19,7 @@ export interface RunTestsOptions {
   configPath: string;
   headed: boolean;
   mode: CliSupportedServerModes;
+  testTarget: 'local' | 'cloud';
   esFrom: 'serverless' | 'source' | 'snapshot' | undefined;
   installDir: string | undefined;
   logsDir: string | undefined;
@@ -27,11 +28,12 @@ export interface RunTestsOptions {
 export const TEST_FLAG_OPTIONS: FlagOptions = {
   ...SERVER_FLAG_OPTIONS,
   boolean: [...(SERVER_FLAG_OPTIONS.boolean || []), 'headed'],
-  string: [...(SERVER_FLAG_OPTIONS.string || []), 'config'],
-  default: { headed: false },
+  string: [...(SERVER_FLAG_OPTIONS.string || []), 'config', 'testTarget'],
+  default: { headed: false, testTarget: 'local' },
   help: `${SERVER_FLAG_OPTIONS.help}
     --config             Playwright config file path
     --headed             Run Playwright with browser head
+    --testTarget         Run tests agaist locally started servers or Cloud deployment / MKI project
   `,
 };
 
@@ -39,6 +41,11 @@ export async function parseTestFlags(flags: FlagsReader) {
   const options = parseServerFlags(flags);
   const configPath = flags.string('config');
   const headed = flags.boolean('headed');
+  const testTarget = flags.enum('testTarget', ['local', 'cloud']) || 'local';
+
+  if (testTarget === 'cloud') {
+    throw createFlagError(`Running tests against Cloud / MKI is not supported yet`);
+  }
 
   if (!configPath) {
     throw createFlagError(`Path to playwright config is required: --config <file path>`);
@@ -51,5 +58,6 @@ export async function parseTestFlags(flags: FlagsReader) {
     ...options,
     configPath,
     headed,
+    testTarget,
   };
 }

src/platform/packages/shared/kbn-scout/src/playwright/runner/run_tests.ts

@@ -32,7 +32,12 @@ export async function runTests(log: ToolingLog, options: RunTestsOptions) {
   const playwrightConfigPath = options.configPath;
 
   const cmd = resolve(REPO_ROOT, './node_modules/.bin/playwright');
-  const cmdArgs = ['test', `--config=${playwrightConfigPath}`, `--grep=${playwrightGrepTag}`];
+  const cmdArgs = [
+    'test',
+    `--config=${playwrightConfigPath}`,
+    `--grep=${playwrightGrepTag}`,
+    `--project=${options.testTarget}`,
+  ];
 
   await withProcRunner(log, async (procs) => {
     log.info(`scout: Validate Playwright config has tests`);
@@ -78,7 +83,7 @@ export async function runTests(log: ToolingLog, options: RunTestsOptions) {
       // wait for 5 seconds
       await silence(log, 5000);
 
-      // Running 'npx playwright test --config=${playwrightConfigPath}'
+      // Running 'npx playwright test --config=${playwrightConfigPath} --project local'
       await procs.run(`playwright`, {
         cmd,
         args: [...cmdArgs, ...(options.headed ? ['--headed'] : [])],

src/platform/packages/shared/kbn-scout/src/playwright/types/index.ts

@@ -13,14 +13,15 @@ export type Protocol = 'http' | 'https';
 
 export const VALID_CONFIG_MARKER = Symbol('validConfig');
 
+export type ScoutConfigName = 'local';
+
 export interface ScoutTestOptions extends PlaywrightTestOptions {
   serversConfigDir: string;
+  configName: ScoutConfigName;
   [VALID_CONFIG_MARKER]: boolean;
 }
 
-export interface ScoutPlaywrightOptions
-  extends Pick<PlaywrightTestConfig, 'testDir' | 'workers' | 'globalSetup'> {
+export interface ScoutPlaywrightOptions extends Pick<PlaywrightTestConfig, 'testDir' | 'workers'> {
   testDir: string;
   workers?: 1 | 2 | 3; // to keep performance consistent within test suites
-  globalSetup?: string;
 }

src/platform/packages/shared/kbn-scout/src/servers/start_servers.ts

@@ -52,7 +52,7 @@ export async function startServers(log: ToolingLog, options: StartServerOptions)
       '\n\n' +
         dedent`
           Elasticsearch and Kibana are ready for functional testing.
-          Use 'npx playwright test --config <path_to_Playwright.config.ts>' to run tests'
+          Use 'npx playwright test --config <path_to_Playwright.config.ts> --project local' to run tests'
         ` +
         '\n\n'
     );

x-pack/platform/plugins/private/discover_enhanced/ui_tests/README.md

@@ -13,10 +13,10 @@ Then you can run the tests multiple times in another terminal with:
 
 ```bash
 // ESS
-npx playwright test --config x-pack/platform/plugins/private/discover_enhanced/ui_tests/playwright.config.ts --grep @ess
+npx playwright test --config x-pack/platform/plugins/private/discover_enhanced/ui_tests/playwright.config.ts --project local --grep @ess
 
 // Serverless
-npx playwright test --config x-pack/platform/plugins/private/discover_enhanced/ui_tests/playwright.config.ts --grep @svlSearch
+npx playwright test --config x-pack/platform/plugins/private/discover_enhanced/ui_tests/playwright.config.ts --project local --grep @svlSearch
 
 // @svlOblt, @svlSecurity
 ```

x-pack/platform/plugins/private/discover_enhanced/ui_tests/parallel.playwright.config.ts

@@ -9,7 +9,6 @@ import { createPlaywrightConfig } from '@kbn/scout';
 
 // eslint-disable-next-line import/no-default-export
 export default createPlaywrightConfig({
-  globalSetup: require.resolve('./parallel_tests/global_setup'),
   testDir: './parallel_tests',
   workers: 2,
 });

x-pack/platform/plugins/private/discover_enhanced/ui_tests/parallel_tests/global.setup.ts

@@ -5,11 +5,10 @@
  * 2.0.
  */
 
-import { ingestTestDataHook } from '@kbn/scout';
-import { type FullConfig } from '@playwright/test';
+import { globalSetupHook } from '@kbn/scout';
 import { testData } from '../fixtures';
 
-async function globalSetup(config: FullConfig) {
+globalSetupHook('Ingest data to Elasticsearch', async ({ esArchiver, log }) => {
   // add archives to load, if needed
   const archives = [
     testData.ES_ARCHIVES.LOGSTASH,
@@ -17,8 +16,8 @@ async function globalSetup(config: FullConfig) {
     testData.ES_ARCHIVES.ECOMMERCE,
   ];
 
-  return ingestTestDataHook(config, archives);
-}
-
-// eslint-disable-next-line import/no-default-export
-export default globalSetup;
+  log.debug('[setup] loading test data (only if indexes do not exist)...');
+  for (const archive of archives) {
+    await esArchiver.loadIfNeeded(archive);
+  }
+});

x-pack/solutions/observability/packages/kbn-scout-oblt/index.ts

@@ -17,10 +17,10 @@ export type {
 // re-export from @kbn/scout
 export {
   expect,
+  globalSetupHook,
   tags,
   createPlaywrightConfig,
   createLazyPageObject,
-  ingestTestDataHook,
 } from '@kbn/scout';
 
 export type {
@@ -29,7 +29,6 @@ export type {
   KibanaUrl,
   ScoutLogger,
   ScoutPage,
-  PageObjects,
   ScoutServerConfig,
   ScoutTestConfig,
   ScoutPlaywrightOptions,

x-pack/solutions/observability/plugins/apm/ui_tests/README.md

@@ -14,10 +14,10 @@ Then you can run the parallel tests in another terminal:
 
 ```bash
 // ESS
-npx playwright test --config x-pack/solutions/observability/plugins/apm/ui_tests/parallel.playwright.config.ts --grep @ess
+npx playwright test --config x-pack/solutions/observability/plugins/apm/ui_tests/parallel.playwright.config.ts --project=local --grep @ess
 
 // Serverless
-npx playwright test --config x-pack/solutions/observability/plugins/apm/ui_tests/parallel.playwright.config.ts --grep @svlOblt
+npx playwright test --project local --config x-pack/solutions/observability/plugins/apm/ui_tests/parallel.playwright.config.ts --grep @svlOblt
 ```
 
 Test results are available in `x-pack/solutions/observability/plugins/apm/ui_tests/output`

x-pack/solutions/observability/plugins/apm/ui_tests/fixtures/constants.ts

@@ -0,0 +1,9 @@
+/*
+ * Copyright Elasticsearch B.V. and/or licensed to Elasticsearch B.V. under one
+ * or more contributor license agreements. Licensed under the Elastic License
+ * 2.0; you may not use this file except in compliance with the Elastic License
+ * 2.0.
+ */
+
+export const OPBEANS_START_DATE = '2021-10-10T00:00:00.000Z';
+export const OPBEANS_END_DATE = '2021-10-10T00:15:00.000Z';

x-pack/solutions/observability/plugins/apm/ui_tests/fixtures/index.ts

@@ -5,19 +5,24 @@
  * 2.0.
  */
 
-import type { PageObjects, ScoutTestFixtures, ScoutWorkerFixtures, KibanaUrl } from '@kbn/scout';
-import { test as base, createLazyPageObject } from '@kbn/scout';
+import type {
+  ObltPageObjects,
+  ObltTestFixtures,
+  ObltWorkerFixtures,
+  KibanaUrl,
+} from '@kbn/scout-oblt';
+import { test as base, createLazyPageObject } from '@kbn/scout-oblt';
 import { ServiceMapPage } from './page_objects/service_map';
 import { ServiceInventoryPage } from './page_objects/service_inventory';
 
-export interface ExtendedScoutTestFixtures extends ScoutTestFixtures {
-  pageObjects: PageObjects & {
+export interface ExtendedScoutTestFixtures extends ObltTestFixtures {
+  pageObjects: ObltPageObjects & {
     serviceMapPage: ServiceMapPage;
     serviceInventoryPage: ServiceInventoryPage;
   };
 }
 
-export const test = base.extend<ExtendedScoutTestFixtures, ScoutWorkerFixtures>({
+export const test = base.extend<ExtendedScoutTestFixtures, ObltWorkerFixtures>({
   pageObjects: async (
     {
       pageObjects,
@@ -39,3 +44,5 @@ export const test = base.extend<ExtendedScoutTestFixtures, ScoutWorkerFixtures>(
     await use(extendedPageObjects);
   },
 });
+
+export * as testData from './constants';

x-pack/solutions/observability/plugins/apm/ui_tests/fixtures/page_objects/service_inventory.ts

@@ -5,20 +5,13 @@
  * 2.0.
  */
 
-import type { KibanaUrl, ScoutPage } from '@kbn/scout';
+import type { KibanaUrl, ScoutPage } from '@kbn/scout-oblt';
 
 export class ServiceInventoryPage {
   constructor(private readonly page: ScoutPage, private readonly kbnUrl: KibanaUrl) {}
 
-  async waitForPageToLoad() {
-    await this.page.waitForSelector(
-      '[data-test-subj="kbnAppWrapper visibleChrome"] [aria-busy="false"]',
-      { state: 'visible' }
-    );
-  }
-
   async gotoDetailedServiceInventoryWithDateSelected(start: string, end: string) {
-    this.page.goto(`${this.kbnUrl.app('apm')}/services?&rangeFrom=${start}&rangeTo=${end}`);
-    await this.waitForPageToLoad();
+    await this.page.goto(`${this.kbnUrl.app('apm')}/services?&rangeFrom=${start}&rangeTo=${end}`);
+    return this.page.waitForLoadingIndicatorHidden();
   }
 }

x-pack/solutions/observability/plugins/apm/ui_tests/fixtures/page_objects/service_map.ts

@@ -5,36 +5,52 @@
  * 2.0.
  */
 
-import type { KibanaUrl, ScoutPage } from '@kbn/scout';
+import type { KibanaUrl, Locator, ScoutPage } from '@kbn/scout-oblt';
+import { expect } from '@kbn/scout-oblt';
 
 export class ServiceMapPage {
-  constructor(private readonly page: ScoutPage, private readonly kbnUrl: KibanaUrl) {}
+  public serviceMap: Locator;
+  public zoomInBtn: Locator;
+  public zoomOutBtn: Locator;
+  public centerServiceMapBtn: Locator;
+  public noServicesPlaceholder: Locator;
 
-  async waitForPageToLoad() {
-    await this.page.waitForSelector(
-      '[data-test-subj="kbnAppWrapper visibleChrome"] [aria-busy="false"]',
-      { state: 'visible' }
-    );
+  constructor(private readonly page: ScoutPage, private readonly kbnUrl: KibanaUrl) {
+    this.serviceMap = page.testSubj.locator('serviceMap');
+    this.zoomInBtn = page.locator('button[aria-label="Zoom in"]');
+    this.zoomOutBtn = page.locator('button[aria-label="Zoom out"]');
+    this.centerServiceMapBtn = page.testSubj.locator('centerServiceMap');
+    this.noServicesPlaceholder = page.locator('.euiEmptyPrompt__content .euiTitle');
   }
 
   async gotoWithDateSelected(start: string, end: string) {
-    this.page.goto(`${this.kbnUrl.app('apm')}/service-map?&rangeFrom=${start}&rangeTo=${end}`);
-    await this.waitForPageToLoad();
+    await this.page.goto(
+      `${this.kbnUrl.app('apm')}/service-map?&rangeFrom=${start}&rangeTo=${end}`
+    );
+    return this.page.waitForLoadingIndicatorHidden();
   }
+
   async gotoDetailedServiceMapWithDateSelected(start: string, end: string) {
-    this.page.goto(
+    await this.page.goto(
       `${this.kbnUrl.app(
         'apm'
       )}/services/opbeans-java/service-map?&rangeFrom=${start}&rangeTo=${end}`
     );
-    await this.waitForPageToLoad();
+    return this.page.waitForLoadingIndicatorHidden();
   }
+
   async getSearchBar() {
     await this.page.testSubj.waitForSelector('apmUnifiedSearchBar');
   }
-  async typeInTheSearchBar() {
+
+  async typeInTheSearchBar(text: string) {
     await this.getSearchBar();
-    await this.page.testSubj.typeWithDelay('apmUnifiedSearchBar', '_id : foo');
-    await this.page.getByTestId('querySubmitButton').press('Enter');
+    await this.page.testSubj.typeWithDelay('apmUnifiedSearchBar', text);
+    return this.page.getByTestId('querySubmitButton').press('Enter');
+  }
+
+  async waitForServiceMapToLoad() {
+    await this.serviceMap.waitFor({ state: 'visible' });
+    return expect(this.serviceMap.getByLabel('Loading')).toBeHidden();
   }
 }

x-pack/solutions/observability/plugins/apm/ui_tests/fixtures/synthtrace/opbeans.ts

@@ -4,9 +4,16 @@
  * 2.0; you may not use this file except in compliance with the Elastic License
  * 2.0.
  */
+import type { ApmFields, SynthtraceGenerator } from '@kbn/apm-synthtrace-client';
 import { apm, timerange } from '@kbn/apm-synthtrace-client';
 
-export function opbeans({ from, to }: { from: number; to: number }) {
+export function opbeans({
+  from,
+  to,
+}: {
+  from: number;
+  to: number;
+}): SynthtraceGenerator<ApmFields> {
   const range = timerange(from, to);
 
   const opbeansJava = apm

x-pack/solutions/observability/plugins/apm/ui_tests/parallel.playwright.config.ts

@@ -5,11 +5,10 @@
  * 2.0.
  */
 
-import { createPlaywrightConfig } from '@kbn/scout';
+import { createPlaywrightConfig } from '@kbn/scout-oblt';
 
 // eslint-disable-next-line import/no-default-export
 export default createPlaywrightConfig({
-  globalSetup: require.resolve('./parallel_tests/global_setup'),
   testDir: './parallel_tests',
   workers: 2,
 });

x-pack/solutions/observability/plugins/apm/ui_tests/parallel_tests/global_setup.ts

@@ -5,27 +5,16 @@
  * 2.0.
  */
 
-import { ingestSynthtraceDataHook } from '@kbn/scout';
-import { type FullConfig } from '@playwright/test';
+import { globalSetupHook } from '@kbn/scout-oblt';
+import type { ApmFields, SynthtraceGenerator } from '@kbn/apm-synthtrace-client';
 import { opbeans } from '../fixtures/synthtrace/opbeans';
+import { testData } from '../fixtures';
 
-async function globalSetup(config: FullConfig) {
-  const start = '2021-10-10T00:00:00.000Z';
-  const end = '2021-10-10T00:15:00.000Z';
-  const data = {
-    apm: [
-      opbeans({
-        from: new Date(start).getTime(),
-        to: new Date(end).getTime(),
-      }),
-    ],
-    // TODO add infra and otel fixtures
-    infra: [],
-    otel: [],
-  };
+globalSetupHook('Ingest data to Elasticsearch', async ({ apmSynthtraceEsClient }) => {
+  const dataGenerator: SynthtraceGenerator<ApmFields> = opbeans({
+    from: new Date(testData.OPBEANS_START_DATE).getTime(),
+    to: new Date(testData.OPBEANS_END_DATE).getTime(),
+  });
 
-  return ingestSynthtraceDataHook(config, data);
-}
-
-// eslint-disable-next-line import/no-default-export
-export default globalSetup;
+  await apmSynthtraceEsClient.index(dataGenerator);
+});

x-pack/solutions/observability/plugins/apm/ui_tests/parallel_tests/service_inventory/service_inventory.spec.ts

@@ -4,34 +4,34 @@
  * 2.0; you may not use this file except in compliance with the Elastic License
  * 2.0.
  */
-import { expect } from '@kbn/scout';
-import { test } from '../../fixtures';
-
-const start = '2021-10-10T00:00:00.000Z';
-const end = '2021-10-10T00:15:00.000Z';
+import { expect } from '@kbn/scout-oblt';
+import { test, testData } from '../../fixtures';
 
 test.describe('Service Inventory', { tag: ['@ess', '@svlOblt'] }, () => {
-  test.beforeEach(async ({ browserAuth, page, pageObjects: { serviceInventoryPage } }) => {
+  test.beforeEach(async ({ browserAuth, pageObjects: { serviceInventoryPage } }) => {
     await browserAuth.loginAsViewer();
-    await serviceInventoryPage.gotoDetailedServiceInventoryWithDateSelected(start, end);
-    await serviceInventoryPage.waitForPageToLoad();
+    await serviceInventoryPage.gotoDetailedServiceInventoryWithDateSelected(
+      testData.OPBEANS_START_DATE,
+      testData.OPBEANS_END_DATE
+    );
   });
 
-  test('shows the service inventory', async ({ page, pageObjects: { serviceInventoryPage } }) => {
-    await serviceInventoryPage.gotoDetailedServiceInventoryWithDateSelected(start, end);
-    expect(page.url()).toContain('/app/apm/services');
-    await expect(page.getByRole('heading', { name: 'Services', level: 1 })).toBeVisible();
-  });
+  test('renders page with selected date range', async ({ page }) => {
+    await test.step('shows correct heading', async () => {
+      expect(page.url()).toContain('/app/apm/services');
+      await expect(page.getByRole('heading', { name: 'Services', level: 1 })).toBeVisible();
+    });
 
-  test('shows a list of services', async ({ page }) => {
-    await expect(page.getByText('opbeans-node')).toBeVisible();
-    await expect(page.getByText('opbeans-java')).toBeVisible();
-    await expect(page.getByText('opbeans-rum')).toBeVisible();
-  });
+    await test.step('shows a list of services', async () => {
+      await expect(page.getByText('opbeans-node')).toBeVisible();
+      await expect(page.getByText('opbeans-java')).toBeVisible();
+      await expect(page.getByText('opbeans-rum')).toBeVisible();
+    });
 
-  test('shows a list of environments', async ({ page }) => {
-    const environmentEntrySelector = page.locator('td:has-text("production")');
-    await expect(environmentEntrySelector).toHaveCount(3);
+    await test.step('shows a list of environments', async () => {
+      const environmentEntrySelector = page.locator('td:has-text("production")');
+      await expect(environmentEntrySelector).toHaveCount(3);
+    });
   });
 
   test('loads the service overview for a service when clicking on it', async ({ page }) => {
@@ -41,15 +41,9 @@ test.describe('Service Inventory', { tag: ['@ess', '@svlOblt'] }, () => {
   });
 
   test('shows the correct environment when changing the environment', async ({ page }) => {
+    await page.testSubj.click('environmentFilter > comboBoxSearchInput');
     await page
-      .locator('[data-test-subj="environmentFilter"]')
-      .locator('[data-test-subj="comboBoxSearchInput"]')
-      .click();
-    await expect(
-      page.getByTestId('comboBoxOptionsList environmentFilter-optionsList')
-    ).toBeVisible();
-    await page
-      .locator('[data-test-subj="comboBoxOptionsList environmentFilter-optionsList"]')
+      .getByTestId('comboBoxOptionsList environmentFilter-optionsList')
       .locator('button:has-text("production")')
       .click();
     await expect(page.getByTestId('comboBoxSearchInput')).toHaveValue('production');

x-pack/solutions/observability/plugins/apm/ui_tests/parallel_tests/sevice_map/service_map.spec.ts

@@ -5,46 +5,54 @@
  * 2.0.
  */
 
-import { expect } from '@kbn/scout';
-import { test } from '../../fixtures';
-
-const start = '2021-10-10T00:00:00.000Z';
-const end = '2021-10-10T00:15:00.000Z';
+import { expect } from '@kbn/scout-oblt';
+import { test, testData } from '../../fixtures';
 
 test.describe('Service Map', { tag: ['@ess', '@svlOblt'] }, () => {
-  test.beforeEach(async ({ browserAuth, page, pageObjects: { serviceMapPage } }) => {
+  test.beforeEach(async ({ browserAuth }) => {
     await browserAuth.loginAsViewer();
-    await serviceMapPage.gotoWithDateSelected(start, end);
-    await serviceMapPage.waitForPageToLoad();
   });
-  test('shows the service map', async ({ page, pageObjects: { serviceMapPage } }) => {
-    await serviceMapPage.gotoWithDateSelected(start, end);
+
+  test('renders page with selected date range', async ({
+    page,
+    pageObjects: { serviceMapPage },
+  }) => {
+    await serviceMapPage.gotoWithDateSelected(
+      testData.OPBEANS_START_DATE,
+      testData.OPBEANS_END_DATE
+    );
     expect(page.url()).toContain('/app/apm/service-map');
-    await page.waitForSelector('[data-test-subj="serviceMap"]');
-    await expect(page.getByTestId('serviceMap').getByLabel('Loading')).toBeHidden();
-    await page.getByLabel('Zoom In').click();
-    await page.getByTestId('centerServiceMap').click();
-    await expect(page.getByTestId('serviceMap').getByLabel('Loading')).toBeHidden();
+    await serviceMapPage.waitForServiceMapToLoad();
+    await serviceMapPage.zoomInBtn.click();
+    await serviceMapPage.centerServiceMapBtn.click();
+    await serviceMapPage.waitForServiceMapToLoad();
   });
 
   test('shows a detailed service map', async ({ page, pageObjects: { serviceMapPage } }) => {
-    await serviceMapPage.gotoDetailedServiceMapWithDateSelected(start, end);
+    await serviceMapPage.gotoDetailedServiceMapWithDateSelected(
+      testData.OPBEANS_START_DATE,
+      testData.OPBEANS_END_DATE
+    );
     expect(page.url()).toContain('/services/opbeans-java/service-map');
-    await page.waitForSelector('[data-test-subj="serviceMap"]');
-    await expect(page.getByTestId('serviceMap').getByLabel('Loading')).toBeHidden();
-    await page.getByLabel('Zoom out').click();
-    await page.getByTestId('centerServiceMap').click();
-    await expect(page.getByTestId('serviceMap').getByLabel('Loading')).toBeHidden();
+    await serviceMapPage.waitForServiceMapToLoad();
+    await serviceMapPage.zoomOutBtn.click();
+    await serviceMapPage.centerServiceMapBtn.click();
+    await serviceMapPage.zoomInBtn.click();
+    await serviceMapPage.waitForServiceMapToLoad();
   });
 
   test('shows empty state when there is no data', async ({
     page,
     pageObjects: { serviceMapPage },
   }) => {
-    await serviceMapPage.typeInTheSearchBar();
-    await expect(page.getByTestId('serviceMap').getByLabel('Loading')).toBeHidden();
-    page.getByText('No services available');
-    // search bar is still visible
+    await serviceMapPage.gotoWithDateSelected(
+      testData.OPBEANS_START_DATE,
+      testData.OPBEANS_END_DATE
+    );
+    await serviceMapPage.typeInTheSearchBar('_id : foo');
+    await serviceMapPage.waitForServiceMapToLoad();
+    await expect(serviceMapPage.noServicesPlaceholder).toBeVisible();
+    await expect(serviceMapPage.noServicesPlaceholder).toHaveText('No services available');
     await expect(page.getByTestId('apmUnifiedSearchBar')).toBeVisible();
   });
 });

x-pack/solutions/observability/plugins/apm/ui_tests/tsconfig.json

@@ -7,8 +7,8 @@
     "**/*"
   ],
   "kbn_references": [
-    "@kbn/scout",
-    "@kbn/apm-synthtrace-client"
+    "@kbn/apm-synthtrace-client",
+    "@kbn/scout-oblt"
   ],
   "exclude": [
     "target/**/*"

x-pack/solutions/observability/plugins/observability_onboarding/ui_tests/README.md

@@ -16,20 +16,22 @@ Some tests are designed to run sequentially:
 
 ```bash
 // ESS
-npx playwright test --config x-pack/solutions/observability/plugins/observability_onboarding/ui_tests/playwright.config.ts --grep @ess
+npx playwright test --config x-pack/solutions/observability/plugins/observability_onboarding/ui_tests/playwright.config.ts --project=local --grep @ess
 
 // Serverless
-npx playwright test --config x-pack/solutions/observability/plugins/observability_onboarding/ui_tests/playwright.config.ts --grep @svlOblt
+npx playwright test --config x-pack/solutions/observability/plugins/observability_onboarding/ui_tests/playwright.config.ts --project=local --grep @svlOblt
 ```
 
 Some tests are designed to run concurrently (preferred option):
 
 ```bash
 // ESS
-npx playwright test --config x-pack/solutions/observability/plugins/observability_onboarding/ui_tests/parallel_playwright.config.ts --grep @ess
+npx playwright test --config x-pack/solutions/observability/plugins/observability_onboarding/ui_tests/parallel_playwright.config.ts
+--project=local --grep @ess
 
 // Serverless
-npx playwright test --config x-pack/solutions/observability/plugins/observability_onboarding/ui_tests/parallel_playwright.config.ts --grep @svlOblt
+npx playwright test --config x-pack/solutions/observability/plugins/observability_onboarding/ui_tests/parallel_playwright.config.ts
+--project=local --grep @svlOblt
 ```
 
 Test results are available in `x-pack/solutions/observability/plugins/observability_onboarding/ui_tests/output`

x-pack/solutions/observability/plugins/observability_onboarding/ui_tests/parallel.playwright.config.ts

@@ -5,7 +5,7 @@
  * 2.0.
  */
 
-import { createPlaywrightConfig } from '@kbn/scout';
+import { createPlaywrightConfig } from '@kbn/scout-oblt';
 
 // eslint-disable-next-line import/no-default-export
 export default createPlaywrightConfig({

x-pack/solutions/observability/plugins/observability_onboarding/ui_tests/playwright.config.ts

@@ -5,7 +5,7 @@
  * 2.0.
  */
 
-import { createPlaywrightConfig } from '@kbn/scout';
+import { createPlaywrightConfig } from '@kbn/scout-oblt';
 
 // eslint-disable-next-line import/no-default-export
 export default createPlaywrightConfig({

x-pack/solutions/observability/plugins/observability_onboarding/ui_tests/tsconfig.json

@@ -7,7 +7,6 @@
     "**/*"
   ],
   "kbn_references": [
-    "@kbn/scout",
     "@kbn/scout-oblt"
   ],
   "exclude": [