kibana/.buildkite/pipeline-resource-definitions
Sonia Sanz Vivas 284e404945
[9.0] Update console definitions branches (#221888) (#221999)
# Backport

This will backport the following commits from `main` to `9.0`:
- [Update console definitions branches
(#221888)](https://github.com/elastic/kibana/pull/221888)

<!--- Backport version: 10.0.0 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sorenlouv/backport)

<!--BACKPORT [{"author":{"name":"Sonia Sanz
Vivas","email":"sonia.sanzvivas@elastic.co"},"sourceCommit":{"committedDate":"2025-05-29T16:35:17Z","message":"Update
console definitions branches (#221888)\n\n## Summary\n\nWith
https://github.com/elastic/kibana/pull/207036 we introduced
some\nchanges in the script so that it generates two PRs: one for the
`main`\nbranch and one for `8.x` in order to keep previous versions with
their\ncorresponding console definitions.\n\nThis PR updates the
branches so the script generates PRs for `main`,\n`9.0`, `8.19` and
`8.18`","sha":"abf2c2c789dd3ad4f727d59ec292b32d0e9e84e8","branchLabelMapping":{"^v9.1.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["Feature:Console","Team:Kibana
Management","release_note:skip","backport:version","v9.1.0","v8.19.0","v9.0.2","v8.18.3"],"title":"Update
console definitions
branches","number":221888,"url":"https://github.com/elastic/kibana/pull/221888","mergeCommit":{"message":"Update
console definitions branches (#221888)\n\n## Summary\n\nWith
https://github.com/elastic/kibana/pull/207036 we introduced
some\nchanges in the script so that it generates two PRs: one for the
`main`\nbranch and one for `8.x` in order to keep previous versions with
their\ncorresponding console definitions.\n\nThis PR updates the
branches so the script generates PRs for `main`,\n`9.0`, `8.19` and
`8.18`","sha":"abf2c2c789dd3ad4f727d59ec292b32d0e9e84e8"}},"sourceBranch":"main","suggestedTargetBranches":["8.19","9.0","8.18"],"targetPullRequestStates":[{"branch":"main","label":"v9.1.0","branchLabelMappingKey":"^v9.1.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/221888","number":221888,"mergeCommit":{"message":"Update
console definitions branches (#221888)\n\n## Summary\n\nWith
https://github.com/elastic/kibana/pull/207036 we introduced
some\nchanges in the script so that it generates two PRs: one for the
`main`\nbranch and one for `8.x` in order to keep previous versions with
their\ncorresponding console definitions.\n\nThis PR updates the
branches so the script generates PRs for `main`,\n`9.0`, `8.19` and
`8.18`","sha":"abf2c2c789dd3ad4f727d59ec292b32d0e9e84e8"}},{"branch":"8.19","label":"v8.19.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"9.0","label":"v9.0.2","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.18","label":"v8.18.3","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}]
BACKPORT-->
2025-06-03 08:47:40 +02:00
..
_templates [ci] Skip intermediate builds (#199540) 2024-11-11 07:36:48 -06:00
scripts [CI] Validate pipeline resource definitions and location collection (#208398) 2025-01-29 12:45:28 +01:00
security-solution-ess [9.0] [Security Assistant] Adds BuildKite pipeline for running Security GenAI Evaluations weekly (#215254) (#219283) 2025-04-25 22:11:58 +02:00
security-solution-quality-gate [ci] Skip intermediate builds (#199540) 2024-11-11 07:36:48 -06:00
kibana-api-docs.yml [ci] Skip intermediate builds (#199540) 2024-11-11 07:36:48 -06:00
kibana-apis-capacity-testing-daily.yml [ci] Skip intermediate builds (#199540) 2024-11-11 07:36:48 -06:00
kibana-artifacts-container-image.yml Tag pipelines related to Kibana serverless release (#195631) 2024-10-09 22:28:19 +02:00
kibana-artifacts-snapshot.yml [ci] Skip intermediate builds (#199540) 2024-11-11 07:36:48 -06:00
kibana-artifacts-staging.yml [ci] Skip intermediate builds (#199540) 2024-11-11 07:36:48 -06:00
kibana-artifacts-trigger.yml [ci] Skip intermediate builds (#199540) 2024-11-11 07:36:48 -06:00
kibana-chrome-forward-testing.yml [ci] Skip intermediate builds (#199540) 2024-11-11 07:36:48 -06:00
kibana-codeql.yml [CI] Add tags for kibana pipelines (#195388) 2024-10-09 11:26:46 +02:00
kibana-console-definitions-sync.yml [9.0] Update console definitions branches (#221888) (#221999) 2025-06-03 08:47:40 +02:00
kibana-coverage-daily.yml [ci] Skip intermediate builds (#199540) 2024-11-11 07:36:48 -06:00
kibana-deploy-cloud.yml [ci] Click to deploy cloud (#205623) 2025-01-23 10:26:03 +01:00
kibana-deploy-project.yml [ci] Click to deploy cloud (#205623) 2025-01-23 10:26:03 +01:00
kibana-es-forward-testing-9-dot-0.yml [ci/es-forward-testing] Revert skip_intermediate_builds (#205167) 2024-12-26 11:29:29 -06:00
kibana-es-forward-testing.yml [ci/es-forward-testing] Revert skip_intermediate_builds (#205167) 2024-12-26 11:29:29 -06:00
kibana-es-serverless-snapshots.yml [ci] Skip intermediate builds (#199540) 2024-11-11 07:36:48 -06:00
kibana-es-snapshots.yml [ci] Shut off 8.15 branch (#205788) 2025-01-07 11:11:54 -06:00
kibana-esql-grammar-sync.yml [ci] Skip intermediate builds (#199540) 2024-11-11 07:36:48 -06:00
kibana-fips-daily.yml [FIPS] Switch Pipeline notification channel and description (#202566) 2024-12-02 15:37:56 -08:00
kibana-flaky.yml [ci] Skip intermediate builds (#199540) 2024-11-11 07:36:48 -06:00
kibana-fleet-packages-daily.yml [ci] Skip intermediate builds (#199540) 2024-11-11 07:36:48 -06:00
kibana-gen-ai-daily.yml GenAI FTR tests: switch to daily job (#203369) 2024-12-09 16:09:29 +01:00
kibana-migration-staging.yml [CI] Add tags for kibana pipelines (#195388) 2024-10-09 11:26:46 +02:00
kibana-on-merge-unsupported-ftrs.yml [9.0] [ci] enable Scout reporter for on-merge-unsupported-ftrs (#210627) (#210673) 2025-02-11 20:48:40 +01:00
kibana-on-merge.yml [kbn-scout] Scout reporter updates (#206431) 2025-01-29 00:08:37 +01:00
kibana-package-registry.yml [ci] Use daily promoted EPR distribution (#205221) 2025-01-06 14:08:27 -06:00
kibana-performance-daily.yml [ci] Skip intermediate builds (#199540) 2024-11-11 07:36:48 -06:00
kibana-performance-data-set-extraction-daily.yml [CI] Add tags for kibana pipelines (#195388) 2024-10-09 11:26:46 +02:00
kibana-pointer-compression.yml Upgrade Node.js to 20.18.2 (#207431) 2025-01-22 12:00:14 -06:00
kibana-pr.yml [kbn-scout] Scout reporter updates (#206431) 2025-01-29 00:08:37 +01:00
kibana-purge-cloud-deployments.yml [ci] Skip intermediate builds (#199540) 2024-11-11 07:36:48 -06:00
kibana-serverless-emergency-release.yml Tag pipelines related to Kibana serverless release (#195631) 2024-10-09 22:28:19 +02:00
kibana-serverless-quality-gates-emergency.yml Tag pipelines related to Kibana serverless release (#195631) 2024-10-09 22:28:19 +02:00
kibana-serverless-quality-gates.yml Tag pipelines related to Kibana serverless release (#195631) 2024-10-09 22:28:19 +02:00
kibana-serverless-release-testing.yml [ci] Skip intermediate builds (#199540) 2024-11-11 07:36:48 -06:00
kibana-serverless-release.yml [ci] Skip intermediate builds (#199540) 2024-11-11 07:36:48 -06:00
kibana-vm-images.yml [9.0] [ci] Trigger VM image rebuild for cache rebuild only (#213497) (#213697) 2025-03-10 12:41:12 +01:00
locations.yml [9.0] [Security Assistant] Adds BuildKite pipeline for running Security GenAI Evaluations weekly (#215254) (#219283) 2025-04-25 22:11:58 +02:00
README.md [BK] Migrate es-forward (+add versions.json dependent triggering) (#184018) 2024-07-10 12:08:16 +02:00
scalability_testing-daily.yml [ci] Skip intermediate builds (#199540) 2024-11-11 07:36:48 -06:00
trigger-version-dependent-jobs.yml refact(NA): rename .buildkite/pipeline-resource-definitions/kibana-es-forward-testing-v9.yml to 9-fot-0 2024-12-13 00:07:11 +00:00

Buildkite pipeline resource definitions

Overview

The pipeline resources are "RRE" (real resource entities) that are used to create/maintain buildkite pipelines.

The resources described in these files are parsed and loaded to Backstage (https://backstage.elastic.dev). From there, Terrazzo is generating and updating the buildkite pipelines.

These pipelines are referenced indirectly through the root's catalog-info.yaml file in order to reduce bloat in the main resources file. There's a location file that collects files defined in this folder (locations.yml), this file needs to be updated in order to keep track of local files.

Available parameters and further help can be found here: https://docs.elastic.dev/ci/getting-started-with-buildkite-at-elastic

Creating a new pipeline resource definition

The easiest way to create a new pipeline is either by copying and editing a similar pipeline, or by copying a blank template (see _new_pipeline.yml) and editing that.

You can validate your pipeline's structural integrity, and it's conformity to baseline rules by running the following command:

.buildkite/pipeline-resource-definitions/scripts/validate-pipeline-definition.sh <path_to_your_pipeline_file>

Once you've added the file, you should update the locations.yml file to include the new pipeline, or run the following command to update it:

.buildkite/pipeline-resource-definitions/scripts/fix-location-collection.ts

Add your pipeline implementation, commit & push & merge. The pipeline resource will appear in Backstage within minutes, then the pipeline will be added to Buildkite within ~10 minutes.