Skip to content

[Security Solution] Add FTR tests for prebuilt rules OOM testing#236891

Merged
maximpn merged 2 commits into
elastic:mainfrom
maximpn:add-prebuilt-rules-oom-tests
Oct 10, 2025
Merged

[Security Solution] Add FTR tests for prebuilt rules OOM testing#236891
maximpn merged 2 commits into
elastic:mainfrom
maximpn:add-prebuilt-rules-oom-tests

Conversation

@maximpn
Copy link
Copy Markdown
Contributor

@maximpn maximpn commented Sep 30, 2025

Partially addresses: #188090

Summary

This PR contains FTR tests designed to expose potential Out of Memory (OOM) issues in Kibana when performing memory-intensive operations related to Detection Prebuilt Rules. The tests open a possibility to test against any Prebuilt Rules fleet package version including prerelease packages.

Running test instructions

  • Set up QAF by following to the instructions (internal)
  • Place the following Elastic Cloud plan in ~/.qaf/config/cloud_plans/prebuilt_rules_oom_testing.yml
---
name: {{ deployment_name }}
settings:
  autoscaling_enabled: {{ autoscaling_enabled }}
metadata:
  system_owned: false
resources:
  elasticsearch:
    - region: {{ region }}
      settings:
        dedicated_masters_threshold: 6
      plan:
        cluster_topology:
          - zone_count: 1
            elasticsearch:
              node_attributes:
                data: hot
            instance_configuration_id: gcp.es.datahot.n2.68x10x45
            node_roles:
              - master
              - ingest
              - remote_cluster_client
              - data_hot
              - transform
              - data_content
            id: hot_content
            size:
              value: 1024
              resource: memory
        elasticsearch:
          version: {{ stack_version }}
        deployment_template:
          id: gcp-storage-optimized
      ref_id: main-elasticsearch
  enterprise_search: []
  kibana:
    - elasticsearch_cluster_ref_id: main-elasticsearch
      region: {{ region }}
      plan:
        cluster_topology:
          - instance_configuration_id: gcp.kibana.n2.68x32x45
            zone_count: 1
            size:
              value: 1024
              resource: memory
        kibana:
          version: {{ stack_version }}
      ref_id: main-kibana
  • Create an ECH deployment by running the following command
qaf elastic-cloud deployments create --stack-version 9.3.0 --version-validation --deployment-name prebuilt-rules-oom-test-9.3.0 --environment production --no-autoscaling --no-sso --region gcp-us-west2 --plan prebuilt_rules_oom_testing
  • Run the tests by running the following command
qaf kibana ftr run-config --ec-deployment-name prebuilt-rules-oom-test-9.3.0 --kibana-repo-root <kibana-root> <kibana-root>/x-pack/solutions/security/test/security_solution_api_integration/test_suites/detections_response/rules_management/prebuilt_rules/oom_testing/configs/ess_basic_license.config.ts

where <kibana-root> is the absolute path to the Kibana's root folder.

@maximpn maximpn self-assigned this Sep 30, 2025
@maximpn maximpn added release_note:skip Skip the PR/issue when compiling release notes Team:Detections and Resp Security Detection Response Team Team: SecuritySolution Security Solutions Team working on SIEM, Endpoint, Timeline, Resolver, etc. Team:Detection Rule Management Security Detection Rule Management Team Feature:Prebuilt Detection Rules Security Solution Prebuilt Detection Rules area backport:version Backport to applied version labels v9.2.0 labels Sep 30, 2025
@maximpn maximpn marked this pull request as ready for review September 30, 2025 11:46
@maximpn maximpn requested review from a team as code owners September 30, 2025 11:46
@maximpn maximpn requested a review from xcrzx September 30, 2025 11:46
@elasticmachine
Copy link
Copy Markdown
Contributor

Pinging @elastic/security-detections-response (Team:Detections and Resp)

@elasticmachine
Copy link
Copy Markdown
Contributor

Pinging @elastic/security-solution (Team: SecuritySolution)

@elasticmachine
Copy link
Copy Markdown
Contributor

Pinging @elastic/security-detection-rule-management (Team:Detection Rule Management)

@maximpn maximpn requested review from nikitaindik and removed request for xcrzx September 30, 2025 11:47
Copy link
Copy Markdown
Contributor

@jbudz jbudz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

.buildkite/ftr_security_stateful_configs.yml LGTM

@maximpn maximpn force-pushed the add-prebuilt-rules-oom-tests branch 2 times, most recently from 2c5a23a to f75a6d1 Compare October 9, 2025 10:49
Copy link
Copy Markdown
Contributor

@nikitaindik nikitaindik left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed the changes and tested by doing these:

  • set up qaf locally
  • deployed a 9.3.0 stack to prod cloud
  • pointed Kibana to a custom EPR deployed GCP
  • ran the tests against the deployment, trying to bootstrap with "good" and "bad" packages.

In the green scenario, the endpoints return 200. In a scenario with a huge package, the bootstrap endpoint returns 502 "Bad Gateway".

@maximpn With huge packages, do we see OOMs in the bootstrap endpoint already? I expected the tests to fail at "installation review" stage. I was using your package v99.32.0.


### ⚙️ Test Environment Setup

To effectively reproduce OOM-related behavior, the deployment should be created in Elastic Cloud with 1GB RAM limit for the Kibana instance and 2-4GB RAM limit for Elasticsearch instance. ML and Integration instances as well as cold and frozen tier Elasticsearch nodes aren't required. An example Elastic Cloud configuration applicable for internal testing framework QAF (QA Framework) looks like the following
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Does RAM limit for ES matter for Kibana OOM tests? In the example plan below only 1GB is specified.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I haven't observed any significant memory pressure in the ES instance while performing experiments. The same results are observed when ES instance has 4GB, 2GB and 1GB of memory. So it should be safe to have only 1GB of RAM for the ES instance.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for checking this. Then we could also update the wording here to have 1GB for ES instead of 2-4GB.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes. I've done it already.


#### CI

The tests can be run via a Buildkite pipeline...
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we can remove the unfinished sections for now and add them later once we have more info.

@maximpn maximpn force-pushed the add-prebuilt-rules-oom-tests branch from f75a6d1 to fd41b78 Compare October 10, 2025 10:16
@maximpn
Copy link
Copy Markdown
Contributor Author

maximpn commented Oct 10, 2025

@nikitaindik Thanks for your review! I've updated the README.md file to address your comments. Please have a look.

@maximpn maximpn requested a review from nikitaindik October 10, 2025 10:16
Copy link
Copy Markdown
Contributor

@nikitaindik nikitaindik left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@maximpn Replied to a comment about ES RAM configuration. Please, take a look.

Thanks for the updates. LGTM now.

@kibanamachine
Copy link
Copy Markdown
Contributor

Looks like this PR has backport PRs but they still haven't been merged. Please merge them ASAP to keep the branches relatively in sync.
cc: @maximpn

2 similar comments
@kibanamachine
Copy link
Copy Markdown
Contributor

Looks like this PR has backport PRs but they still haven't been merged. Please merge them ASAP to keep the branches relatively in sync.
cc: @maximpn

@kibanamachine
Copy link
Copy Markdown
Contributor

Looks like this PR has backport PRs but they still haven't been merged. Please merge them ASAP to keep the branches relatively in sync.
cc: @maximpn

rylnd pushed a commit to rylnd/kibana that referenced this pull request Oct 17, 2025
…stic#236891)

**Partially addresses:** elastic#188090

## Summary

This PR contains FTR tests designed to expose potential Out of Memory (OOM) issues in Kibana when performing memory-intensive operations related to **Detection Prebuilt Rules**. The tests open a possibility to test against any Prebuilt Rules fleet package version including prerelease packages.

## Running test instructions

- Set up QAF by following to the [instructions](https://docs.elastic.dev/appex-qa/qaf/getting-started) (internal)
- Place the following Elastic Cloud plan in `~/.qaf/config/cloud_plans/prebuilt_rules_oom_testing.yml`
```yaml
---
name: {{ deployment_name }}
settings:
  autoscaling_enabled: {{ autoscaling_enabled }}
metadata:
  system_owned: false
resources:
  elasticsearch:
    - region: {{ region }}
      settings:
        dedicated_masters_threshold: 6
      plan:
        cluster_topology:
          - zone_count: 1
            elasticsearch:
              node_attributes:
                data: hot
            instance_configuration_id: gcp.es.datahot.n2.68x10x45
            node_roles:
              - master
              - ingest
              - remote_cluster_client
              - data_hot
              - transform
              - data_content
            id: hot_content
            size:
              value: 1024
              resource: memory
        elasticsearch:
          version: {{ stack_version }}
        deployment_template:
          id: gcp-storage-optimized
      ref_id: main-elasticsearch
  enterprise_search: []
  kibana:
    - elasticsearch_cluster_ref_id: main-elasticsearch
      region: {{ region }}
      plan:
        cluster_topology:
          - instance_configuration_id: gcp.kibana.n2.68x32x45
            zone_count: 1
            size:
              value: 1024
              resource: memory
        kibana:
          version: {{ stack_version }}
      ref_id: main-kibana
```

- Create an ECH deployment by running the following command

```bash
qaf elastic-cloud deployments create --stack-version 9.3.0 --version-validation --deployment-name prebuilt-rules-oom-test-9.3.0 --environment production --no-autoscaling --no-sso --region gcp-us-west2 --plan prebuilt_rules_oom_testing
```

- Run the tests by running the following command

```bash
qaf kibana ftr run-config --ec-deployment-name prebuilt-rules-oom-test-9.3.0 --kibana-repo-root <kibana-root> <kibana-root>/x-pack/solutions/security/test/security_solution_api_integration/test_suites/detections_response/rules_management/prebuilt_rules/oom_testing/configs/ess_basic_license.config.ts
```

where `<kibana-root>` is the absolute path to the Kibana's root folder.
@kibanamachine
Copy link
Copy Markdown
Contributor

Looks like this PR has backport PRs but they still haven't been merged. Please merge them ASAP to keep the branches relatively in sync.
cc: @maximpn

2 similar comments
@kibanamachine
Copy link
Copy Markdown
Contributor

Looks like this PR has backport PRs but they still haven't been merged. Please merge them ASAP to keep the branches relatively in sync.
cc: @maximpn

@kibanamachine
Copy link
Copy Markdown
Contributor

Looks like this PR has backport PRs but they still haven't been merged. Please merge them ASAP to keep the branches relatively in sync.
cc: @maximpn

@maximpn
Copy link
Copy Markdown
Contributor Author

maximpn commented Oct 22, 2025

💚 All backports created successfully

Status Branch Result
9.2
8.19

Note: Successful backport PRs will be merged automatically after passing CI.

Questions ?

Please refer to the Backport tool documentation

maximpn added a commit to maximpn/kibana that referenced this pull request Oct 22, 2025
…stic#236891)

**Partially addresses:** elastic#188090

## Summary

This PR contains FTR tests designed to expose potential Out of Memory (OOM) issues in Kibana when performing memory-intensive operations related to **Detection Prebuilt Rules**. The tests open a possibility to test against any Prebuilt Rules fleet package version including prerelease packages.

## Running test instructions

- Set up QAF by following to the [instructions](https://docs.elastic.dev/appex-qa/qaf/getting-started) (internal)
- Place the following Elastic Cloud plan in `~/.qaf/config/cloud_plans/prebuilt_rules_oom_testing.yml`
```yaml
---
name: {{ deployment_name }}
settings:
  autoscaling_enabled: {{ autoscaling_enabled }}
metadata:
  system_owned: false
resources:
  elasticsearch:
    - region: {{ region }}
      settings:
        dedicated_masters_threshold: 6
      plan:
        cluster_topology:
          - zone_count: 1
            elasticsearch:
              node_attributes:
                data: hot
            instance_configuration_id: gcp.es.datahot.n2.68x10x45
            node_roles:
              - master
              - ingest
              - remote_cluster_client
              - data_hot
              - transform
              - data_content
            id: hot_content
            size:
              value: 1024
              resource: memory
        elasticsearch:
          version: {{ stack_version }}
        deployment_template:
          id: gcp-storage-optimized
      ref_id: main-elasticsearch
  enterprise_search: []
  kibana:
    - elasticsearch_cluster_ref_id: main-elasticsearch
      region: {{ region }}
      plan:
        cluster_topology:
          - instance_configuration_id: gcp.kibana.n2.68x32x45
            zone_count: 1
            size:
              value: 1024
              resource: memory
        kibana:
          version: {{ stack_version }}
      ref_id: main-kibana
```

- Create an ECH deployment by running the following command

```bash
qaf elastic-cloud deployments create --stack-version 9.3.0 --version-validation --deployment-name prebuilt-rules-oom-test-9.3.0 --environment production --no-autoscaling --no-sso --region gcp-us-west2 --plan prebuilt_rules_oom_testing
```

- Run the tests by running the following command

```bash
qaf kibana ftr run-config --ec-deployment-name prebuilt-rules-oom-test-9.3.0 --kibana-repo-root <kibana-root> <kibana-root>/x-pack/solutions/security/test/security_solution_api_integration/test_suites/detections_response/rules_management/prebuilt_rules/oom_testing/configs/ess_basic_license.config.ts
```

where `<kibana-root>` is the absolute path to the Kibana's root folder.

(cherry picked from commit d99c5b4)
maximpn added a commit to maximpn/kibana that referenced this pull request Oct 22, 2025
…stic#236891)

**Partially addresses:** elastic#188090

## Summary

This PR contains FTR tests designed to expose potential Out of Memory (OOM) issues in Kibana when performing memory-intensive operations related to **Detection Prebuilt Rules**. The tests open a possibility to test against any Prebuilt Rules fleet package version including prerelease packages.

## Running test instructions

- Set up QAF by following to the [instructions](https://docs.elastic.dev/appex-qa/qaf/getting-started) (internal)
- Place the following Elastic Cloud plan in `~/.qaf/config/cloud_plans/prebuilt_rules_oom_testing.yml`
```yaml
---
name: {{ deployment_name }}
settings:
  autoscaling_enabled: {{ autoscaling_enabled }}
metadata:
  system_owned: false
resources:
  elasticsearch:
    - region: {{ region }}
      settings:
        dedicated_masters_threshold: 6
      plan:
        cluster_topology:
          - zone_count: 1
            elasticsearch:
              node_attributes:
                data: hot
            instance_configuration_id: gcp.es.datahot.n2.68x10x45
            node_roles:
              - master
              - ingest
              - remote_cluster_client
              - data_hot
              - transform
              - data_content
            id: hot_content
            size:
              value: 1024
              resource: memory
        elasticsearch:
          version: {{ stack_version }}
        deployment_template:
          id: gcp-storage-optimized
      ref_id: main-elasticsearch
  enterprise_search: []
  kibana:
    - elasticsearch_cluster_ref_id: main-elasticsearch
      region: {{ region }}
      plan:
        cluster_topology:
          - instance_configuration_id: gcp.kibana.n2.68x32x45
            zone_count: 1
            size:
              value: 1024
              resource: memory
        kibana:
          version: {{ stack_version }}
      ref_id: main-kibana
```

- Create an ECH deployment by running the following command

```bash
qaf elastic-cloud deployments create --stack-version 9.3.0 --version-validation --deployment-name prebuilt-rules-oom-test-9.3.0 --environment production --no-autoscaling --no-sso --region gcp-us-west2 --plan prebuilt_rules_oom_testing
```

- Run the tests by running the following command

```bash
qaf kibana ftr run-config --ec-deployment-name prebuilt-rules-oom-test-9.3.0 --kibana-repo-root <kibana-root> <kibana-root>/x-pack/solutions/security/test/security_solution_api_integration/test_suites/detections_response/rules_management/prebuilt_rules/oom_testing/configs/ess_basic_license.config.ts
```

where `<kibana-root>` is the absolute path to the Kibana's root folder.

(cherry picked from commit d99c5b4)

# Conflicts:
#	.buildkite/ftr_security_stateful_configs.yml
maximpn added a commit that referenced this pull request Oct 22, 2025
…ng (#236891) (#240013)

# Backport

This will backport the following commits from `main` to `8.19`:
- [[Security Solution] Add FTR tests for prebuilt rules OOM testing
(#236891)](#236891)

<!--- Backport version: 10.0.0 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sorenlouv/backport)

<!--BACKPORT [{"author":{"name":"Maxim
Palenov","email":"maxim.palenov@elastic.co"},"sourceCommit":{"committedDate":"2025-10-10T12:27:05Z","message":"[Security
Solution] Add FTR tests for prebuilt rules OOM testing
(#236891)\n\n**Partially addresses:**
https://github.com/elastic/kibana/issues/188090\n\n## Summary\n\nThis PR
contains FTR tests designed to expose potential Out of Memory (OOM)
issues in Kibana when performing memory-intensive operations related to
**Detection Prebuilt Rules**. The tests open a possibility to test
against any Prebuilt Rules fleet package version including prerelease
packages.\n\n## Running test instructions\n\n- Set up QAF by following
to the
[instructions](https://docs.elastic.dev/appex-qa/qaf/getting-started)
(internal)\n- Place the following Elastic Cloud plan in
`~/.qaf/config/cloud_plans/prebuilt_rules_oom_testing.yml`\n```yaml\n---\nname:
{{ deployment_name }}\nsettings:\n autoscaling_enabled: {{
autoscaling_enabled }}\nmetadata:\n system_owned: false\nresources:\n
elasticsearch:\n - region: {{ region }}\n settings:\n
dedicated_masters_threshold: 6\n plan:\n cluster_topology:\n -
zone_count: 1\n elasticsearch:\n node_attributes:\n data: hot\n
instance_configuration_id: gcp.es.datahot.n2.68x10x45\n node_roles:\n -
master\n - ingest\n - remote_cluster_client\n - data_hot\n - transform\n
- data_content\n id: hot_content\n size:\n value: 1024\n resource:
memory\n elasticsearch:\n version: {{ stack_version }}\n
deployment_template:\n id: gcp-storage-optimized\n ref_id:
main-elasticsearch\n enterprise_search: []\n kibana:\n -
elasticsearch_cluster_ref_id: main-elasticsearch\n region: {{ region
}}\n plan:\n cluster_topology:\n - instance_configuration_id:
gcp.kibana.n2.68x32x45\n zone_count: 1\n size:\n value: 1024\n resource:
memory\n kibana:\n version: {{ stack_version }}\n ref_id:
main-kibana\n```\n\n- Create an ECH deployment by running the following
command\n\n```bash\nqaf elastic-cloud deployments create --stack-version
9.3.0 --version-validation --deployment-name
prebuilt-rules-oom-test-9.3.0 --environment production --no-autoscaling
--no-sso --region gcp-us-west2 --plan
prebuilt_rules_oom_testing\n```\n\n- Run the tests by running the
following command\n\n```bash\nqaf kibana ftr run-config
--ec-deployment-name prebuilt-rules-oom-test-9.3.0 --kibana-repo-root
<kibana-root>
<kibana-root>/x-pack/solutions/security/test/security_solution_api_integration/test_suites/detections_response/rules_management/prebuilt_rules/oom_testing/configs/ess_basic_license.config.ts\n```\n\nwhere
`<kibana-root>` is the absolute path to the Kibana's root
folder.","sha":"d99c5b4b7211c1510f18f2b6260e24ea327b7d5a","branchLabelMapping":{"^v9.3.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","backport
missing","Team:Detections and Resp","Team:
SecuritySolution","Team:Detection Rule Management","Feature:Prebuilt
Detection
Rules","backport:version","v9.2.0","v9.3.0","v8.19.6","v9.0.9"],"title":"[Security
Solution] Add FTR tests for prebuilt rules OOM
testing","number":236891,"url":"https://github.com/elastic/kibana/pull/236891","mergeCommit":{"message":"[Security
Solution] Add FTR tests for prebuilt rules OOM testing
(#236891)\n\n**Partially addresses:**
https://github.com/elastic/kibana/issues/188090\n\n## Summary\n\nThis PR
contains FTR tests designed to expose potential Out of Memory (OOM)
issues in Kibana when performing memory-intensive operations related to
**Detection Prebuilt Rules**. The tests open a possibility to test
against any Prebuilt Rules fleet package version including prerelease
packages.\n\n## Running test instructions\n\n- Set up QAF by following
to the
[instructions](https://docs.elastic.dev/appex-qa/qaf/getting-started)
(internal)\n- Place the following Elastic Cloud plan in
`~/.qaf/config/cloud_plans/prebuilt_rules_oom_testing.yml`\n```yaml\n---\nname:
{{ deployment_name }}\nsettings:\n autoscaling_enabled: {{
autoscaling_enabled }}\nmetadata:\n system_owned: false\nresources:\n
elasticsearch:\n - region: {{ region }}\n settings:\n
dedicated_masters_threshold: 6\n plan:\n cluster_topology:\n -
zone_count: 1\n elasticsearch:\n node_attributes:\n data: hot\n
instance_configuration_id: gcp.es.datahot.n2.68x10x45\n node_roles:\n -
master\n - ingest\n - remote_cluster_client\n - data_hot\n - transform\n
- data_content\n id: hot_content\n size:\n value: 1024\n resource:
memory\n elasticsearch:\n version: {{ stack_version }}\n
deployment_template:\n id: gcp-storage-optimized\n ref_id:
main-elasticsearch\n enterprise_search: []\n kibana:\n -
elasticsearch_cluster_ref_id: main-elasticsearch\n region: {{ region
}}\n plan:\n cluster_topology:\n - instance_configuration_id:
gcp.kibana.n2.68x32x45\n zone_count: 1\n size:\n value: 1024\n resource:
memory\n kibana:\n version: {{ stack_version }}\n ref_id:
main-kibana\n```\n\n- Create an ECH deployment by running the following
command\n\n```bash\nqaf elastic-cloud deployments create --stack-version
9.3.0 --version-validation --deployment-name
prebuilt-rules-oom-test-9.3.0 --environment production --no-autoscaling
--no-sso --region gcp-us-west2 --plan
prebuilt_rules_oom_testing\n```\n\n- Run the tests by running the
following command\n\n```bash\nqaf kibana ftr run-config
--ec-deployment-name prebuilt-rules-oom-test-9.3.0 --kibana-repo-root
<kibana-root>
<kibana-root>/x-pack/solutions/security/test/security_solution_api_integration/test_suites/detections_response/rules_management/prebuilt_rules/oom_testing/configs/ess_basic_license.config.ts\n```\n\nwhere
`<kibana-root>` is the absolute path to the Kibana's root
folder.","sha":"d99c5b4b7211c1510f18f2b6260e24ea327b7d5a"}},"sourceBranch":"main","suggestedTargetBranches":["9.0"],"targetPullRequestStates":[{"branch":"9.2","label":"v9.2.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"url":"https://github.com/elastic/kibana/pull/238438","number":238438,"state":"OPEN"},{"branch":"main","label":"v9.3.0","branchLabelMappingKey":"^v9.3.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/236891","number":236891,"mergeCommit":{"message":"[Security
Solution] Add FTR tests for prebuilt rules OOM testing
(#236891)\n\n**Partially addresses:**
https://github.com/elastic/kibana/issues/188090\n\n## Summary\n\nThis PR
contains FTR tests designed to expose potential Out of Memory (OOM)
issues in Kibana when performing memory-intensive operations related to
**Detection Prebuilt Rules**. The tests open a possibility to test
against any Prebuilt Rules fleet package version including prerelease
packages.\n\n## Running test instructions\n\n- Set up QAF by following
to the
[instructions](https://docs.elastic.dev/appex-qa/qaf/getting-started)
(internal)\n- Place the following Elastic Cloud plan in
`~/.qaf/config/cloud_plans/prebuilt_rules_oom_testing.yml`\n```yaml\n---\nname:
{{ deployment_name }}\nsettings:\n autoscaling_enabled: {{
autoscaling_enabled }}\nmetadata:\n system_owned: false\nresources:\n
elasticsearch:\n - region: {{ region }}\n settings:\n
dedicated_masters_threshold: 6\n plan:\n cluster_topology:\n -
zone_count: 1\n elasticsearch:\n node_attributes:\n data: hot\n
instance_configuration_id: gcp.es.datahot.n2.68x10x45\n node_roles:\n -
master\n - ingest\n - remote_cluster_client\n - data_hot\n - transform\n
- data_content\n id: hot_content\n size:\n value: 1024\n resource:
memory\n elasticsearch:\n version: {{ stack_version }}\n
deployment_template:\n id: gcp-storage-optimized\n ref_id:
main-elasticsearch\n enterprise_search: []\n kibana:\n -
elasticsearch_cluster_ref_id: main-elasticsearch\n region: {{ region
}}\n plan:\n cluster_topology:\n - instance_configuration_id:
gcp.kibana.n2.68x32x45\n zone_count: 1\n size:\n value: 1024\n resource:
memory\n kibana:\n version: {{ stack_version }}\n ref_id:
main-kibana\n```\n\n- Create an ECH deployment by running the following
command\n\n```bash\nqaf elastic-cloud deployments create --stack-version
9.3.0 --version-validation --deployment-name
prebuilt-rules-oom-test-9.3.0 --environment production --no-autoscaling
--no-sso --region gcp-us-west2 --plan
prebuilt_rules_oom_testing\n```\n\n- Run the tests by running the
following command\n\n```bash\nqaf kibana ftr run-config
--ec-deployment-name prebuilt-rules-oom-test-9.3.0 --kibana-repo-root
<kibana-root>
<kibana-root>/x-pack/solutions/security/test/security_solution_api_integration/test_suites/detections_response/rules_management/prebuilt_rules/oom_testing/configs/ess_basic_license.config.ts\n```\n\nwhere
`<kibana-root>` is the absolute path to the Kibana's root
folder.","sha":"d99c5b4b7211c1510f18f2b6260e24ea327b7d5a"}},{"branch":"8.19","label":"v8.19.6","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"url":"https://github.com/elastic/kibana/pull/238437","number":238437,"state":"OPEN"},{"branch":"9.0","label":"v9.0.9","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"url":"https://github.com/elastic/kibana/pull/238467","number":238467,"branch":"9.1","state":"OPEN"}]}]
BACKPORT-->
maximpn added a commit that referenced this pull request Oct 22, 2025
#236891) (#238467)

# Backport

This will backport the following commits from `main` to `9.1`:
 - [[Security Solution] Add FTR tests for prebuilt rules OOM testing (#236891)](#236891)

<!--- Backport version: 10.0.2 -->

### Questions ?
Please refer to the [Backport tool documentation](https://github.com/sorenlouv/backport)

<!--BACKPORT [{"author":{"name":"Maxim Palenov","email":"maxim.palenov@elastic.co"},"sourceCommit":{"committedDate":"2025-10-10T12:27:05Z","message":"[Security Solution] Add FTR tests for prebuilt rules OOM testing (#236891)\n\n**Partially addresses:** https://github.com/elastic/kibana/issues/188090\n\n## Summary\n\nThis PR contains FTR tests designed to expose potential Out of Memory (OOM) issues in Kibana when performing memory-intensive operations related to **Detection Prebuilt Rules**. The tests open a possibility to test against any Prebuilt Rules fleet package version including prerelease packages.\n\n## Running test instructions\n\n- Set up QAF by following to the [instructions](https://docs.elastic.dev/appex-qa/qaf/getting-started) (internal)\n- Place the following Elastic Cloud plan in `~/.qaf/config/cloud_plans/prebuilt_rules_oom_testing.yml`\n```yaml\n---\nname: {{ deployment_name }}\nsettings:\n  autoscaling_enabled: {{ autoscaling_enabled }}\nmetadata:\n  system_owned: false\nresources:\n  elasticsearch:\n    - region: {{ region }}\n      settings:\n        dedicated_masters_threshold: 6\n      plan:\n        cluster_topology:\n          - zone_count: 1\n            elasticsearch:\n              node_attributes:\n                data: hot\n            instance_configuration_id: gcp.es.datahot.n2.68x10x45\n            node_roles:\n              - master\n              - ingest\n              - remote_cluster_client\n              - data_hot\n              - transform\n              - data_content\n            id: hot_content\n            size:\n              value: 1024\n              resource: memory\n        elasticsearch:\n          version: {{ stack_version }}\n        deployment_template:\n          id: gcp-storage-optimized\n      ref_id: main-elasticsearch\n  enterprise_search: []\n  kibana:\n    - elasticsearch_cluster_ref_id: main-elasticsearch\n      region: {{ region }}\n      plan:\n        cluster_topology:\n          - instance_configuration_id: gcp.kibana.n2.68x32x45\n            zone_count: 1\n            size:\n              value: 1024\n              resource: memory\n        kibana:\n          version: {{ stack_version }}\n      ref_id: main-kibana\n```\n\n- Create an ECH deployment by running the following command\n\n```bash\nqaf elastic-cloud deployments create --stack-version 9.3.0 --version-validation --deployment-name prebuilt-rules-oom-test-9.3.0 --environment production --no-autoscaling --no-sso --region gcp-us-west2 --plan prebuilt_rules_oom_testing\n```\n\n- Run the tests by running the following command\n\n```bash\nqaf kibana ftr run-config --ec-deployment-name prebuilt-rules-oom-test-9.3.0 --kibana-repo-root <kibana-root> <kibana-root>/x-pack/solutions/security/test/security_solution_api_integration/test_suites/detections_response/rules_management/prebuilt_rules/oom_testing/configs/ess_basic_license.config.ts\n```\n\nwhere `<kibana-root>` is the absolute path to the Kibana's root folder.","sha":"d99c5b4b7211c1510f18f2b6260e24ea327b7d5a","branchLabelMapping":{"^v9.3.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","Team:Detections and Resp","Team: SecuritySolution","Team:Detection Rule Management","Feature:Prebuilt Detection Rules","backport:version","v9.2.0","v9.3.0","v9.1.6","v8.18.9","v8.19.6","v9.0.9"],"title":"[Security Solution] Add FTR tests for prebuilt rules OOM testing","number":236891,"url":"https://github.com/elastic/kibana/pull/236891","mergeCommit":{"message":"[Security Solution] Add FTR tests for prebuilt rules OOM testing (#236891)\n\n**Partially addresses:** https://github.com/elastic/kibana/issues/188090\n\n## Summary\n\nThis PR contains FTR tests designed to expose potential Out of Memory (OOM) issues in Kibana when performing memory-intensive operations related to **Detection Prebuilt Rules**. The tests open a possibility to test against any Prebuilt Rules fleet package version including prerelease packages.\n\n## Running test instructions\n\n- Set up QAF by following to the [instructions](https://docs.elastic.dev/appex-qa/qaf/getting-started) (internal)\n- Place the following Elastic Cloud plan in `~/.qaf/config/cloud_plans/prebuilt_rules_oom_testing.yml`\n```yaml\n---\nname: {{ deployment_name }}\nsettings:\n  autoscaling_enabled: {{ autoscaling_enabled }}\nmetadata:\n  system_owned: false\nresources:\n  elasticsearch:\n    - region: {{ region }}\n      settings:\n        dedicated_masters_threshold: 6\n      plan:\n        cluster_topology:\n          - zone_count: 1\n            elasticsearch:\n              node_attributes:\n                data: hot\n            instance_configuration_id: gcp.es.datahot.n2.68x10x45\n            node_roles:\n              - master\n              - ingest\n              - remote_cluster_client\n              - data_hot\n              - transform\n              - data_content\n            id: hot_content\n            size:\n              value: 1024\n              resource: memory\n        elasticsearch:\n          version: {{ stack_version }}\n        deployment_template:\n          id: gcp-storage-optimized\n      ref_id: main-elasticsearch\n  enterprise_search: []\n  kibana:\n    - elasticsearch_cluster_ref_id: main-elasticsearch\n      region: {{ region }}\n      plan:\n        cluster_topology:\n          - instance_configuration_id: gcp.kibana.n2.68x32x45\n            zone_count: 1\n            size:\n              value: 1024\n              resource: memory\n        kibana:\n          version: {{ stack_version }}\n      ref_id: main-kibana\n```\n\n- Create an ECH deployment by running the following command\n\n```bash\nqaf elastic-cloud deployments create --stack-version 9.3.0 --version-validation --deployment-name prebuilt-rules-oom-test-9.3.0 --environment production --no-autoscaling --no-sso --region gcp-us-west2 --plan prebuilt_rules_oom_testing\n```\n\n- Run the tests by running the following command\n\n```bash\nqaf kibana ftr run-config --ec-deployment-name prebuilt-rules-oom-test-9.3.0 --kibana-repo-root <kibana-root> <kibana-root>/x-pack/solutions/security/test/security_solution_api_integration/test_suites/detections_response/rules_management/prebuilt_rules/oom_testing/configs/ess_basic_license.config.ts\n```\n\nwhere `<kibana-root>` is the absolute path to the Kibana's root folder.","sha":"d99c5b4b7211c1510f18f2b6260e24ea327b7d5a"}},"sourceBranch":"main","suggestedTargetBranches":["9.1","8.18","9.0"],"targetPullRequestStates":[{"branch":"9.2","label":"v9.2.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"url":"https://github.com/elastic/kibana/pull/238438","number":238438,"state":"OPEN"},{"branch":"main","label":"v9.3.0","branchLabelMappingKey":"^v9.3.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/236891","number":236891,"mergeCommit":{"message":"[Security Solution] Add FTR tests for prebuilt rules OOM testing (#236891)\n\n**Partially addresses:** https://github.com/elastic/kibana/issues/188090\n\n## Summary\n\nThis PR contains FTR tests designed to expose potential Out of Memory (OOM) issues in Kibana when performing memory-intensive operations related to **Detection Prebuilt Rules**. The tests open a possibility to test against any Prebuilt Rules fleet package version including prerelease packages.\n\n## Running test instructions\n\n- Set up QAF by following to the [instructions](https://docs.elastic.dev/appex-qa/qaf/getting-started) (internal)\n- Place the following Elastic Cloud plan in `~/.qaf/config/cloud_plans/prebuilt_rules_oom_testing.yml`\n```yaml\n---\nname: {{ deployment_name }}\nsettings:\n  autoscaling_enabled: {{ autoscaling_enabled }}\nmetadata:\n  system_owned: false\nresources:\n  elasticsearch:\n    - region: {{ region }}\n      settings:\n        dedicated_masters_threshold: 6\n      plan:\n        cluster_topology:\n          - zone_count: 1\n            elasticsearch:\n              node_attributes:\n                data: hot\n            instance_configuration_id: gcp.es.datahot.n2.68x10x45\n            node_roles:\n              - master\n              - ingest\n              - remote_cluster_client\n              - data_hot\n              - transform\n              - data_content\n            id: hot_content\n            size:\n              value: 1024\n              resource: memory\n        elasticsearch:\n          version: {{ stack_version }}\n        deployment_template:\n          id: gcp-storage-optimized\n      ref_id: main-elasticsearch\n  enterprise_search: []\n  kibana:\n    - elasticsearch_cluster_ref_id: main-elasticsearch\n      region: {{ region }}\n      plan:\n        cluster_topology:\n          - instance_configuration_id: gcp.kibana.n2.68x32x45\n            zone_count: 1\n            size:\n              value: 1024\n              resource: memory\n        kibana:\n          version: {{ stack_version }}\n      ref_id: main-kibana\n```\n\n- Create an ECH deployment by running the following command\n\n```bash\nqaf elastic-cloud deployments create --stack-version 9.3.0 --version-validation --deployment-name prebuilt-rules-oom-test-9.3.0 --environment production --no-autoscaling --no-sso --region gcp-us-west2 --plan prebuilt_rules_oom_testing\n```\n\n- Run the tests by running the following command\n\n```bash\nqaf kibana ftr run-config --ec-deployment-name prebuilt-rules-oom-test-9.3.0 --kibana-repo-root <kibana-root> <kibana-root>/x-pack/solutions/security/test/security_solution_api_integration/test_suites/detections_response/rules_management/prebuilt_rules/oom_testing/configs/ess_basic_license.config.ts\n```\n\nwhere `<kibana-root>` is the absolute path to the Kibana's root folder.","sha":"d99c5b4b7211c1510f18f2b6260e24ea327b7d5a"}},{"branch":"9.1","label":"v9.1.6","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.18","label":"v8.18.9","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.19","label":"v8.19.6","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"url":"https://github.com/elastic/kibana/pull/238437","number":238437,"state":"OPEN"},{"branch":"9.0","label":"v9.0.9","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}] BACKPORT-->
maximpn added a commit that referenced this pull request Oct 22, 2025
#236891) (#240012)

# Backport

This will backport the following commits from `main` to `9.2`:
- [[Security Solution] Add FTR tests for prebuilt rules OOM testing
(#236891)](#236891)

<!--- Backport version: 10.0.0 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sorenlouv/backport)

<!--BACKPORT [{"author":{"name":"Maxim
Palenov","email":"maxim.palenov@elastic.co"},"sourceCommit":{"committedDate":"2025-10-10T12:27:05Z","message":"[Security
Solution] Add FTR tests for prebuilt rules OOM testing
(#236891)\n\n**Partially addresses:**
https://github.com/elastic/kibana/issues/188090\n\n## Summary\n\nThis PR
contains FTR tests designed to expose potential Out of Memory (OOM)
issues in Kibana when performing memory-intensive operations related to
**Detection Prebuilt Rules**. The tests open a possibility to test
against any Prebuilt Rules fleet package version including prerelease
packages.\n\n## Running test instructions\n\n- Set up QAF by following
to the
[instructions](https://docs.elastic.dev/appex-qa/qaf/getting-started)
(internal)\n- Place the following Elastic Cloud plan in
`~/.qaf/config/cloud_plans/prebuilt_rules_oom_testing.yml`\n```yaml\n---\nname:
{{ deployment_name }}\nsettings:\n autoscaling_enabled: {{
autoscaling_enabled }}\nmetadata:\n system_owned: false\nresources:\n
elasticsearch:\n - region: {{ region }}\n settings:\n
dedicated_masters_threshold: 6\n plan:\n cluster_topology:\n -
zone_count: 1\n elasticsearch:\n node_attributes:\n data: hot\n
instance_configuration_id: gcp.es.datahot.n2.68x10x45\n node_roles:\n -
master\n - ingest\n - remote_cluster_client\n - data_hot\n - transform\n
- data_content\n id: hot_content\n size:\n value: 1024\n resource:
memory\n elasticsearch:\n version: {{ stack_version }}\n
deployment_template:\n id: gcp-storage-optimized\n ref_id:
main-elasticsearch\n enterprise_search: []\n kibana:\n -
elasticsearch_cluster_ref_id: main-elasticsearch\n region: {{ region
}}\n plan:\n cluster_topology:\n - instance_configuration_id:
gcp.kibana.n2.68x32x45\n zone_count: 1\n size:\n value: 1024\n resource:
memory\n kibana:\n version: {{ stack_version }}\n ref_id:
main-kibana\n```\n\n- Create an ECH deployment by running the following
command\n\n```bash\nqaf elastic-cloud deployments create --stack-version
9.3.0 --version-validation --deployment-name
prebuilt-rules-oom-test-9.3.0 --environment production --no-autoscaling
--no-sso --region gcp-us-west2 --plan
prebuilt_rules_oom_testing\n```\n\n- Run the tests by running the
following command\n\n```bash\nqaf kibana ftr run-config
--ec-deployment-name prebuilt-rules-oom-test-9.3.0 --kibana-repo-root
<kibana-root>
<kibana-root>/x-pack/solutions/security/test/security_solution_api_integration/test_suites/detections_response/rules_management/prebuilt_rules/oom_testing/configs/ess_basic_license.config.ts\n```\n\nwhere
`<kibana-root>` is the absolute path to the Kibana's root
folder.","sha":"d99c5b4b7211c1510f18f2b6260e24ea327b7d5a","branchLabelMapping":{"^v9.3.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","backport
missing","Team:Detections and Resp","Team:
SecuritySolution","Team:Detection Rule Management","Feature:Prebuilt
Detection
Rules","backport:version","v9.2.0","v9.3.0","v8.19.6","v9.0.9"],"title":"[Security
Solution] Add FTR tests for prebuilt rules OOM
testing","number":236891,"url":"https://github.com/elastic/kibana/pull/236891","mergeCommit":{"message":"[Security
Solution] Add FTR tests for prebuilt rules OOM testing
(#236891)\n\n**Partially addresses:**
https://github.com/elastic/kibana/issues/188090\n\n## Summary\n\nThis PR
contains FTR tests designed to expose potential Out of Memory (OOM)
issues in Kibana when performing memory-intensive operations related to
**Detection Prebuilt Rules**. The tests open a possibility to test
against any Prebuilt Rules fleet package version including prerelease
packages.\n\n## Running test instructions\n\n- Set up QAF by following
to the
[instructions](https://docs.elastic.dev/appex-qa/qaf/getting-started)
(internal)\n- Place the following Elastic Cloud plan in
`~/.qaf/config/cloud_plans/prebuilt_rules_oom_testing.yml`\n```yaml\n---\nname:
{{ deployment_name }}\nsettings:\n autoscaling_enabled: {{
autoscaling_enabled }}\nmetadata:\n system_owned: false\nresources:\n
elasticsearch:\n - region: {{ region }}\n settings:\n
dedicated_masters_threshold: 6\n plan:\n cluster_topology:\n -
zone_count: 1\n elasticsearch:\n node_attributes:\n data: hot\n
instance_configuration_id: gcp.es.datahot.n2.68x10x45\n node_roles:\n -
master\n - ingest\n - remote_cluster_client\n - data_hot\n - transform\n
- data_content\n id: hot_content\n size:\n value: 1024\n resource:
memory\n elasticsearch:\n version: {{ stack_version }}\n
deployment_template:\n id: gcp-storage-optimized\n ref_id:
main-elasticsearch\n enterprise_search: []\n kibana:\n -
elasticsearch_cluster_ref_id: main-elasticsearch\n region: {{ region
}}\n plan:\n cluster_topology:\n - instance_configuration_id:
gcp.kibana.n2.68x32x45\n zone_count: 1\n size:\n value: 1024\n resource:
memory\n kibana:\n version: {{ stack_version }}\n ref_id:
main-kibana\n```\n\n- Create an ECH deployment by running the following
command\n\n```bash\nqaf elastic-cloud deployments create --stack-version
9.3.0 --version-validation --deployment-name
prebuilt-rules-oom-test-9.3.0 --environment production --no-autoscaling
--no-sso --region gcp-us-west2 --plan
prebuilt_rules_oom_testing\n```\n\n- Run the tests by running the
following command\n\n```bash\nqaf kibana ftr run-config
--ec-deployment-name prebuilt-rules-oom-test-9.3.0 --kibana-repo-root
<kibana-root>
<kibana-root>/x-pack/solutions/security/test/security_solution_api_integration/test_suites/detections_response/rules_management/prebuilt_rules/oom_testing/configs/ess_basic_license.config.ts\n```\n\nwhere
`<kibana-root>` is the absolute path to the Kibana's root
folder.","sha":"d99c5b4b7211c1510f18f2b6260e24ea327b7d5a"}},"sourceBranch":"main","suggestedTargetBranches":["9.0"],"targetPullRequestStates":[{"branch":"9.2","label":"v9.2.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"url":"https://github.com/elastic/kibana/pull/238438","number":238438,"state":"OPEN"},{"branch":"main","label":"v9.3.0","branchLabelMappingKey":"^v9.3.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/236891","number":236891,"mergeCommit":{"message":"[Security
Solution] Add FTR tests for prebuilt rules OOM testing
(#236891)\n\n**Partially addresses:**
https://github.com/elastic/kibana/issues/188090\n\n## Summary\n\nThis PR
contains FTR tests designed to expose potential Out of Memory (OOM)
issues in Kibana when performing memory-intensive operations related to
**Detection Prebuilt Rules**. The tests open a possibility to test
against any Prebuilt Rules fleet package version including prerelease
packages.\n\n## Running test instructions\n\n- Set up QAF by following
to the
[instructions](https://docs.elastic.dev/appex-qa/qaf/getting-started)
(internal)\n- Place the following Elastic Cloud plan in
`~/.qaf/config/cloud_plans/prebuilt_rules_oom_testing.yml`\n```yaml\n---\nname:
{{ deployment_name }}\nsettings:\n autoscaling_enabled: {{
autoscaling_enabled }}\nmetadata:\n system_owned: false\nresources:\n
elasticsearch:\n - region: {{ region }}\n settings:\n
dedicated_masters_threshold: 6\n plan:\n cluster_topology:\n -
zone_count: 1\n elasticsearch:\n node_attributes:\n data: hot\n
instance_configuration_id: gcp.es.datahot.n2.68x10x45\n node_roles:\n -
master\n - ingest\n - remote_cluster_client\n - data_hot\n - transform\n
- data_content\n id: hot_content\n size:\n value: 1024\n resource:
memory\n elasticsearch:\n version: {{ stack_version }}\n
deployment_template:\n id: gcp-storage-optimized\n ref_id:
main-elasticsearch\n enterprise_search: []\n kibana:\n -
elasticsearch_cluster_ref_id: main-elasticsearch\n region: {{ region
}}\n plan:\n cluster_topology:\n - instance_configuration_id:
gcp.kibana.n2.68x32x45\n zone_count: 1\n size:\n value: 1024\n resource:
memory\n kibana:\n version: {{ stack_version }}\n ref_id:
main-kibana\n```\n\n- Create an ECH deployment by running the following
command\n\n```bash\nqaf elastic-cloud deployments create --stack-version
9.3.0 --version-validation --deployment-name
prebuilt-rules-oom-test-9.3.0 --environment production --no-autoscaling
--no-sso --region gcp-us-west2 --plan
prebuilt_rules_oom_testing\n```\n\n- Run the tests by running the
following command\n\n```bash\nqaf kibana ftr run-config
--ec-deployment-name prebuilt-rules-oom-test-9.3.0 --kibana-repo-root
<kibana-root>
<kibana-root>/x-pack/solutions/security/test/security_solution_api_integration/test_suites/detections_response/rules_management/prebuilt_rules/oom_testing/configs/ess_basic_license.config.ts\n```\n\nwhere
`<kibana-root>` is the absolute path to the Kibana's root
folder.","sha":"d99c5b4b7211c1510f18f2b6260e24ea327b7d5a"}},{"branch":"8.19","label":"v8.19.6","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"url":"https://github.com/elastic/kibana/pull/238437","number":238437,"state":"OPEN"},{"branch":"9.0","label":"v9.0.9","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"url":"https://github.com/elastic/kibana/pull/238467","number":238467,"branch":"9.1","state":"OPEN"}]}]
BACKPORT-->
@kibanamachine
Copy link
Copy Markdown
Contributor

Looks like this PR has backport PRs but they still haven't been merged. Please merge them ASAP to keep the branches relatively in sync.
cc: @maximpn

@maximpn maximpn removed the v9.1.3 label Oct 23, 2025
nickpeihl pushed a commit to nickpeihl/kibana that referenced this pull request Oct 23, 2025
…stic#236891)

**Partially addresses:** elastic#188090

## Summary

This PR contains FTR tests designed to expose potential Out of Memory (OOM) issues in Kibana when performing memory-intensive operations related to **Detection Prebuilt Rules**. The tests open a possibility to test against any Prebuilt Rules fleet package version including prerelease packages.

## Running test instructions

- Set up QAF by following to the [instructions](https://docs.elastic.dev/appex-qa/qaf/getting-started) (internal)
- Place the following Elastic Cloud plan in `~/.qaf/config/cloud_plans/prebuilt_rules_oom_testing.yml`
```yaml
---
name: {{ deployment_name }}
settings:
  autoscaling_enabled: {{ autoscaling_enabled }}
metadata:
  system_owned: false
resources:
  elasticsearch:
    - region: {{ region }}
      settings:
        dedicated_masters_threshold: 6
      plan:
        cluster_topology:
          - zone_count: 1
            elasticsearch:
              node_attributes:
                data: hot
            instance_configuration_id: gcp.es.datahot.n2.68x10x45
            node_roles:
              - master
              - ingest
              - remote_cluster_client
              - data_hot
              - transform
              - data_content
            id: hot_content
            size:
              value: 1024
              resource: memory
        elasticsearch:
          version: {{ stack_version }}
        deployment_template:
          id: gcp-storage-optimized
      ref_id: main-elasticsearch
  enterprise_search: []
  kibana:
    - elasticsearch_cluster_ref_id: main-elasticsearch
      region: {{ region }}
      plan:
        cluster_topology:
          - instance_configuration_id: gcp.kibana.n2.68x32x45
            zone_count: 1
            size:
              value: 1024
              resource: memory
        kibana:
          version: {{ stack_version }}
      ref_id: main-kibana
```

- Create an ECH deployment by running the following command

```bash
qaf elastic-cloud deployments create --stack-version 9.3.0 --version-validation --deployment-name prebuilt-rules-oom-test-9.3.0 --environment production --no-autoscaling --no-sso --region gcp-us-west2 --plan prebuilt_rules_oom_testing
```

- Run the tests by running the following command

```bash
qaf kibana ftr run-config --ec-deployment-name prebuilt-rules-oom-test-9.3.0 --kibana-repo-root <kibana-root> <kibana-root>/x-pack/solutions/security/test/security_solution_api_integration/test_suites/detections_response/rules_management/prebuilt_rules/oom_testing/configs/ess_basic_license.config.ts
```

where `<kibana-root>` is the absolute path to the Kibana's root folder.
@mistic mistic added v8.19.7 and removed v8.19.6 labels Oct 23, 2025
@kibanamachine
Copy link
Copy Markdown
Contributor

Looks like this PR has backport PRs but they still haven't been merged. Please merge them ASAP to keep the branches relatively in sync.
cc: @maximpn

NicholasPeretti pushed a commit to NicholasPeretti/kibana that referenced this pull request Oct 27, 2025
…stic#236891)

**Partially addresses:** elastic#188090

## Summary

This PR contains FTR tests designed to expose potential Out of Memory (OOM) issues in Kibana when performing memory-intensive operations related to **Detection Prebuilt Rules**. The tests open a possibility to test against any Prebuilt Rules fleet package version including prerelease packages.

## Running test instructions

- Set up QAF by following to the [instructions](https://docs.elastic.dev/appex-qa/qaf/getting-started) (internal)
- Place the following Elastic Cloud plan in `~/.qaf/config/cloud_plans/prebuilt_rules_oom_testing.yml`
```yaml
---
name: {{ deployment_name }}
settings:
  autoscaling_enabled: {{ autoscaling_enabled }}
metadata:
  system_owned: false
resources:
  elasticsearch:
    - region: {{ region }}
      settings:
        dedicated_masters_threshold: 6
      plan:
        cluster_topology:
          - zone_count: 1
            elasticsearch:
              node_attributes:
                data: hot
            instance_configuration_id: gcp.es.datahot.n2.68x10x45
            node_roles:
              - master
              - ingest
              - remote_cluster_client
              - data_hot
              - transform
              - data_content
            id: hot_content
            size:
              value: 1024
              resource: memory
        elasticsearch:
          version: {{ stack_version }}
        deployment_template:
          id: gcp-storage-optimized
      ref_id: main-elasticsearch
  enterprise_search: []
  kibana:
    - elasticsearch_cluster_ref_id: main-elasticsearch
      region: {{ region }}
      plan:
        cluster_topology:
          - instance_configuration_id: gcp.kibana.n2.68x32x45
            zone_count: 1
            size:
              value: 1024
              resource: memory
        kibana:
          version: {{ stack_version }}
      ref_id: main-kibana
```

- Create an ECH deployment by running the following command

```bash
qaf elastic-cloud deployments create --stack-version 9.3.0 --version-validation --deployment-name prebuilt-rules-oom-test-9.3.0 --environment production --no-autoscaling --no-sso --region gcp-us-west2 --plan prebuilt_rules_oom_testing
```

- Run the tests by running the following command

```bash
qaf kibana ftr run-config --ec-deployment-name prebuilt-rules-oom-test-9.3.0 --kibana-repo-root <kibana-root> <kibana-root>/x-pack/solutions/security/test/security_solution_api_integration/test_suites/detections_response/rules_management/prebuilt_rules/oom_testing/configs/ess_basic_license.config.ts
```

where `<kibana-root>` is the absolute path to the Kibana's root folder.
@kibanamachine
Copy link
Copy Markdown
Contributor

Looks like this PR has backport PRs but they still haven't been merged. Please merge them ASAP to keep the branches relatively in sync.
cc: @maximpn

1 similar comment
@kibanamachine
Copy link
Copy Markdown
Contributor

Looks like this PR has backport PRs but they still haven't been merged. Please merge them ASAP to keep the branches relatively in sync.
cc: @maximpn

@banderror banderror removed the backport missing Added to PRs automatically when the are determined to be missing a backport. label Oct 29, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport:version Backport to applied version labels Feature:Prebuilt Detection Rules Security Solution Prebuilt Detection Rules area release_note:skip Skip the PR/issue when compiling release notes Team:Detection Rule Management Security Detection Rule Management Team Team:Detections and Resp Security Detection Response Team Team: SecuritySolution Security Solutions Team working on SIEM, Endpoint, Timeline, Resolver, etc. v8.19.7 v9.1.6 v9.2.0 v9.3.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants