Related to: https://elasticco.atlassian.net/browse/APEX-76 (internal)
Summary
Our existing package installation test has not been effective in catching potential OOMs. The test is designed to emulate the installation of 15,000 rules. However, in a Serverless environment, we've seen OOMs when installing ~5,000 rules. This might be because the integration test limits the heap but cannot control external memory, and in our investigation, we saw a significant amount of external memory being used before an OOM (300+MB).
We need to add an MKI test so that even if we tweak the heap or memory on Serverless, our test will continue to prevent regression.
PRs
Tests:
ECH pipeline and other infrastructure:
Serverless pipeline and other infrastructure:
Docs:
Misc:
Related to: https://elasticco.atlassian.net/browse/APEX-76 (internal)
Summary
Our existing package installation test has not been effective in catching potential OOMs. The test is designed to emulate the installation of 15,000 rules. However, in a Serverless environment, we've seen OOMs when installing ~5,000 rules. This might be because the integration test limits the heap but cannot control external memory, and in our investigation, we saw a significant amount of external memory being used before an OOM (300+MB).
We need to add an MKI test so that even if we tweak the heap or memory on Serverless, our test will continue to prevent regression.
PRs
Tests:
ECH pipeline and other infrastructure:
Serverless pipeline and other infrastructure:
Docs:
Misc: