Skip to content

[EDR Workflows] Stabilize "add a new entry" FTR test under env pressure#268313

Merged
szwarckonrad merged 3 commits into
elastic:mainfrom
szwarckonrad:fix-flaky-artifact-entries-add-test
May 11, 2026
Merged

[EDR Workflows] Stabilize "add a new entry" FTR test under env pressure#268313
szwarckonrad merged 3 commits into
elastic:mainfrom
szwarckonrad:fix-flaky-artifact-entries-add-test

Conversation

@szwarckonrad
Copy link
Copy Markdown
Contributor

The should be able to add a new ${testData.title} entry parametrized test in artifact_entries_list.ts intermittently fails on Serverless with a TimeoutError waiting for the new artifact's criteriaConditions card to render within the default 10s implicit wait. Mirrors the sibling update-flow pattern: wraps the post-create assertion in retry.waitForWithTimeout(20000, …) keyed on the criteriaConditions card before running the existing checkResults loop.

Closes #265265

@szwarckonrad szwarckonrad added release_note:skip Skip the PR/issue when compiling release notes backport:skip This PR does not require backporting Team:Defend Workflows “EDR Workflows” sub-team of Security Solution labels May 7, 2026
@szwarckonrad szwarckonrad self-assigned this May 7, 2026
@kibanamachine
Copy link
Copy Markdown
Contributor

Flaky Test Runner Stats

🎉 All tests passed! - kibana-flaky-test-suite-runner#12179

[✅] x-pack/solutions/security/test/security_solution_endpoint/configs/serverless.integrations.config.ts: 25/25 tests passed.

see run history

@szwarckonrad szwarckonrad force-pushed the fix-flaky-artifact-entries-add-test branch from 6498bba to ada201a Compare May 8, 2026 16:28
@szwarckonrad szwarckonrad marked this pull request as ready for review May 8, 2026 16:28
@szwarckonrad szwarckonrad requested a review from a team as a code owner May 8, 2026 16:28
@szwarckonrad szwarckonrad requested review from paul-tavares and pzl May 8, 2026 16:28
@infra-vault-gh-plugin-prod
Copy link
Copy Markdown

Pinging @elastic/security-defend-workflows (Team:Defend Workflows)

@pzl pzl requested review from tomsonpl and removed request for pzl May 11, 2026 12:54
szwarckonrad added a commit that referenced this pull request May 11, 2026
…sure (#268492)

The `should display the endpoint custom content` and `should show the
Trusted Apps page when link is clicked` tests in `fleet_integrations.ts`
intermittently fail on ESS and Serverless with a Selenium
`ScriptTimeoutError` when Kibana is under Fleet/ES startup contention
(registry `ECONNRESET`, `missing_references` saved-object imports, ES
`NoLivingConnectionsError`). Mirrors the pattern from #268313: wraps the
post-click element-render and post-navigation assertions in
`retry.waitForWithTimeout` / `retry.tryForTime` so each retry attempt
gets a fresh WebDriver script-timeout window.

Closes #250405
Closes #250417
Closes #265974
Closes #260847
@szwarckonrad szwarckonrad enabled auto-merge (squash) May 11, 2026 17:32
@kibanamachine
Copy link
Copy Markdown
Contributor

💛 Build succeeded, but was flaky

Failed CI Steps

Test Failures

  • [job] [logs] FTR Configs #35 / Cloud Security Posture POST /internal/cloud_security_posture/graph Happy flows Pinning should treat empty pinnedIds the same as missing pinnedIds

Metrics [docs]

✅ unchanged

History

cc @szwarckonrad

@szwarckonrad szwarckonrad merged commit 9248e30 into elastic:main May 11, 2026
31 checks passed
clintandrewhall pushed a commit that referenced this pull request May 12, 2026
…sure (#268492)

The `should display the endpoint custom content` and `should show the
Trusted Apps page when link is clicked` tests in `fleet_integrations.ts`
intermittently fail on ESS and Serverless with a Selenium
`ScriptTimeoutError` when Kibana is under Fleet/ES startup contention
(registry `ECONNRESET`, `missing_references` saved-object imports, ES
`NoLivingConnectionsError`). Mirrors the pattern from #268313: wraps the
post-click element-render and post-navigation assertions in
`retry.waitForWithTimeout` / `retry.tryForTime` so each retry attempt
gets a fresh WebDriver script-timeout window.

Closes #250405
Closes #250417
Closes #265974
Closes #260847
clintandrewhall pushed a commit that referenced this pull request May 12, 2026
…re (#268313)

The `should be able to add a new ${testData.title} entry` parametrized
test in `artifact_entries_list.ts` intermittently fails on Serverless
with a `TimeoutError` waiting for the new artifact's
`criteriaConditions` card to render within the default 10s implicit
wait. Mirrors the sibling update-flow pattern: wraps the post-create
assertion in `retry.waitForWithTimeout(20000, …)` keyed on the
`criteriaConditions` card before running the existing `checkResults`
loop.

Closes #265265
patrykkopycinski pushed a commit to patrykkopycinski/kibana that referenced this pull request May 13, 2026
…sure (elastic#268492)

The `should display the endpoint custom content` and `should show the
Trusted Apps page when link is clicked` tests in `fleet_integrations.ts`
intermittently fail on ESS and Serverless with a Selenium
`ScriptTimeoutError` when Kibana is under Fleet/ES startup contention
(registry `ECONNRESET`, `missing_references` saved-object imports, ES
`NoLivingConnectionsError`). Mirrors the pattern from elastic#268313: wraps the
post-click element-render and post-navigation assertions in
`retry.waitForWithTimeout` / `retry.tryForTime` so each retry attempt
gets a fresh WebDriver script-timeout window.

Closes elastic#250405
Closes elastic#250417
Closes elastic#265974
Closes elastic#260847
patrykkopycinski pushed a commit to patrykkopycinski/kibana that referenced this pull request May 13, 2026
…re (elastic#268313)

The `should be able to add a new ${testData.title} entry` parametrized
test in `artifact_entries_list.ts` intermittently fails on Serverless
with a `TimeoutError` waiting for the new artifact's
`criteriaConditions` card to render within the default 10s implicit
wait. Mirrors the sibling update-flow pattern: wraps the post-create
assertion in `retry.waitForWithTimeout(20000, …)` keyed on the
`criteriaConditions` card before running the existing `checkResults`
loop.

Closes elastic#265265
jcger pushed a commit that referenced this pull request May 26, 2026
…sure (#268492)

The `should display the endpoint custom content` and `should show the
Trusted Apps page when link is clicked` tests in `fleet_integrations.ts`
intermittently fail on ESS and Serverless with a Selenium
`ScriptTimeoutError` when Kibana is under Fleet/ES startup contention
(registry `ECONNRESET`, `missing_references` saved-object imports, ES
`NoLivingConnectionsError`). Mirrors the pattern from #268313: wraps the
post-click element-render and post-navigation assertions in
`retry.waitForWithTimeout` / `retry.tryForTime` so each retry attempt
gets a fresh WebDriver script-timeout window.

Closes #250405
Closes #250417
Closes #265974
Closes #260847
jcger pushed a commit that referenced this pull request May 26, 2026
…re (#268313)

The `should be able to add a new ${testData.title} entry` parametrized
test in `artifact_entries_list.ts` intermittently fails on Serverless
with a `TimeoutError` waiting for the new artifact's
`criteriaConditions` card to render within the default 10s implicit
wait. Mirrors the sibling update-flow pattern: wraps the post-create
assertion in `retry.waitForWithTimeout(20000, …)` keyed on the
`criteriaConditions` card before running the existing `checkResults`
loop.

Closes #265265
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport:skip This PR does not require backporting release_note:skip Skip the PR/issue when compiling release notes Team:Defend Workflows “EDR Workflows” sub-team of Security Solution v9.5.0

Projects

None yet

3 participants