Skip to content

[Observability] Migrate observability API integration tests to Scout#272029

Draft
shahzad31 wants to merge 1 commit into
elastic:mainfrom
shahzad31:scout/migrate-observability-api-integration
Draft

[Observability] Migrate observability API integration tests to Scout#272029
shahzad31 wants to merge 1 commit into
elastic:mainfrom
shahzad31:scout/migrate-observability-api-integration

Conversation

@shahzad31
Copy link
Copy Markdown
Contributor

Summary

Migrates the trial-license observability_api_integration FTR suite to Scout API tests, co-located with the existing UI suite under the observability plugin (test/scout/api).

Coverage migrated 1:1:

  • Annotations CRUDannotations.spec.ts
  • SLO annotation filteringfind_annotations.spec.ts
  • AI assistant alert details contextual insights — split into focused specs (alert_details_context*.spec.ts) using Synthtrace-generated APM traces and logs

This also removes the old FTR wiring:

  • Deleted x-pack/solutions/observability/test/observability_api_integration/ (config, shared helpers, SLO kbn_archiver fixture).
  • Removed the entry from .buildkite/ftr-manifests/ftr_oblt_stateful_configs.yml.
  • Updated .github/CODEOWNERS (kept the suite owned by @elastic/actionable-obs-team via a test/scout/api override) and refreshed the plugin README.

Notes

  • Trial license is the Scout stateful default (esTestCluster.license: 'trial'), so no per-test license config is needed.
  • Auth follows Scout conventions: API keys (requestAuth) for public api/* annotation routes; cookies (samlAuth.asInteractiveUser) for the internal alert-details route, including a least-privilege custom role for the 403 case.

Testing

Run against a stateful classic server:

node scripts/scout.js start-server --arch stateful --domain classic
node scripts/playwright test --config x-pack/solutions/observability/plugins/observability/test/scout/api/playwright.config.ts --project=local
  • 20/20 specs passing locally (stateful classic).
  • node scripts/type_check --project x-pack/solutions/observability/plugins/observability/tsconfig.json
  • ✅ ESLint clean.

Checklist

  • Tests migrated and passing locally
  • No release note needed (test infra only)

Made with Cursor

Migrates the trial-license observability API integration FTR suite to
Scout API tests under the observability plugin:

- annotations CRUD (`annotations.spec.ts`)
- SLO annotation filtering (`find_annotations.spec.ts`)
- AI assistant alert details contextual insights, split into focused
  specs with Synthtrace-generated APM traces and logs

Removes the old FTR config, shared helpers, SLO archiver fixture, and
the `ftr_oblt_stateful_configs.yml` manifest entry, and updates
CODEOWNERS and the plugin README to point at the Scout suite.

Co-authored-by: Cursor <cursoragent@cursor.com>
@shahzad31 shahzad31 added release_note:skip Skip the PR/issue when compiling release notes backport:skip This PR does not require backporting author:actionable-obs PRs authored by the actionable obs team v9.5.0 labels May 30, 2026
@infra-vault-gh-plugin-prod
Copy link
Copy Markdown

infra-vault-gh-plugin-prod Bot commented May 30, 2026

🤖 Jobs for this PR can be triggered through checkboxes. 🚧

ℹ️ To trigger the CI, please tick the checkbox below 👇

  • Click to trigger kibana-pull-request for this PR!
  • Click to trigger kibana-deploy-project-from-pr for this PR!
  • Click to trigger kibana-deploy-cloud-from-pr for this PR!
  • Click to trigger kibana-entity-store-performance-from-pr for this PR!
  • Click to trigger kibana-storybooks-from-pr for this PR!

@kibanamachine
Copy link
Copy Markdown
Contributor

💛 Build succeeded, but was flaky

Failed CI Steps

Metrics [docs]

Unknown metric groups

ESLint disabled line counts

id before after diff
@kbn/test-suites-xpack-observability 18 17 -1

Total ESLint disabled count

id before after diff
@kbn/test-suites-xpack-observability 20 19 -1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

author:actionable-obs PRs authored by the actionable obs team backport:skip This PR does not require backporting release_note:skip Skip the PR/issue when compiling release notes v9.5.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants