Skip to content

Decouple connector creation for FF tests - #1821

Merged
ohltyler merged 4 commits into
opensearch-project:mainfrom
ohltyler:ff-improvements
Aug 7, 2025
Merged

Decouple connector creation for FF tests#1821
ohltyler merged 4 commits into
opensearch-project:mainfrom
ohltyler:ff-improvements

Conversation

@ohltyler

@ohltyler ohltyler commented Aug 5, 2025

Copy link
Copy Markdown
Member

Description

Improves the Flow Framework OSD plugin tests by decoupling the connector creation step for improved flexibility & less flakiness when running the tests against different endpoints with different security standards. For example, an Amazon OpenSearch Service (AOS) domain prohibits remote connector creation, so these tests cannot run out-of-the-box against such endpoints. This fixes that, by mocking the connector creation entirely if the step fails.

Includes several other minor improvements to minimize flakiness, such as the model deployment call and scoped-down mocking checks during ingest and search.

Tested against local domain with no security, and against an AOS domain with basic auth. Both scenarios succeed without any changes to the test file:

       Spec                                              Tests  Passing  Failing  Pending  Skipped  
  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ ✔  plugins/dashboards-flow-framework/c      02:41        6        6        -        -        - │
  │    reate_workflow_spec.js                                                                      │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘
    ✔  All specs passed!                        02:41        6        6        -        -        -  

Issues Resolved

Check List

  • Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
Comment thread cypress/integration/plugins/dashboards-flow-framework/create_workflow_spec.js Outdated
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
@ohltyler
ohltyler merged commit 4efec4c into opensearch-project:main Aug 7, 2025
48 checks passed
@ohltyler
ohltyler deleted the ff-improvements branch August 7, 2025 16:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants