Skip to content

[Bug]: ODF 4.21 UI Deployment - AI LOCATOR FALLBACK ACTIVATED #14908

@dahorak

Description

@dahorak

Description

UI ODF 4.21 on IBM Cloud IPI deployment fall-back to AI based locator activate.

Steps to Reproduce

  1. Trigger job: https://url.corp.redhat.com/55a494e

Actual Behavior

During ODF Deployment, following log messages are shown:

2026-04-14 19:06:00  13:05:58 - MainThread - ocs_ci.ocs.ui.base_ui - INFO  - Copy DOM file: /home/jenkins/current-cluster-dir/logs/ui_logs_dir_1776186165900/dom/test_deployment/2026-04-14T13-05-58.804689_DeploymentUI-2026-04-14T13-05-21.248648_DOM.html
2026-04-14 19:06:00  13:05:59 - MainThread - ocs_ci.ocs.ui.base_ui - ERROR  - Message: 
2026-04-14 19:06:00  Stacktrace:
2026-04-14 19:06:00  #0 0x5589ac58271a <unknown>
2026-04-14 19:06:00  #1 0x5589ac0250a0 <unknown>
2026-04-14 19:06:00  #2 0x5589ac0769b0 <unknown>
2026-04-14 19:06:00  #3 0x5589ac076ba1 <unknown>
2026-04-14 19:06:00  #4 0x5589ac0c4ea4 <unknown>
2026-04-14 19:06:00  #5 0x5589ac09c3cd <unknown>
2026-04-14 19:06:00  #6 0x5589ac0c22a0 <unknown>
2026-04-14 19:06:00  #7 0x5589ac09c173 <unknown>
2026-04-14 19:06:00  #8 0x5589ac068d4b <unknown>
2026-04-14 19:06:00  #9 0x5589ac0699b1 <unknown>
2026-04-14 19:06:00  #10 0x5589ac5478cb <unknown>
2026-04-14 19:06:00  #11 0x5589ac54b7ca <unknown>
2026-04-14 19:06:00  #12 0x5589ac52f622 <unknown>
2026-04-14 19:06:00  #13 0x5589ac54c354 <unknown>
2026-04-14 19:06:00  #14 0x5589ac51445f <unknown>
2026-04-14 19:06:00  #15 0x5589ac5704f8 <unknown>
2026-04-14 19:06:00  #16 0x5589ac5706d6 <unknown>
2026-04-14 19:06:00  #17 0x5589ac581586 <unknown>
2026-04-14 19:06:00  #18 0x7fb17d68b2fa start_thread
2026-04-14 19:06:00  
2026-04-14 19:06:00  13:05:59 - MainThread - ocs_ci.ocs.ui.llm_tools.locator_fallback - INFO  - 
2026-04-14 19:06:00  ╔══════════════════════════════════════════════════════════════╗
2026-04-14 19:06:00  ║           AI LOCATOR FALLBACK ACTIVATED                      ║
2026-04-14 19:06:00  ╚══════════════════════════════════════════════════════════════╝
2026-04-14 19:06:00    selector=Installed Operators  by=link text  action=click
2026-04-14 19:06:00  13:05:59 - MainThread - ocs_ci.ocs.ui.llm_tools.locator_fallback - INFO  - [AI_FALLBACK] stage=1 (DOM-only) selector=Installed Operators
2026-04-14 19:06:00  13:05:59 - MainThread - ocs_ci.ocs.ui.llm_tools.llm_helper - INFO  - Querying Claude CLI (model=claude-sonnet-4-5, tools=none)
2026-04-14 19:06:28  13:06:23 - MainThread - ocs_ci.ocs.ui.llm_tools.llm_helper - INFO  - Claude CLI completed: model=claude-sonnet-4-5, cost=$0.0972, turns=1, duration=24.4s, cumulative_cost=$0.0972
2026-04-14 19:06:28  13:06:24 - MainThread - ocs_ci.ocs.ui.llm_tools.locator_fallback - INFO  - [AI_FALLBACK] stage=1 success new_selector=//a[@href='/k8s/all-namespaces/operators.coreos.com~v1alpha1~ClusterServiceVersion'] new_by=xpath
2026-04-14 19:06:28  13:06:24 - MainThread - ocs_ci.ocs.ui.llm_tools.locator_fallback - INFO  - [AI_FALLBACK] cached result path=/home/jenkins/current-cluster-dir/logs/ui_logs_dir_1776186165900/ai_locator_cache_test_deployment.json
2026-04-14 19:06:28  13:06:24 - MainThread - ocs_ci.ocs.ui.llm_tools.locator_fallback - INFO  - [AI_FALLBACK] cost attempt=$0.0972/1_req  cumulative=$0.0972/1_req  session=$0.0972/1_req
2026-04-14 19:06:54  13:06:54 - MainThread - ocs_ci.ocs.ui.deployment_ui - ERROR  - Refresh pop-up does not exist: Message: 

Expected Behavior

The deployment should be smooth without AI locator fallback

Impact (likelihood of reproduction, impact on the cluster and on other tests, etc.)

Saw it first time, but quick search in the previous job shows that some AI Locator fallback were also activated there.

Screenshots (if applicable)

https://url.corp.redhat.com/7b3bd5f

Environment

  • Test Suite(s): ODF Deployment
  • Platform(s): IBM Cloud IPI (lowerreq)
  • Version(s): ODF 4.21

Additional Context

Logs: https://url.corp.redhat.com/f53d789

Metadata

Metadata

Assignees

No one assigned

    Labels

    Squad/BlackCovers UI specific test cases such as ODF Dashboard etc.bugSomething isn't workingui_automation

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions