Skip to content

Align the retagged generate-schema Flow eval before preview-catalog use #2755

Description

@tmatup

Context

tests/tasks/uipath-maestro-flow/connector_features/generate_schema.yaml is tagged uipath-platform, so the 112-task Maestro Flow same-ground campaign correctly excludes it. The task should stay untouched in that campaign.

The 2026-08-20 preview-catalog run nevertheless shows two known alignment problems that its owner should resolve before using it in a cross-skill comparison:

  1. Its artifact check requires **/GenerateSchemaTest*.flow, so it cannot discover the preview Flow SDK's valid root-level emit-only layout.
  2. Two gating criteria require live-v1 CLI commands (uip is resources describe and uip maestro flow validate) instead of the persisted GenerateSchema outcome.

Evidence: runs/adhoc-flow-v2-preview-20260820/default/skill-flow-ipe-generate-schema/00/task.json recorded score 0.0, no discovered Flow, and neither command-telemetry gate.

Requested follow-up

Apply the same neutral measurement recipe used by the Maestro Flow expansion:

  • discover both solution-wrapped and root-level Flow artifacts;
  • grade the persisted Jira GenerateSchema structure and validation outcome;
  • keep loop-specific command telemetry report-only when no durable equivalent exists;
  • preserve criterion intent and weights.

This issue is an owner note only. The current Maestro Flow campaign does not edit or retag the task.

🤖 Generated with Claude Code
Co-Authored-By: Claude

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions