Skip to content

feat(workflows): enable "best" confidence for semantic segmentation#2425

Open
leeclemnet wants to merge 3 commits into
mainfrom
feat/semantic-seg-best-confidence
Open

feat(workflows): enable "best" confidence for semantic segmentation#2425
leeclemnet wants to merge 3 commits into
mainfrom
feat/semantic-seg-best-confidence

Conversation

@leeclemnet

@leeclemnet leeclemnet commented Jun 9, 2026

Copy link
Copy Markdown
Contributor

What does this PR do?

Allow "best" confidence for semantic segmentation inference now that model-eval supports it (https://github.com/roboflow/model_eval/pull/161), and make it the new default for the semantic seg model workflow block, matching other supported model blocks.

Related Issue(s): n/a

Type of Change

  • New feature (non-breaking change that adds functionality)

Testing

  • I have tested this change locally
  • I have added/updated tests for this change

Test details:

  • Updated unit tests
  • Tested workflow in staging with local inference server
image image

Checklist

  • My code follows the style guidelines of this project
  • I have performed a self-review of my own code
  • I have commented my code where necessary, particularly in hard-to-understand areas
  • My changes generate no new warnings or errors
  • I have updated the documentation accordingly (if applicable)

Additional Context

@leeclemnet leeclemnet changed the title feat(workflows): add "best" confidence to semantic segmentation block feat(workflows): enable "best" confidence for semantic segmentation block Jun 9, 2026
@leeclemnet leeclemnet changed the title feat(workflows): enable "best" confidence for semantic segmentation block feat(workflows): enable "best" confidence for semantic segmentation Jun 9, 2026
leeclemnet and others added 2 commits June 9, 2026 13:20
Mirror the object-detection v3 / instance-segmentation v4 pattern so the
semantic segmentation model block (@v2) exposes the "best" confidence mode,
which uses F1-optimal thresholds from model evaluation. "best" becomes the
default, matching the sibling blocks.

The mode was previously gated by a deliberate validator on
SemanticSegmentationInferenceRequest because model eval did not yet produce
per-class thresholds for this task; that gate is now removed.

Note: this flips the default confidence_mode from "default" to "best" for
existing v2 workflows that did not set the field explicitly.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
…ation

The semantic-segmentation request entity no longer rejects "best", so move it
from the rejects list into the accepted-confidence-modes set. keypoint-detection
remains gated (model eval still produces no thresholds for it).

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
@leeclemnet leeclemnet force-pushed the feat/semantic-seg-best-confidence branch from 2972289 to 18006b5 Compare June 9, 2026 15:51
@leeclemnet leeclemnet marked this pull request as ready for review June 9, 2026 17:27
No sibling model block asserts the default confidence_mode value, so remove
that assertion for consistency. The accepts-"best" test and the existing
minimalistic-config test still cover the relevant behavior.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
@leeclemnet leeclemnet enabled auto-merge (squash) June 9, 2026 17:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant