Skip to content

[FR] Text Search for grouped data #6352

@adityasaikovvali-droid

Description

@adityasaikovvali-droid

Proposal Summary

At the moment it is not possible to search through all the slices of a grouped data.
E.g. I have multiple camera view images and I cannot search through all images from all slices at once.
Multiple blockers to get this working

  1. Embeddings can only be computed on group slice view
  2. The search icon in UI is visible from the root view (server by default launches root view). But is not functional. Its only functional, when I add a stage and select the group slice.

Motivation

  • Text search for grouped dataset
  • Improved Text search and possibility to allow multiple vectors per sample in database.
  • When I search, I want to search through combined views of images
  • The current architecture for text search doesn't support it

What areas of FiftyOne does this feature affect?

  • App: FiftyOne application
  • Core: Core fiftyone Python library
  • Server: FiftyOne server

Details

Allow per sample to hold 'n' of vector embeddings (From multiple image views, models, any source). This will allow the text prompt (vector embedding) to compare with 'n' other vectors of sample.

Willingness to contribute

The FiftyOne Community welcomes contributions! Would you or another member of your organization be willing to contribute an implementation of this feature?

  • Yes. I can contribute this feature independently
  • Yes. I would be willing to contribute this feature with guidance from the FiftyOne community
  • No. I cannot contribute this feature at this time

Metadata

Metadata

Assignees

No one assigned

    Labels

    featureWork on a feature request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions