FastSAM draw bounding boxes with label and segment with label

[drakshayanidesai]

Search before asking

• I have searched the Supervision issues and found no similar feature requests.

Description

Hi Roboflow
I was trying with Fast SAM. How to label the boxes and detect them with labels after drawing boxes on
the image after executing the snippiest( as shown in the attachment).
IS_COLAB = True

if IS_COLAB:
from google.colab import outputRoboFastSAM.docx
from jupyter_bbox_widget import BBoxWidget

widget = BBoxWidget()
widget.image = encode_image(IMAGE_PATH)
widget
RoboFastSAM.docx

Use case

No response

Additional

No response

Are you willing to submit a PR?

• Yes I'd like to help by submitting a PR!

[github-actions[bot]]

Hello there, thank you for opening an Issue ! 🙏🏻 The team was notified and they will get back to you asap.

[SkalskiP]

Hi @drakshayanidesai 👋🏻! Let's start by converting this issue into thread in our QA discussion.

[SkalskiP]

@drakshayanidesai, the Colab you are using is processing only one box at a time. So it doesn't matter how many boxes you annotate, it will only pick one. You would probably need to change that part of code:

box = widget.bboxes[0] if widget.bboxes else default_box
box = [
    box['x'],
    box['y'],
    box['x'] + box['width'],
    box['y'] + box['height']
]