feat(sam): add sam support

[Aisuko]

Description

This PR fixes #915

Notes for Reviewers

Please kindly check the this page to get more detail of SAM. It is a demo for our SAM support plan.

• The version of dependencies
• The repo we are going to use to implement it
• The result of showing masks in picture mode

Further request

I do not know how to debug(one-step-by-one-step), please show me any useful information to help me test it.

Signed commits

• Yes, I signed my commits.

[Aisuko]

The CI issues are related to below

LocalAI/Dockerfile

Line 88 in 8123f00

COPY extra/requirements.txt /build/extra/requirements.txt

I think it should be removed since we have been created separate env for every single extra backend. We do not need a requirements.txt

[mudler]

The CI issues are related to below

LocalAI/Dockerfile

Line 88 in 8123f00

COPY extra/requirements.txt /build/extra/requirements.txt

I think it should be removed since we have been created separate env for every single extra backend. We do not need a requirements.txt

yup correct. consider for SAM we might need an additional endpoint in the API - maybe we can look around other closed API services to mimic their API?

[Aisuko]

Hi @mudler, Do you mean the new API like?

LocalAI/api/api.go

Line 209 in 4e16bc2

app.Post("/v1/images/generations", auth, openai.ImageEndpoint(cl, options))