Skip to content

🚀 Feature Extract and process images from source uploads #1451

Open
@fadingNA

Description

@fadingNA

🔖 Feature description

@dartpain Basically allow our AI's to eat images. good place to start is just open ai llms, even docsgpt free service should work

🎤 Why is this feature needed ?

Accept image and encoded base64

  • Maybe user wants to send a message with an image when chatting with AI

✌️ How do you aim to achieve this?

  • When a source has an image, for example there is a link (publicly accessible) in markdown file that was ingested, we can pass it to llm inside classic rag retriever when its generating an answer.

🔄️ Additional Information

No response

👀 Have you spent some time to check if this feature request has been raised before?

  • I checked and didn't find similar issue

Are you willing to submit PR?

Yes I am willing to submit a PR!

Metadata

Metadata

Assignees

Labels

applicationApplicationbackendenhancementNew feature or requesthelp wantedExtra attention is neededpythonPull requests that update Python code

Type

No type

Projects

Status

Parking

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions