Skip to content

Conversation

@abetlen
Copy link
Owner

@abetlen abetlen commented Oct 2, 2024

Weights and example code: https://huggingface.co/abetlen/paligemma-3b-mix-224-gguf

  • the chat handler here only supports single image / single turn conversations, just did this to simplify testing but will change before merging
  • you must set n_ubatch to be sufficiently large to process both the image and text input embeddings together.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants