llama-server fails when MCP tool returns images. #20319
Unanswered
Sultan-papagani
asked this question in
Q&A
Replies: 1 comment 1 reply
-
|
You need to use multimodal model. It has two files: model file amd multimedia projector file. For example, at https://huggingface.co/unsloth/Qwen3.5-9B-GGUF/tree/main you can find such model. To load it you must use --mmproj command line parameter: |
Beta Was this translation helpful? Give feedback.
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I’m using llama-server with an MCP tool that generates images. When the LLM sends a message containing an image generated by the tool, I get the following error when i reply to the LLM:
image input is not supported - hint: if this is unexpected, you may need to provide the mmproj
I understand that llama-server (with a text-only model) cannot handle image inputs, but in my use case I don’t want to send MCP-generated images back to the LLM at all.
What should i do ?
Thanks!
Beta Was this translation helpful? Give feedback.
All reactions