Description
If the OpenAI responses API option is switched on, images are no longer being processed by the agent. Other file types appear to be unaffected.
Using Agent Plug-in V1.14.1 with an on-prem installation of Mattermost V10.11.11.
- Switch on Use Responses API in the Agent Plugin
- Ensure Enable Vision option is switched on in the AI Bot configuration
- Send the agent an image file; the agent will respond as if a file has not been sent.
Switching off the Use Responses API resolves the issue; but of course we then don't get to use the Responses API.
Some research seems to indicate that there is an API syntax change when submitting an image to the Responses model; unsure if that is the cause as it is a bit beyond my knowledge.
Description
If the OpenAI responses API option is switched on, images are no longer being processed by the agent. Other file types appear to be unaffected.
Using Agent Plug-in V1.14.1 with an on-prem installation of Mattermost V10.11.11.
Switching off the Use Responses API resolves the issue; but of course we then don't get to use the Responses API.
Some research seems to indicate that there is an API syntax change when submitting an image to the Responses model; unsure if that is the cause as it is a bit beyond my knowledge.