OpenAI Deepseek API image creation and analysis not working

[Lawkss]

Which version of integration_openai are you using?

3.7.1

Which version of Nextcloud are you using?

32.0.1

Which browser are you using? In case you are using the phone App, specify the Android or iOS version and device please.

Edge

Describe the Bug

AI Chat answers by deepseek work fine in NC Assitant but when asking the AI to analyze an image or create an image, or create Audio these are the error messages:

OpenAI/LocalAI's image question generation failed with: API request error: Failed to deserialize the JSON body into the target type: messages[1]: unknown variant image_url, expected text at line 1 column 62797

OpenAI/LocalAI's text to image generation failed with: API request error: Client error: POST https://api.deepseek.com/v1/audio/speech resulted in a 404 Not Found response: { "error_msg": "Not Found. Please check the configuration." }

OpenAI/LocalAI's text to image generation failed with: API request error: Client error: POST https://api.deepseek.com/v1/images/generations resulted in a 404 Not Found response: { "error_msg": "Not Found. Please check the configuration." }

Expected Behavior

analzye/create/image and audio

To Reproduce

Use NC AI Assistant with OpenAI integration and deepseek URL for API and API Key.

[oleksandr-nc]

Thank you for the message. Would you happen to be willing to submit a PR to fix the error?

[kyteinsky]

not sure which model @Lawkss is using but deepseek's R1 or V3* models don't support image input.
and their api does not implement /audio/speech or /images/generations so it's not possible to use those task types with deepseek.
Maybe you can try "Work with images -> Analyse images", it may work but for the audio part, it's not possible right now.