[Feature Request] Gemini support structured output with tool call

[Wendong-Fan]

Required prerequisites

• I have searched the Issue Tracker and Discussions that this hasn't already been reported. (+1 or comment there if it has.)
• Consider asking first in a Discussion.

Motivation

Gemini now doesn't support this feature natively, but we can implement this by letting the model do tool call first then do structured output

Solution

No response

Alternatives

No response

Additional context

No response

[JINO-ROHIT]

is the idea to basically

modify _run --> perform a tool call using _request_chat_completion --> then prompt it to gnerate structure using pydantic class or something,

is this flow correct? so thats double api calls right?

[fengju0213]

Gemini seems to support structured output

[Wendong-Fan]

is the idea to basically

modify _run --> perform a tool call using _request_chat_completion --> then prompt it to gnerate structure using pydantic class or something,

is this flow correct? so thats double api calls right?

hey @JINO-ROHIT , for the structured output we don't need to use prompt, we can use gemini's native feature to do it, it's just can't do tool call and structured output together, so we need to make it into 2 steps

cc @fengju0213

[JINO-ROHIT]

makes sense, lemme try and implement this

[lightaime]

@Wendong-Fan is this solved?