Commit f0d72e5
committed
Warn that Gemini's OpenAI-compatible endpoint breaks tool calling
Users connecting Gemini through https://generativelanguage.googleapis.com/v1beta/openai get an empty assistant message on any turn where the model decides to call a tool, with nothing in the logs. Builtin tools such as Memory are affected, so it reads as the occasional blank reply rather than a tool failure, and the provider page previously said the endpoint "works well".
Google's layer omits the `index` field the OpenAI streaming schema carries on every tool call, and Gemini 3 attaches a `thought_signature` it then demands back on the follow-up request. Both are deviations on Google's side, so the docs now state the limitation and give the ways around it: Function Calling set to Legacy, turning the builtin tools capability off, or a gateway such as LiteLLM or OpenRouter for real native tool calling.
Reported in #28492.1 parent 2ff5dec commit f0d72e5
2 files changed
Lines changed: 17 additions & 1 deletion
File tree
- docs
- alternatives
- getting-started/quick-start/connect-a-provider
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
84 | 84 | | |
85 | 85 | | |
86 | 86 | | |
| 87 | + | |
| 88 | + | |
| 89 | + | |
| 90 | + | |
87 | 91 | | |
88 | 92 | | |
89 | 93 | | |
| |||
Lines changed: 13 additions & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
94 | 94 | | |
95 | 95 | | |
96 | 96 | | |
97 | | - | |
| 97 | + | |
98 | 98 | | |
99 | 99 | | |
100 | 100 | | |
| |||
106 | 106 | | |
107 | 107 | | |
108 | 108 | | |
| 109 | + | |
| 110 | + | |
| 111 | + | |
| 112 | + | |
| 113 | + | |
| 114 | + | |
| 115 | + | |
| 116 | + | |
| 117 | + | |
| 118 | + | |
| 119 | + | |
| 120 | + | |
109 | 121 | | |
110 | 122 | | |
111 | 123 | | |
| |||
0 commit comments