Gemini Support

[AndryHTC]

Hi guys,
great job!

I was wondering, is there a reason why Gemini is not supported?

[eric-xw]

From our observation and the official OSWorld evaluation (https://os-world.github.io), Gemini models don't do as well as Claude and GPT models on GUI agents. But it can be supported. Also feel free to send a PR for it.

[AndryHTC]

I didn't see any test with the Gemini 2.0 models. The results in OSWorld are about Gemini 1.5

[mjp0]

Gemini support would be an easy add because you can just reuse OpenAI code with custom URL which points to Gemini's OpenAI compatible API.

I mean Gemini Pro 2.5 is literally the best model in the world right now in all aspects, including coding, and it's free to try, so supporting it would be a pretty good selling point.

[eric-xw]

Yes, our evaluation confirmed Gemini 2.5 is the best model for computer use (it outperforms Claude 3.7 by a large margin). You are very encouraged to use it!