Switching to new models and using OpenAI's o3-mini.

[dqnk]

Is there a way to select a few (2 or 3) different models from different providers and cycle between them quickly instead of always having to switch the provider and then the model?

Additionally, when using o3-mini I get the error temperature is not a supported parameter, because OpenAI has deprecated it. Additionally top_p and max_tokens have also been deprecated with o3-mini. Is support for these models planned? I have looked at the code and implementing this change (to not include temperature, top_p and max_tokens) seems much less trivial than with original gp.nvim project.

[frankroeder]

Hi @dqnk,
Yes, you could create yourself shortcuts to directly select the provider like PrtProvider openai and the modelPrtModel o3-mini in combination, like this:
{ "<C-g>q", function() vim.cmd("PrtProvider openai") vim.cmd("PrtModel o3-mini") end}.

Yes, I am aware of the issue to always be in line with what the API providers are doing. In addition, I already provide some default values for all providers:

parrot.nvim/lua/parrot/config.lua

Line 60 in 7ddb9cf

chat = { temperature = 1.1, top_p = 1 },

Removing the defaults would be an option, I guess. However, this would change the default behavior for a lot of plugin users. Another solution would be to implement if statements when filtering the parameters for the exceptional models here:

parrot.nvim/lua/parrot/provider/openai.lua

Line 72 in 7ddb9cf

if payload.model and string.find(payload.model, "o1", 1, true) then

[dqnk]

Oh it seems that the line 72 already checks for o1. So it could also check for o3 and that would fix it I believe, those two models have the same issue with deprecated parameters.

[dqnk]

As for switching models i would prefer something that cycles some predefined models similarly to what gp.nvim has. I'll look into it later.

[frankroeder]

Oh it seems that the line 72 already checks for o1. So it could also check for o3 and that would fix it I believe, those two models have the same issue with deprecated parameters.

Yes, I already updated it, checking for o1 and o3.

As for switching models i would prefer something that cycles some predefined models similarly to what gp.nvim has. I'll look into it later.

Sure, gp.nvim uses "agents" to define the model/parameter/provider selection, a very different approach to what I do with Parrot. I believe you could implement a routine that selects from all available models and then picks the right provider and model combination afterwards.