[FR]: Allow for changing which models appear in dropdown for openai compatible services

[stevegbrooks]

What would you like to have?

My company's openai compatible service has a lot of models under the models/ endpoint. So, in gptstudio, this appears as a very long list, many of which won't work as a chat model (e.g., embedding, tts, stt), or other models that I'd prefer the dropdown to not list.

Ideally, I'd be able to do something like save_user_config(..., model_choices = c("claude_3_5_sonnet", "gpt-4o-mini", "gpt-4o")) but with no need to have any UI implementation for this.

Indeed, this may be helpful for the other services too.

In my case, I'm helping to set up the package for other users in my company, so I can set up this config file for them.

Of course, this is just a suggestion for how to implement. Perhaps there's an even better way to go.

Code of Conduct

• I agree to follow this project's Code of Conduct

[calderonsamuel]

You are right, this should be something that would need to be visible on the settings panel. Do you have a preference for any specific UI?

[stevegbrooks]

I would just want it to be set with save_user_config honestly.

I'm not sure about others, but I wouldn't want to crowd the GUI with more options, and this to me feels like an admin task (i.e., its something that would be set so other users aren't confused). Also, having this in the GUI would be tricky to implement in a clean way, I think.

In the docs we could say something like "If you want to override the default models dropdown for a particular service, then edit ~/.config/R/gptstudio/config.json or set the option in save_user_config(..., model_choices = c()), where a key value pair in the config.json for model_choices being like model_choices: (i.e., blank/missing) means whatever is given by models.R

[calderonsamuel]

Please @stevegbrooks try #252 and let me know if that functionality works for your use case

[stevegbrooks]

Seems to work well, but I can't actually use gptstudio with the most recent version of ellmer due to this: tidyverse/ellmer#431

They got rid of the turns argument in chat_openai, which breaks the gptstudio code in api_perform_request.R

Seems like we have to use set_turns() instead, or set ellmer (<=0.1.1) in DESCRIPTION.

[calderonsamuel]

I'm addressing that issue in another PR. For now, installing #252 and then using remotes::install_version("ellmer", version = "0.1.1") might do the trick

[stevegbrooks]

Yep, thank you!

Looks good then. Thank you for the implementation! :)