[Feature]: Support local models

[tombaker1]

Problem

I would like to use locally hosted models. I can’t find any way to do this.

Proposal

Add the /models command or use a configuration list. How do you recommend the best way to do this?

Done criteria (optional)

No response

[grinev]

@tombaker1 you can use any model which is supported by opencode. You can connect local models to opencode and use them in the bot. See https://theaiops.substack.com/p/setting-up-opencode-with-local-models

[tombaker1]

Yes, I have done that. The models appear when I run the /models command in the opencode native interface. The telegram bot doesn't list all the models available. Only a few models are listed. Am I missing a step?

I would be happy to add the feature myself. I just want to know if there is a simpler way.

[tombaker1]

It looks like the only models in the list are favorites, and recent models. From the telegram interface I have no way to select other models.

https://github.com/grinev/opencode-telegram-bot/blob/main/src/model/manager.ts#L225

[tombaker1]

By the way, I really like this program. Thank you for doing this work and making it open source.

[grinev]

I have plans to add the ability to search for models in upcoming releases. But I don't think it's a major feature. You can add model to favourites and then choose it in the bot.

[jzaleski]

This is going to be my use-case as well. I only just stumbled across this repo, happy to assist/contribute to the implementation if that would be useful @grinev

[grinev]

This is going to be my use-case as well. I only just stumbled across this repo, happy to assist/contribute to the implementation if that would be useful @grinev

Thanks, but I'm afraid this is a complicated enough feature to integrate into the current UI, I'd rather implement it myself, otherwise you'll have to make too many edits to the review.