🧰 AI Tools: Big Next Step for Alpaca

[Jeffser]

Hi everyone, I just wanted to show what I've been working on

Example

That's an AI that requested to use the tool Get Recipe by Name, that looks for a recipe using a free API, then it used the response to generate a message!

Tool Manager

So yeah there's a third manager now lol.

For now there's not a lot to do in each tools's preferences page, but in the future that might contain stuff like API keys.

How to Activate Tools

Well first you gotta turn them on in the tool manager, then open the context menu for the send message button, you can either right click or long left click it.

Limitations

The message generated is not streamed, basically the words won't start appearing as they are generated, instead Ollama will generate the whole message and THEN it will show it, that's an Ollama problem, can't do much about it.

[mags0ft]

This is some crazy cool stuff! Looking super promising.

[olumolu]

brave search is a better alternative https://pypi.org/project/brave-search/

[mags0ft]

Nope, unfortunately not - you need an API key for that, which (even in the free trial variant) requires you to enter your credit card info.

[olumolu]

Ohh

[matalab]

What about searxng?

[mags0ft]

Hard to find an instance and unfortunately low quality results. I have tried it with Open WebUI and believe me, it isn't a pleasure to use.

I can already see Jeffry implementing a Search Engine Manager!

[Jeffser]

Btw this will be shipping in the next version but hidden, you will need to set the env variable ALPACA_ACTION_TESTING to 1.

sudo flatpak override --env=ALPACA_ACTION_TESTING=1 com.jeffser.Alpaca

Then to access the tool manager you just have to press ctrl+t

(It's called action here because that was the old name for it)