Can we use AI analysis feature with the local models ?

[Amruta-Pawar2001]

Hey, I want to use the above app with local LLMs. Could you please let me know if that is available ?

[Abhi5h3k]

At the time of development, local models were slow and large in size, so we decided to use the Gemini API to offload processing and provide faster responses.

However, if you want, you should be able to set up and integrate a local LLM yourself. When I get some time, I’ll also give it a try. It seems interesting.

[Amruta-Pawar2001]

It's really interesting but the local models needs some hardware specifications. But, if you see in the enterprise level people are trying to use local models for data security. This would be really helpful if it gets integrated with the local model. Thanks !