accessing locally run AI (like ollama or LLM running through a python script with pytorch)

[viper968]

is there a way to modify specific parts of the code to allow it to interface with more than just the openai GPT-4/GPT-3.5? being able to use like ollama or an LLM from hugging face would be nice so we aren't restricted by quota limits or having to pay to increase the limit.

[66Beastmaster]

It wont start in my case