Skip to content

Connection Error when using Ollama (local) LLM for Corpus chat #2256

Description

@ichappel

I'm running a local cite instance with an Ollama server running directly in shell and not through a docker container. I've configured Cite to use the local ollama server through the interface and have uploaded some documents. I've added the documents to a corpus and I'm attempting to use suggested prompts ("How do these documents relate to one another?").

I receive a "connection error" on the following "new Chat" page. It looks like it took two steps and is failing on the "sending request to language model" step. In the console, I'm receiving the following error:

index-kIGuFrl2.js:12 An error occurred! For more details, see the full error text at https://go.apollo.dev/c/err#%...

which links to this page:
https://www.apollographql.com/docs/react/errors#%7B%22version%22%3A%223.14.0%22%2C%22message%22%3A78%2C%22args%22%3A%5B%22useLazyQuery%22%2C%22onError%22%2C%22If%20your%20%60onError%60%20callback%20sets%20local%20state%2C%20switch%20to%20use%20derived%20state%20using%20%60data%60%2C%20%60error%60%20or%20%60errors%60%20returned%20from%20the%20hook%20instead.%20Use%20%60useEffect%60%20if%20you%20need%20to%20perform%20side-effects%20as%20a%20result%20of%20updates%20to%20%60data%60%2C%20%60error%60%20or%20%60errors%60.%22%5D%7D

the error appears 3 times in a row on the console.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions