Skip to content

Server Error (500) when trying to add a new model in self-hosted mode #1251

@raphaelventura

Description

@raphaelventura

Server

  • Cloud (https://app.khoj.dev)
  • Self-Hosted Docker
  • Self-Hosted Python package
  • Self-Hosted source code

Clients

  • Web browser
  • Desktop/mobile app
  • Obsidian
  • Emacs
  • WhatsApp

OS

  • Windows
  • macOS
  • Linux
  • Android
  • iOS

Khoj version

1.42.10

Describe the bug

I have added llama.cpp and Ollama as AI models APIs.

Whenever I try to add a new model that is of either type, I'm getting a HTTP 500 error.

Current Behavior

The associated python trace is attached.

khoj.log

Expected Behavior

Being able to add a model through the web interface without getting this error

Reproduction Steps

  • install khoj through pip as stated in the docs. I'm using uv and chose the vulkan GPU interface: CMAKE_ARGS="-DGGML_VULKAN=on" FORCE_CMAKE=1 uv pip install 'khoj[local]'
  • launch khoj with USE_EMBEDDED_DB="true" khoj --anonymous-mode
  • try to add a model through the web interface

Possible Workaround

No response

Additional Information

No response

Link to Discord or Github discussion

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    fixFix something that isn't working as expected

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions