-
-
Notifications
You must be signed in to change notification settings - Fork 2.1k
Open
Labels
fixFix something that isn't working as expectedFix something that isn't working as expected
Description
Server
- Cloud (https://app.khoj.dev)
- Self-Hosted Docker
- Self-Hosted Python package
- Self-Hosted source code
Clients
- Web browser
- Desktop/mobile app
- Obsidian
- Emacs
OS
- Windows
- macOS
- Linux
- Android
- iOS
Khoj version
1.42.10
Describe the bug
I have added llama.cpp and Ollama as AI models APIs.
Whenever I try to add a new model that is of either type, I'm getting a HTTP 500 error.
Current Behavior
The associated python trace is attached.
Expected Behavior
Being able to add a model through the web interface without getting this error
Reproduction Steps
- install khoj through pip as stated in the docs. I'm using
uvand chose the vulkan GPU interface:CMAKE_ARGS="-DGGML_VULKAN=on" FORCE_CMAKE=1 uv pip install 'khoj[local]' - launch khoj with
USE_EMBEDDED_DB="true" khoj --anonymous-mode - try to add a model through the web interface
Possible Workaround
No response
Additional Information
No response
Link to Discord or Github discussion
No response
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
fixFix something that isn't working as expectedFix something that isn't working as expected