KoboldCPP with Claude CLI

[oromis995]

I'm looking to use KoboldCPP as a back-end for claude CLI, not the MCP usage. I already use KoboldCPP, so I don't want to also install Ollama or some other back-end. Has anyone done this successfully?

[LostRuins]

It should be possible. You can specify a custom endpoint from Claude CLI settings.

Open or create your global Claude settings file in a text editor:
macOS / Linux: ~/.claude/settings.json
Windows: C:\Users\your_name.claude\settings.json

Add an "env" object to set the ANTHROPIC_BASE_URL and ANTHROPIC_AUTH_TOKEN parameter

{
  "env": {
    "ANTHROPIC_BASE_URL": "http://localhost:5001",
    "ANTHROPIC_AUTH_TOKEN": "test"
  }
}

you can probably find a lot of references online on how to setup claude settings