anthropic-proxy-rs

High-performance Rust proxy that translates Anthropic API requests to OpenAI-compatible format. Use Claude Code, Claude Desktop, or any Anthropic API client with OpenRouter, native OpenAI, or any OpenAI-compatible endpoint.

Features

• Fast & Lightweight: Written in Rust with async I/O (~3MB binary)
• Full Streaming: Server-Sent Events (SSE) with real-time responses
• Tool Calling: Complete support for function/tool calling
• Universal: Works with any OpenAI-compatible API (OpenRouter, OpenAI, Azure, local LLMs)
• Extended Thinking: Supports Claude's reasoning mode
• Drop-in Replacement: Compatible with official Anthropic SDKs

Quick Start

Note: Using Task is currently recommended. Install with brew install go-task (macOS) or see the installation guide. Releases with build binaries will be made soon.

# Install Rust (if needed)
curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | sh

Build and install to PATH with task

task local-install

Run from anywhere

UPSTREAM_BASE_URL=https://openrouter.ai/api \
UPSTREAM_API_KEY=sk-or-... \
anthropic-proxy

Or build and run manually

cargo build --release
UPSTREAM_BASE_URL=https://api.openai.com \
UPSTREAM_API_KEY=sk-... \
./target/release/anthropic-proxy

Configuration

Command Line Options

anthropic-proxy --help

Commands:

Command	Description
stop	Stop running daemon
status	Check daemon status

Options:

Option	Short	Description
--config <FILE>	-c	Path to custom .env file
--debug	-d	Enable debug logging
--verbose	-v	Enable verbose logging (logs full request/response bodies)
--port <PORT>	-p	Port to listen on (overrides PORT env var)
--daemon		Run as background daemon
--pid-file <FILE>		PID file path (default: /tmp/anthropic-proxy.pid)
--help	-h	Print help information
--version	-V	Print version

Environment Variables

Configuration can be set via environment variables or .env file:

Variable	Required	Default	Description
UPSTREAM_BASE_URL	Yes	-	OpenAI-compatible endpoint URL
UPSTREAM_API_KEY	No*	-	API key for upstream service
PORT	No	3000	Server port
REASONING_MODEL	No	(uses request model)	Model to use when extended thinking is enabled**
COMPLETION_MODEL	No	(uses request model)	Model to use for standard requests (no thinking)**
DEBUG	No	false	Enable debug logging (1 or true)
VERBOSE	No	false	Enable verbose logging (1 or true)

* Required if your upstream endpoint needs authentication
** The proxy automatically detects when a request has extended thinking enabled (via the thinking parameter in the request) and routes it to REASONING_MODEL. Standard requests without thinking use COMPLETION_MODEL. This allows you to use more powerful models for reasoning tasks and faster/cheaper models for simple completions. If not set, the model from the client request is used.

Configuration File Locations

The proxy searches for .env files in the following order:

1. Custom path specified with --config flag
2. Current working directory (./.env)
3. User home directory (~/.anthropic-proxy.env)
4. System-wide config (/etc/anthropic-proxy/.env)

If no .env file is found, the proxy uses environment variables from your shell.

Usage Examples

With Claude Code

# Start proxy as daemon and use Claude Code immediately
anthropic-proxy --daemon && ANTHROPIC_BASE_URL=http://localhost:3000 claude

# Or use separate terminals:
# Terminal 1: Start proxy
anthropic-proxy

# Terminal 2: Use Claude Code
ANTHROPIC_BASE_URL=http://localhost:3000 claude

With Debug Logging

# Enable debug logging via CLI flag
anthropic-proxy --debug

# Or via environment variable
DEBUG=true anthropic-proxy

# Enable verbose logging (logs full request/response bodies)
anthropic-proxy --verbose

With Custom Config File

# Use a custom .env file
anthropic-proxy --config /path/to/my-config.env

# Or place it in your home directory
cp .env ~/.anthropic-proxy.env
anthropic-proxy

With Custom Model Overrides

# Use different models for reasoning vs standard completion
# Reasoning model is used when extended thinking is enabled in the request
# Completion model is used for standard requests without thinking
UPSTREAM_BASE_URL=https://openrouter.ai/api \
  UPSTREAM_API_KEY=sk-or-... \
  REASONING_MODEL=anthropic/claude-3.5-sonnet \
  COMPLETION_MODEL=anthropic/claude-3-haiku \
  PORT=8080 \
  anthropic-proxy

# This allows cost optimization: use powerful models for complex reasoning,
# and faster/cheaper models for simple completions

Running as Daemon

# Start as background daemon
anthropic-proxy --daemon

# Check daemon status
anthropic-proxy status

# Stop daemon
anthropic-proxy stop

# View daemon logs
tail -f /tmp/anthropic-proxy.log

# Custom PID file location
anthropic-proxy --daemon --pid-file ~/.anthropic-proxy.pid
anthropic-proxy stop --pid-file ~/.anthropic-proxy.pid

Note: When running as daemon, logs are written to /tmp/anthropic-proxy.log

Supported Features

✅ Text messages
✅ System prompts (single and multiple)
✅ Image content (base64)
✅ Tool/function calling
✅ Tool results
✅ Streaming responses
✅ Extended thinking mode (automatic model routing)
✅ Temperature, top_p, top_k
✅ Stop sequences
✅ Max tokens

Note: Make sure your upstream model supports tool use. Especially if you are using this proxy for coding agents like Claude Code.

Extended Thinking Mode

The proxy automatically detects when a request includes the thinking parameter (Claude Codes's for example) and routes it to the model specified in REASONING_MODEL. Requests without thinking use COMPLETION_MODEL.

If model override variables are not set, the proxy uses the model specified in the client request.

Known Limitations

The following Anthropic API features are not supported currently (Claude Code and similar tools working without these parameters):):

• tool_choice parameter (always uses auto)
• service_tier parameter
• metadata parameter
• context_management parameter
• container parameter
• Citations in responses
• pause_turn and refusal stop reasons
• Message Batches API
• Files API
• Admin API

Troubleshooting & Known Pitfalls

Error: UPSTREAM_BASE_URL is required
→ You must set the upstream endpoint URL. Examples:

• OpenRouter: https://openrouter.ai/api
• OpenAI: https://api.openai.com
• Local: http://localhost:11434

Error: 405 Method Not Allowed
→ Your UPSTREAM_BASE_URL likely ends with /v1. Remove it!

• ❌ Wrong: https://openrouter.ai/api/v1
• ✅ Correct: https://openrouter.ai/api
• The proxy automatically adds /v1/chat/completions

Model not found errors
→ Set REASONING_MODEL and COMPLETION_MODEL to override the models from client requests

License

MIT License - Copyright (c) 2025 m0n0x41d (Ivan Zakutnii)

See LICENSE for details.

Contributing

Contributions welcome! Please:

1. Fork the repository
2. Create a feature branch
3. Make your changes
4. Run cargo test && cargo clippy
5. Submit a pull request

Links

• Anthropic API Documentation
• OpenRouter Documentation
• Rust Documentation