MCP-Server Per-User Authentication with cost tracking

[almajo]

I have the following target setup:

• OpenWebUI (400 users)
• LiteLLM Proxy
• MCP servers that work with oauth, like Microsoft 365 where the mcp server accesses the user's resources

As some of our MCP servers that we use have a cost-per-call (like Microsoft Dataverse or Copilot RAG API), we would love to track that cost in LiteLLM by adding it as a Litelllm MCP server.

However, I have not found the right settings of how authentication flows from OpenWebUI through the litellm-proxy to the target-mcp and we can still track the tool-calling-costs.

Has anybody managed to implement this in such a setting? After all it's the main use case with mcp servers, where multiple users call the same MCP server in their name.

Really happy to hear back for this. I'm currently on litellm version 1.88.1

[omni-front]

You should look into the examples/ folder of the LiteLLM repository where authentication flows and cost tracking are usually illustrated. Additionally, check the configuration details in litellm/proxy/proxy_server.py, as it might contain references to managing OAuth or similar authentication methods. If there's a need to customize further, the README or documentation may have sections on configuring MCP servers and tracking usage costs.