🚅 LiteLLM

Call 100+ LLMs in OpenAI format. [Bedrock, Azure, OpenAI, VertexAI, Anthropic, Groq, etc.]

LiteLLM Proxy Server (AI Gateway) | Hosted Proxy | Enterprise Tier

LiteLLM — NixOS Tooling

⚠️ This repository is a fork of: https://github.com/BerriAI/litellm

The purpose of this fork is not to replace the upstream project.

Instead it provides:

• NixOS container packaging • reproducible container builds • Nix flake integration • optional compose/k3s deployment

---

Upstream Project

LiteLLM is an OpenAI-compatible LLM gateway supporting 100+ providers.

Full documentation: https://github.com/BerriAI/litellm

---

What This Fork Adds

This fork adds infrastructure for running LiteLLM in a reproducible NixOS container environment.

---

Why This Exists

NixOS users often prefer declarative infrastructure and reproducible builds. This fork provides a clean way to run LiteLLM within that ecosystem.

---

Sync with Upstream

This repository tracks upstream LiteLLM and periodically merges updates.