Skip to content

Latest commit

 

History

History
16 lines (13 loc) · 378 Bytes

File metadata and controls

16 lines (13 loc) · 378 Bytes

local-llm-gateway

TypeScript gateway for routing chat requests across local and remote LLM providers with fallback rules.

Features

  • Provider routing by model family.
  • Automatic fallback for unhealthy providers.
  • Structured health checks and route metadata.
  • Unit tests for routing and fallback behavior.

Development

npm install
npm test
npm run build