Skip to content

Latest commit

 

History

History
68 lines (43 loc) · 6.07 KB

File metadata and controls

68 lines (43 loc) · 6.07 KB

Integrations Overview

Hugging Face Inference Providers works with a growing ecosystem of developer tools, frameworks, and platforms. These integrations let you use state-of-the-art models in your existing workflows and development environments.

If a tool doesn't have explicit support for Inference Providers, it is often still compatible via its OpenAI-compatible API support. Check the documentation for your tool to see if it can be configured to use custom endpoints.

Why Use Integrations?

  • Keep your existing tools: Use Inference Providers with tools you already know
  • Access dozens of providers: Switch between providers without changing your code
  • Zero markup pricing: Get the same rates as going direct to providers
  • Single API token: One HF token for all providers and models

Overview

This table lists some tools, libraries, and applications that work with Hugging Face Inference Providers. For detailed setup instructions, follow the links in the Documentation column.

Integration Description Documentation
Continue AI code assistant for VS Code and JetBrains Integration docs
Haystack Open-source LLM framework for building production applications Integration docs
Inspect AI safety and evaluation framework Integration docs
LangChain LLM application framework Integration docs
LiteLLM Unified interface for 100+ LLMs Integration docs
LlamaIndex Data framework for LLM applications Integration docs
MacWhisper Speech-to-text application for macOS Guide
OpenCode AI coding agent built for the terminal Integration docs / HF Guide
Roo Code AI-powered code generation and refactoring Integration docs

Integrations by Category

API Clients

Client libraries and gateways for simplified LLM access.

  • LiteLLM - Unified interface for calling 100+ LLMs with the same format

Applications

End-user applications and interfaces powered by LLMs.

Developer Tools

AI-powered coding assistants and development environments.

  • Continue - AI code assistant for VS Code, JetBrains and the terminal.
  • OpenCode - AI coding agent built for the terminal.
  • Roo Code - AI-powered code generation and refactoring.

Evaluation Frameworks

Tools for assessing and ensuring AI safety and performance.

  • Inspect - AI safety and evaluation framework.

LLM Frameworks

LLM application frameworks and orchestration platforms.

  • Haystack - Open-source framework for building production-ready LLM applications
  • LangChain - Popular framework for developing LLM applications
  • LlamaIndex - Data framework for connecting custom data to LLMs