Skip to content

Latest commit

 

History

History
68 lines (43 loc) · 6.3 KB

File metadata and controls

68 lines (43 loc) · 6.3 KB

Integrations Overview

Hugging Face Inference Providers works with a growing ecosystem of developer tools, frameworks, and platforms. These integrations let you use state-of-the-art models in your existing workflows and development environments.

If a tool doesn't have explicit support for Inference Providers, it is often still compatible via its OpenAI-compatible API support. Check the documentation for your tool to see if it can be configured to use custom endpoints.

Why Use Integrations?

  • Keep your existing tools: Use Inference Providers with tools you already know
  • Access dozens of providers: Switch between providers without changing your code
  • Zero markup pricing: Get the same rates as going direct to providers
  • Single API token: One HF token for all providers and models

Overview

This table lists some tools, libraries, and applications that work with Hugging Face Inference Providers. For detailed setup instructions, follow the links in the Documentation column.

Integration Description Resources
Continue AI code assistant for VS Code and JetBrains Official docs
Haystack Open-source LLM framework for building production applications Official docs
Inspect AI safety and evaluation framework Official docs
LangChain LLM application framework Official docs
LiteLLM Unified interface for 100+ LLMs Official docs
LlamaIndex Data framework for LLM applications Official docs
MacWhisper Speech-to-text application for macOS HF docs
OpenCode AI coding agent built for the terminal Official docs / HF docs
Roo Code AI-powered code generation and refactoring Official docs

Integrations by Category

API Clients

Client libraries and gateways for simplified LLM access.

Applications

End-user applications and interfaces powered by LLMs.

Developer Tools

AI-powered coding assistants and development environments.

Evaluation Frameworks

Tools for assessing and ensuring AI safety and performance.

LLM Frameworks

LLM application frameworks and orchestration platforms.