𝕏 Follow me on X • 🤗 Hugging Face • 💻 Docs
Novita AI is an AI cloud platform that helps developers easily deploy AI models through a simple API, backed by affordable and reliable GPU cloud infrastructure.
Integrate the Novita API into popular software and platforms. Access Novita to get an API key.
| Repo | Description | Guide |
|---|---|---|
 |
Hugging Face is a library that provides pre-trained language models for NLP tasks. Novita is one of the inference providers of Hugging Face. | Novita AI & Hugging Face Integration Guide |
 |
LangChain is a framework for developing applications powered by large language models (LLMs). | Novita AI & LangChain Integration Guide |
 |
LobeChat is an open-source, modern-design AI chat framework. | Novita AI & LobeChat Integration Guide |
 |
Dify is an open-source LLM app development platform. | Novita AI & Dify Integration Guide |
 |
Langflow is a low-code app builder for RAG and multi-agent AI applications. | Novita AI & Langflow Integration Guide |
 |
AnythingLLM is an all-in-one Desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, and more. | Novita AI & AnythingLLM Integration Guide |
 |
LlamaIndex is the leading framework for building LLM-powered agents over your data. | Novita AI & LlamaIndex Integration Guide |
 |
Continue is the leading open-source AI code assistant. | Novita AI & Continue Integration Guide |
 |
Skyvern can automate browser-based workflows with LLMs and Computer Vision. | Novita AI & Skyvern Integration Guide |
 |
Langfuse is an open source LLM engineering platform. | Novita AI & Langfuse Integration Guide |
 |
The AI Gateway is designed for fast, reliable & secure routing to 1600+ language, vision, audio, and image models. | Novita AI & Portkey Integration Guide |
 |
Helicone is an open-source LLM observability platform. | Novita AI & Helicone Integration Guide |
Templates are Docker container images paired with a configuration. They are used to launch images as instances, define the required container disk size, volume, volume paths, and ports needed. You can also define environment variables within the template.
| Repo | Description | Template |
|---|---|---|
 |
vLLM is a high-throughput and memory-efficient inference and serving engine for LLMs. | Run DeepSeek-R1-Distill-Qwen-1.5B with vLLM on Novita |
 |
SGLang is a fast serving framework for large language models and vision language models. | Run Llama3.1-8B-Instruct with SGLang on Novita |
 |
TensorFlow is an open-source machine learning framework for everyone. | Run Tensorflow:2.7.0 on Novita |
 |
PyTorch offers tensors and dynamic neural networks in Python with strong GPU acceleration. | Run Pytorch:2.2.1 on Novita |
 |
Flux contains minimal inference code to run image generation & editing with our Flux models. | Run comfyui:flux1-fp8 with Flux on Novita AI |
 |
Stabel Diffusion offers high-resolution image synthesis with latent diffusion models. | Run StableDiffusion:v1.8.0 on Novita AI |
 |
FaceFusion is the industry-leading face manipulation platform. | Run Facefusion:v3.1.1 on Novita AI |
 |
CUDA-Samples offer samples for CUDA Developers which demonstrate features in CUDA Toolkit. | Run cuda:11.8.0 with CUDA-Samples on Novita AI |
 |
Kohya_SS is a python library designed for optimizing and fine-tuning diffusion models. | Run koyha_ss on Novita AI |
 |
Axolotl is a tool designed to streamline post-training for various AI models. | Run Axolotl on Novita AI |
 |
KoboldCpp runs GGUF models easily with a KoboldAI UI with one file and zero Install. | Run KoboldCpp on Novita AI |
Learn about how to use Novita AI in the docs.
https://opensource.org/license/MIT
- Email: [email protected]
- Discord: novita.ai
We're excited to hear from you and work together to build a better cloud ecosystem. At Novita AI, we believe in the strength of teamwork. Let's start a new journey in cloud computing together!