-
Notifications
You must be signed in to change notification settings - Fork 0
Expand file tree
/
Copy pathllms.txt
More file actions
90 lines (71 loc) · 5.17 KB
/
Copy pathllms.txt
File metadata and controls
90 lines (71 loc) · 5.17 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
# TokenLab
> Unified AI API Gateway - Access hundreds of AI models through a single API
TokenLab is an AI API aggregation platform providing unified access to models from OpenAI, Anthropic, Google, DeepSeek, and more.
## Quick Start
Base URL: https://api.tokenlab.sh/v1
Authentication: Bearer token (API key from dashboard)
```bash
curl https://api.tokenlab.sh/v1/chat/completions \
-H "Authorization: Bearer sk-your-api-key" \
-H "Content-Type: application/json" \
-d '{"model": "gpt-4o", "messages": [{"role": "user", "content": "Hello!"}]}'
```
## Documentation
- [Introduction](https://docs.tokenlab.sh/introduction): Overview and key features
- [Quickstart](https://docs.tokenlab.sh/quickstart): Get started in 2 minutes
- [Authentication](https://docs.tokenlab.sh/authentication): API key management
- [Management API](https://docs.tokenlab.sh/api-reference/management/introduction): Organization balance, key management, and key-level reporting
- [API Formats](https://docs.tokenlab.sh/guides/api-formats): OpenAI, Anthropic, Gemini formats
- [Streaming](https://docs.tokenlab.sh/guides/streaming): Real-time responses
- [Error Handling](https://docs.tokenlab.sh/guides/error-handling): Error codes and handling
## API Reference
- [Chat Completions](https://docs.tokenlab.sh/api-reference/chat/create-completion): POST https://api.tokenlab.sh/v1/chat/completions
- [Messages (Anthropic)](https://docs.tokenlab.sh/api-reference/messages/create-message): POST https://api.tokenlab.sh/v1/messages
- [Responses (OpenAI)](https://docs.tokenlab.sh/api-reference/responses/create-response): POST https://api.tokenlab.sh/v1/responses
- [Gemini](https://docs.tokenlab.sh/api-reference/gemini/generate-content): POST https://api.tokenlab.sh/v1beta/models/{model}:generateContent
- [Images](https://docs.tokenlab.sh/api-reference/images/create-image): POST https://api.tokenlab.sh/v1/images/generations
- [Video](https://docs.tokenlab.sh/api-reference/video/create-video): POST https://api.tokenlab.sh/v1/videos/generations
- [Audio](https://docs.tokenlab.sh/api-reference/audio/create-speech): POST https://api.tokenlab.sh/v1/audio/speech
- [Realtime](https://docs.tokenlab.sh/api-reference/realtime/connect): WS https://api.tokenlab.sh/v1/realtime?model={model} (WebSocket proxy only; no Realtime REST client secrets or Calls)
- [Translations](https://docs.tokenlab.sh/api-reference/translation/create-translation): POST https://api.tokenlab.sh/v1/translations
- [Embeddings](https://docs.tokenlab.sh/api-reference/embeddings/create-embedding): POST https://api.tokenlab.sh/v1/embeddings
- [Models](https://docs.tokenlab.sh/api-reference/models/list-models): GET https://api.tokenlab.sh/v1/models
- [Management API](https://docs.tokenlab.sh/api-reference/management/introduction): Management token authentication, organization balance, and key-level usage/billing
## Supported Capabilities
| Capability | Example Models |
|------------|----------------|
| Chat | GPT-5.4, Claude Sonnet 4.6, Gemini 3.5 Flash, DeepSeek V4 |
| Vision | GPT-4o, Claude Sonnet 4.6, Gemini 3.5 Flash |
| Image Generation | GPT Image, FLUX, Qwen Image, Gemini image models |
| Audio | Whisper, TTS-1, MiniMax Speech 2.8 |
| Realtime WebSocket | GPT realtime and live translation models |
| Embeddings | text-embedding-3-small |
| Music | Suno |
| 3D | Tripo H3.1, Tripo P1.0 |
## Integrations
- [Cursor](https://docs.tokenlab.sh/integrations/cursor)
- [Coding Agent Skill](https://docs.tokenlab.sh/integrations/coding-agent-skill)
- [OpenAI SDK](https://docs.tokenlab.sh/integrations/openai-sdk)
- [Anthropic SDK](https://docs.tokenlab.sh/integrations/anthropic-sdk)
- [LangChain](https://docs.tokenlab.sh/integrations/langchain)
- [Vercel AI SDK](https://docs.tokenlab.sh/integrations/vercel-ai-sdk)
## Key Features
- **Native-first + OpenAI-compatible**: Use provider-native routes when behavior matters, or /v1 compatibility for existing OpenAI-style clients
- **Multi-Format API**: Use OpenAI, Anthropic, or Gemini formats with one API key
- **Smart Routing**: Automatic failover and load balancing
- **Pay As You Go**: No subscriptions, competitive pricing
- **Agent-First Model Discovery**: Use GET /v1/models?recommended_for=image|video|music|3d|tts|stt|embedding|rerank|translation before non-chat requests
## Model Data
- [Model Data Center](https://tokenlab.sh/en/models/data): public model catalog source policy and data API
- [Model Trends](https://tokenlab.sh/en/models/trends): newest public models, source coverage, and pricing-unit distribution
- [Model Research](https://tokenlab.sh/en/models/research): model infrastructure research with source snapshots and limitations
- [Catalog JSON](https://tokenlab.sh/model-data/catalog.json): machine-readable public catalog summary
- [Latest Models JSON](https://tokenlab.sh/model-data/latest.json): machine-readable public model list
- [Trends JSON](https://tokenlab.sh/model-data/trends.json): machine-readable current trend snapshot
- [Model Data Markdown](https://tokenlab.sh/model-data/summary.md): crawler-friendly model data summary
## Links
- Website: https://tokenlab.sh
- Dashboard: https://tokenlab.sh/dashboard
- Models: https://tokenlab.sh/en/models
- API Status: https://tokenlab.sh/status
- Support: support@tokenlab.sh