Skip to content

ai-gateway.md

Latest commit

 

History

History
66 lines (45 loc) · 2.14 KB

ai-gateway.md

File metadata and controls

66 lines (45 loc) · 2.14 KB
title Vercel AI Gateway
description Reference for using Vercel AI Gateway with the AI SDK.

Vercel AI Gateway

The Vercel AI Gateway is the fastest way to get started with the AI SDK. It provides access to models from OpenAI, Anthropic, Google, and other providers through a single API.

Authentication

Authenticate with OIDC (for Vercel deployments) or an AI Gateway API key:

AI_GATEWAY_API_KEY=your_api_key_here

Usage

The AI Gateway is the default global provider, so you can access models using a simple string:

import { generateText } from 'ai';

const { text } = await generateText({
  model: 'anthropic/claude-sonnet-4.5',
  prompt: 'What is love?',
});

You can also explicitly import and use the gateway provider:

// Option 1: Import from 'ai' package (included by default)
import { gateway } from 'ai';
model: gateway('anthropic/claude-sonnet-4.5');

// Option 2: Install and import from '@ai-sdk/gateway' package
import { gateway } from '@ai-sdk/gateway';
model: gateway('anthropic/claude-sonnet-4.5');

Find Available Models

Important: Always fetch the current model list before writing code. Never use model IDs from memory - they may be outdated.

List all available models through the gateway API:

curl https://ai-gateway.vercel.sh/v1/models

Filter by provider using jq. Do not truncate with head - always fetch the full list to find the latest models:

# Anthropic models
curl -s https://ai-gateway.vercel.sh/v1/models | jq -r '[.data[] | select(.id | startswith("anthropic/")) | .id] | reverse | .[]'

# OpenAI models
curl -s https://ai-gateway.vercel.sh/v1/models | jq -r '[.data[] | select(.id | startswith("openai/")) | .id] | reverse | .[]'

# Google models
curl -s https://ai-gateway.vercel.sh/v1/models | jq -r '[.data[] | select(.id | startswith("google/")) | .id] | reverse | .[]'

When multiple versions of a model exist, use the one with the highest version number (e.g., prefer claude-sonnet-4-5 over claude-sonnet-4 over claude-3-5-sonnet).