Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 1 addition & 8 deletions docs/faq/tag/fine-tuning.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -11,13 +11,6 @@ When building AI applications that need domain-specific knowledge or consistent
- **Ensure consistent outputs**: Get reliable formatting and structure that matches your exact specifications every time
- **Reduce costs and latency**: Smaller fine-tuned models often outperform larger generic models at specific tasks

<Frame caption="Helicone's dataset curation interface for preparing fine-tuning data">
<img
src="/images/fine-tuning/dataset-curation.webp"
alt="Dataset curation interface showing request filtering and evaluation for fine-tuning"
/>
</Frame>

## Quick Start

<Steps>
Expand Down Expand Up @@ -379,7 +372,7 @@ Create and manage training datasets from your Helicone requests
Score requests to identify high-quality training examples
</Card>

<Card title="Request Filtering" icon="filter" href="/features/advanced-usage/filtering">
<Card title="Request Filtering" icon="filter" href="/rest/request/post-v1requestquery-clickhouse">
Advanced filtering to find the perfect training examples
</Card>

Expand Down
2 changes: 1 addition & 1 deletion docs/features/advanced-usage/custom-properties.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -269,7 +269,7 @@ Custom properties use a simple header-based format:
</ParamField>

<ParamField header="Helicone-User-Id" type="string">
Special reserved property for user tracking. Enables per-user cost analytics and usage metrics. See [User Metrics](/observability/user-metrics) for detailed tracking capabilities.
Special reserved property for user tracking. Enables per-user cost analytics and usage metrics. See [User Metrics](/features/advanced-usage/user-metrics) for detailed tracking capabilities.

Example: `Helicone-User-Id: user-123`
</ParamField>
Expand Down
4 changes: 2 additions & 2 deletions docs/features/advanced-usage/custom-rate-limits.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -173,7 +173,7 @@ const response = await client.chat.completions.create(
```

<Note>
Per-user rate limiting requires the `Helicone-User-Id` header. See [User Metrics](/observability/user-metrics) for more details.
Per-user rate limiting requires the `Helicone-User-Id` header. See [User Metrics](/features/advanced-usage/user-metrics) for more details.
</Note>

### Cost-Based Limits
Expand All @@ -198,7 +198,7 @@ const response = await client.chat.completions.create(

### Custom Property Limits

Limit by [custom properties](/observability/custom-properties) like organization or tier:
Limit by [custom properties](/features/advanced-usage/custom-properties) like organization or tier:

```typescript
// Each organization gets 5000 requests per hour
Expand Down
4 changes: 2 additions & 2 deletions docs/features/advanced-usage/evaluation/overview.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -47,8 +47,8 @@ Get started with Helicone's evaluation features by following these steps:
### Step 3: Setup your Evaluator

<CardGroup cols={3}>
<Card title="Scoring Worker" href="/features/scoring-worker" icon="server">
Setup and monitor your scoring worker.
<Card title="Scores" href="/features/advanced-usage/scores" icon="server">
Setup and monitor your scoring system.
</Card>

<Card title="Webhooks" href="/features/webhooks" icon="link">
Expand Down
17 changes: 4 additions & 13 deletions docs/features/advanced-usage/prompts.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -36,10 +36,7 @@ Traditional prompt development involves hardcoded prompts in application code, m
src="https://marketing-assets-helicone.s3.us-west-2.amazonaws.com/Prompts2025-A.mp4"
type="video/mp4"
/>
<img
src="/static/features/prompts/create_prompt_placeholder.png"
alt="Creating a prompt in Helicone dashboard"
/>
Your browser does not support the video tag.
</video>
</Frame>
</Step>
Expand All @@ -53,16 +50,13 @@ Traditional prompt development involves hardcoded prompts in application code, m
src="https://marketing-assets-helicone.s3.us-west-2.amazonaws.com/Prompts2025-B.mp4"
type="video/mp4"
/>
<img
src="/static/features/prompts/test_prompt_placeholder.png"
alt="Testing prompts with variables and different models"
/>
Your browser does not support the video tag.
</video>
</Frame>
</Step>

<Step title="Run Prompt with AI Gateway">
Use your prompt instantly by referencing its ID in your [AI Gateway](/features/advanced-usage/cloud-ai-gateway-overview). No code changes, no rebuilds.
Use your prompt instantly by referencing its ID in your [AI Gateway](/gateway/prompt-integration). No code changes, no rebuilds.

<CodeGroup>
```typescript TypeScript
Expand Down Expand Up @@ -308,10 +302,7 @@ You can easily manage different deployment environments for your prompts directl
src="https://marketing-assets-helicone.s3.us-west-2.amazonaws.com/Prompts2025-Environment.mp4"
type="video/mp4"
/>
<img
src="/static/features/prompts/environment_placeholder.png"
alt="Managing prompt environments in Helicone dashboard"
/>
Your browser does not support the video tag.
</video>
</Frame>

Expand Down
15 changes: 3 additions & 12 deletions docs/features/advanced-usage/prompts/overview.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -38,10 +38,7 @@ Traditional prompt development involves hardcoded prompts in application code, m
src="https://marketing-assets-helicone.s3.us-west-2.amazonaws.com/Prompts2025-A.mp4"
type="video/mp4"
/>
<img
src="/static/features/prompts/create_prompt_placeholder.png"
alt="Creating a prompt in Helicone dashboard"
/>
Your browser does not support the video tag.
</video>
</Frame>
</Step>
Expand All @@ -55,10 +52,7 @@ Traditional prompt development involves hardcoded prompts in application code, m
src="https://marketing-assets-helicone.s3.us-west-2.amazonaws.com/Prompts2025-B.mp4"
type="video/mp4"
/>
<img
src="/static/features/prompts/test_prompt_placeholder.png"
alt="Testing prompts with variables and different models"
/>
Your browser does not support the video tag.
</video>
</Frame>
</Step>
Expand Down Expand Up @@ -286,10 +280,7 @@ You can easily manage different deployment environments for your prompts directl
src="https://marketing-assets-helicone.s3.us-west-2.amazonaws.com/Prompts2025-Environment.mp4"
type="video/mp4"
/>
<img
src="/static/features/prompts/environment_placeholder.png"
alt="Managing prompt environments in Helicone dashboard"
/>
Your browser does not support the video tag.
</video>
</Frame>

Expand Down
2 changes: 1 addition & 1 deletion docs/features/advanced-usage/user-metrics.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -471,7 +471,7 @@ Responsible user analytics practices:
<Card title="Feedback Collection" icon="message-circle" href="/features/advanced-usage/feedback">
Gather user satisfaction data
</Card>
<Card title="A/B Testing" icon="git-branch" href="/experiments/overview">
<Card title="A/B Testing" icon="git-branch" href="/guides/cookbooks/experiments">
Test improvements with user segments
</Card>
</CardGroup>
Expand Down
4 changes: 2 additions & 2 deletions docs/features/customer-portal.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -122,12 +122,12 @@ Once your customer starts logging their requests in Helicone, you can view their
<CardGroup cols={2}>
<Card
title="Resell a Model"
href="/use-cases/resell-a-model"
href="https://www.helicone.ai/features/customer-portal"
icon="circle-dollar-to-slot"
>
Sell a fine-tuned model to certain customers.
</Card>
<Card title="Bill by Usage" href="/use-cases/bill-by-usage" icon="chart-bar">
<Card title="Bill by Usage" href="https://www.helicone.ai/features/customer-portal" icon="chart-bar">
Coming soon.
</Card>
</CardGroup>
Expand Down
12 changes: 6 additions & 6 deletions docs/features/prompts-legacy/editor.mdx
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
---
title: "Editor"
sidebarTitle: "UI Managed"
description: "Design, version, and manage your prompts collaboratively, then [effortlessly deploy them across your app](/features/prompts/generate)."
description: "Design, version, and manage your prompts collaboratively, then [effortlessly deploy them across your app](/features/prompts-legacy/generate)."
"twitter:title": "Prompts | Helicone OSS LLM Observability"
---

Expand All @@ -24,7 +24,7 @@ The Helicone Prompt Editor enables you to:
type="video/mp4"
/>
<img
src="/static/features/prompts/feature1.png"
src="/images/prompts/create-prompt.webp"
alt="Prompt building interface"
/>
</video>
Expand All @@ -45,7 +45,7 @@ Take full control of your prompt versions:
type="video/mp4"
/>
<img
src="/static/features/prompts/feature2.png"
src="/images/prompts/prompt-cover.webp"
alt="Version control interface"
/>
</video>
Expand All @@ -66,7 +66,7 @@ Write prompts faster and more efficiently:
type="video/mp4"
/>
<img
src="/static/features/prompts/feature3.png"
src="/images/prompts/auto-improve.webp"
alt="Prompt testing interface"
/>
</video>
Expand All @@ -86,7 +86,7 @@ Test and refine your prompts instantly:
type="video/mp4"
/>
<img
src="/static/features/prompts/feature4.png"
src="/images/prompts/prompt-cover.webp"
alt="Prompt testing interface"
/>
</video>
Expand Down Expand Up @@ -124,7 +124,7 @@ We're excited to launch Auto-Improve, an intelligent prompt optimization tool th
<Warning>
**API Migration Notice:** We are actively working on a new Router project that
will include an updated Generate API. While the previous [Generate API
(legacy)](/features/prompts/generate) is still functional (see the notice on
(legacy)](/features/prompts-legacy/generate) is still functional (see the notice on
that page for deprecation timelines), here's a temporary way to import and use
your UI-managed prompts directly in your code in the meantime:
</Warning>
Expand Down
4 changes: 2 additions & 2 deletions docs/features/prompts-legacy/generate.mdx
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
---
title: "Generate API"
sidebarTitle: "Generate (legacy)"
description: "Deploy your [Editor](/features/prompts/editor) prompts effortlessly with a light and modern package."
description: "Deploy your [Editor](/features/prompts-legacy/editor) prompts effortlessly with a light and modern package."
"twitter:title": "Generate API | Helicone OSS LLM Observability"
---

Expand Down Expand Up @@ -106,7 +106,7 @@ Generates a response using a Helicone prompt.
#### Parameters

- `input` (string | object): Either a prompt ID string or a parameters object:
- `promptId` (string): The ID of the prompt to use, created in the [Prompt Editor](/features/prompts/editor)
- `promptId` (string): The ID of the prompt to use, created in the [Prompt Editor](/features/prompts-legacy/editor)
- `version` (number | "production", optional): The version of the prompt to use. Defaults to "production"
- `inputs` (object, optional): Variable inputs to use in the prompt, if any
- `chat` (string[], optional): Chat history for chat-based prompts
Expand Down
2 changes: 1 addition & 1 deletion docs/features/prompts-legacy/import.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -34,7 +34,7 @@ Once you set up prompts in Helicone, your incoming requests will be matched to a

- version and track iterations of your prompt over time.
- maintain a dataset of inputs and outputs for each prompt.
- generate content using predefined prompts through our [Generate API](/features/prompts/generate).
- generate content using predefined prompts through our [Generate API](/features/prompts-legacy/generate).

## Quick Start

Expand Down
12 changes: 6 additions & 6 deletions docs/gateway/concepts/error-handling.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -114,8 +114,8 @@ When both billing methods fail, the gateway returns the **most actionable error*
```

**Solutions**:
1. Add Helicone credits at `/credits`
2. Configure provider keys in `/settings/providers`
1. Add Helicone credits in your dashboard
2. Configure provider keys in your dashboard settings
3. Enable [automatic retries](/features/advanced-usage/retries) with `Helicone-Retry-Enabled: true` to handle transient failures

<Info>
Expand All @@ -131,11 +131,11 @@ When both billing methods fail, the gateway returns the **most actionable error*
When you see an error, you can determine which billing method it came from:

**PTB Errors**:
- 429: "Insufficient credits" → Add credits at `/credits`
- 429: "Insufficient credits" → Add credits in your dashboard
- 403: "Wallet suspended" → Contact support

**BYOK Errors**:
- 401: "Invalid API key" → Check provider keys in `/settings/providers`
- 401: "Invalid API key" → Check provider keys in your dashboard settings
- 500: "Provider error" → Check provider status
- 503: "Service unavailable" → Provider having issues

Expand Down Expand Up @@ -253,8 +253,8 @@ function classifyError(error: any) {

- [Automatic Retries](/features/advanced-usage/retries) - Configure retry headers for handling transient failures
- [Provider Routing](/gateway/provider-routing) - Learn how to configure fallback providers
- [Settings: Provider Keys](/settings/providers) - Add your provider API keys
- [Credits](/credits) - Add Helicone credits for Pass-Through Billing
- Provider Keys - Add your provider API keys in your dashboard settings
- Credits - Add Helicone credits for Pass-Through Billing in your dashboard

<Info>
**Need Help?** If you're seeing unexpected errors or need assistance configuring fallback, contact us at support@helicone.ai or join our [Discord community](https://discord.com/invite/zsSTcH2qhG).
Expand Down
2 changes: 1 addition & 1 deletion docs/gateway/integrations/n8n.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -204,7 +204,7 @@ All requests from this node will include these properties in Helicone.
<Card title="Model Registry" icon="database" href="https://helicone.ai/models">
Browse all available models and providers
</Card>
<Card title="Gateway Features" icon="sparkles" href="/gateway/gateway-features">
<Card title="Gateway Overview" icon="sparkles" href="/gateway/overview">
Explore caching, session tracking, and more
</Card>
<Card title="Custom Properties" icon="tags" href="/features/advanced-usage/custom-properties">
Expand Down
4 changes: 2 additions & 2 deletions docs/gateway/integrations/openai-agents.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -190,7 +190,7 @@ import RequestIntegration from "/snippets/request-integration.mdx";
<Card title="Rate Limiting" icon="gauge" href="/features/advanced-usage/custom-rate-limits">
Configure rate limits for your applications
</Card>
<Card title="Tool Usage Tracking" icon="wrench" href="/features/tool-usage">
Monitor tool calls and function usage in your agents
<Card title="Sessions" icon="wrench" href="/features/sessions">
Monitor tool calls and agent workflows
</Card>
</CardGroup>
2 changes: 1 addition & 1 deletion docs/getting-started/core-concepts.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -240,7 +240,7 @@ Here's how these concepts work together in a real AI application:
Now that you understand the core concepts, put them into practice:

<CardGroup cols={2}>
<Card title="Explore Your Dashboard" icon="chart-line" href="/observability/request-monitoring">
<Card title="Explore Your Dashboard" icon="chart-line" href="https://us.helicone.ai/dashboard">
See these concepts in action with your live data
</Card>
<Card title="Set Up Sessions" icon="git-branch" href="/features/sessions">
Expand Down
2 changes: 1 addition & 1 deletion docs/getting-started/integration-method/crewai.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -204,7 +204,7 @@ llm = LLM(
)
```

Learn more about [Prompts](/features/prompts)
Learn more about [Prompts](/features/advanced-usage/prompts/overview)

## Multi-Agent Example

Expand Down
2 changes: 1 addition & 1 deletion docs/getting-started/integration-method/gateway.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ description: "The optimal method to integrate with Helicone is through our Gatew

# Overview

The Gateway serves as a unified entry point for all traffic, regardless of your provider. It enables you to dispatch requests to any provider through a single endpoint. This provides you with the advantage of utilizing all of Helicone's features such as [Caching](/features/advanced-usage/caching), [Monitoring](https://helicone.ai), [Rate Limiting](/features/advanced-usage/custom-rate-limits), [Vaults](/features/advanced-usage/vaults), [Feedback](/features/advanced-usage/feedback), and many more for any provider.
The Gateway serves as a unified entry point for all traffic, regardless of your provider. It enables you to dispatch requests to any provider through a single endpoint. This provides you with the advantage of utilizing all of Helicone's features such as [Caching](/features/advanced-usage/caching), [Monitoring](https://helicone.ai), [Rate Limiting](/features/advanced-usage/custom-rate-limits), [Key Management](https://us.helicone.ai/settings/providers), [Feedback](/features/advanced-usage/feedback), and many more for any provider.

## Simple Integration

Expand Down
6 changes: 3 additions & 3 deletions docs/getting-started/integration-method/vercel-ai-gateway.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -240,7 +240,7 @@ The `@ai-sdk/gateway` integration (recommended) supports all Vercel AI Gateway f
<Card
title="Explore Analytics"
icon="chart-line"
href="/features/analytics"
href="/getting-started/platform-overview"
>
Learn about Helicone's analytics capabilities
</Card>
Expand All @@ -254,14 +254,14 @@ The `@ai-sdk/gateway` integration (recommended) supports all Vercel AI Gateway f
<Card
title="User Tracking"
icon="users"
href="/features/user-tracking"
href="/features/advanced-usage/user-metrics"
>
Track and analyze user behavior
</Card>
<Card
title="Cost Analysis"
icon="dollar-sign"
href="/features/cost-analysis"
href="/guides/cookbooks/cost-tracking"
>
Monitor costs across all providers
</Card>
Expand Down
4 changes: 2 additions & 2 deletions docs/guides/cookbooks/replay-session.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -272,8 +272,8 @@ Understanding how changes impact your AI agents in real-world interactions is cr
## Additional Tips

- **Version Control Prompts**: Keep track of different prompt versions to see which yields the best results.
- **Use Evaluations**: Utilize Helicone's [Evaluation Features](/features/evaluation) to score and compare responses.
- **Prompt Versioning**: Use Helicone's [Prompt Versioning](/features/prompts) to manage and compare different prompt versions effectively.
- **Use Evaluations**: Utilize Helicone's [Evaluation Features](/features/advanced-usage/evaluation/overview) to score and compare responses.
- **Prompt Versioning**: Use Helicone's [Prompt Versioning](/features/advanced-usage/prompts/overview) to manage and compare different prompt versions effectively.

## Conclusion

Expand Down
2 changes: 1 addition & 1 deletion docs/guides/overview.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -338,7 +338,7 @@ Master the art of crafting effective prompts for optimal LLM performance.
<Accordion title="Need help choosing a guide?" type="secondary">
<p>
Not sure which guide to start with? Check out our
<a href="/guides/getting-started">Getting Started</a> guide to begin your journey
<a href="/getting-started/quick-start">Getting Started</a> guide to begin your journey
with Helicone.
</p>
</Accordion>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ import QuestionsSection from "/snippets/questions-section.mdx";

## What is Least-to-Most (LtM) prompting

Least-to-Most (LtM) prompting is a method that breaks down problems into simpler subproblems and solves them sequentially. This approach differs from [Chain-of-Thought prompting](use-chain-of-thought-prompting), where each step is independent, as LtM utilizes the output of previous subproblems as input for the next.
Least-to-Most (LtM) prompting is a method that breaks down problems into simpler subproblems and solves them sequentially. This approach differs from [Chain-of-Thought prompting](/guides/prompt-engineering/use-chain-of-thought-prompting), where each step is independent, as LtM utilizes the output of previous subproblems as input for the next.

Notably, LtM has demonstrated significantly higher accuracy than standard and Chain-of-Thought approaches in various tasks.

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ import QuestionsSection from "/snippets/questions-section.mdx";

## What is Thread-of-Thought (ThoT) prompting

Thread-of-Thought is an approach that extends [chain-of-thought prompting](use-chain-of-thought-prompting) by maintaining a continuous, evolving reasoning process across multiple, related prompts.
Thread-of-Thought is an approach that extends [chain-of-thought prompting](/guides/prompt-engineering/use-chain-of-thought-prompting) by maintaining a continuous, evolving reasoning process across multiple, related prompts.
It's like having a conversation where each new idea builds on previous ones, helping the LLM to think more deeply and keep track of all the details as we explore a topic.

## How to implement Thread-of-Thought prompting
Expand Down
4 changes: 2 additions & 2 deletions docs/integrations/data/logger-sdk.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -269,5 +269,5 @@ For more examples, check out our [GitHub examples](https://github.com/Helicone/h

## Related Guides

- [How to use Helicone Sessions](/guides/sessions)
- [How to use Helicone Custom Properties](/guides/custom-properties)
- [How to use Helicone Sessions](/features/sessions)
- [How to use Helicone Custom Properties](/features/advanced-usage/custom-properties)
Loading
Loading