Skip to content

Add Helicone AI Gateway Documentation#175

Open
juliettech13 wants to merge 1 commit into
SillyTavern:mainfrom
juliettech13:helicone-doc
Open

Add Helicone AI Gateway Documentation#175
juliettech13 wants to merge 1 commit into
SillyTavern:mainfrom
juliettech13:helicone-doc

Conversation

@juliettech13

Copy link
Copy Markdown

This PR adds comprehensive documentation for the new Helicone AI Gateway integration in SillyTavern.

📚 Documentation Added

New Documentation File:

  • Usage/API_Connections/Helicone.md - Complete setup and usage guide for Helicone AI Gateway

Updated Documentation:

  • Usage/API_Connections/index.md - Added Helicone to the Cloud LLM APIs section

📋 Documentation Contents

The Helicone documentation includes:

  • Setup Instructions: Step-by-step guide to connect Helicone to SillyTavern
  • Feature Overview: Provider routing, web search integration, custom properties
  • Model Selection: Access to 100+ models across multiple providers (OpenAI, Anthropic, Google, Meta, etc.)
  • Pricing Information: Pay-per-use model with transparent pricing
  • Support Links: Documentation, Discord, and GitHub resources

🎯 Key Features Documented

  • BYOK & PTB Support: Bring Your Own Keys or Pass-Through Billing options
  • Provider Routing: Automatic fallbacks and manual routing configuration
  • Web Search: Integration for Claude models with internet access
  • Custom Properties: Analytics and tracking metadata in JSON format
  • Observability: Built-in analytics and usage tracking dashboard
  • Open Source: 0% markup fees, entirely open-source solution

📝 Structure & Style

The documentation follows the established SillyTavern docs patterns:

  • Consistent formatting with other API provider docs (similar to OpenRouter)
  • Step-by-step setup instructions with numbered lists
  • Feature sections with code examples
  • Info/tip callout boxes for important information
  • Proper frontmatter and routing configuration

🖼️ Visual Documentation

  • References screenshot at /static/helicone-connection.png (to be added)
  • Follows same visual documentation pattern as other providers

This documentation provides users with complete guidance on setting up and using Helicone AI Gateway as their LLM provider in SillyTavern, with the same level of
detail and structure as existing provider documentation.

@gemini-code-assist

Copy link
Copy Markdown
Contributor

Summary of Changes

Hello @juliettech13, I'm Gemini Code Assist1! I'm currently reviewing this pull request and will post my feedback shortly. In the meantime, here's a summary to help you and other reviewers quickly get up to speed!

This pull request introduces complete documentation for the Helicone AI Gateway, enabling SillyTavern users to seamlessly integrate this powerful tool. The new guide details how to connect to Helicone, leverage its unified access to over a hundred AI models from various providers, and utilize advanced features such as automatic fallbacks, web search capabilities, and custom analytics tracking, ultimately streamlining AI model management and usage within the application.

Highlights

  • New Helicone AI Gateway Documentation: A new documentation file, "Usage/API_Connections/Helicone.md", has been added, providing a comprehensive guide for integrating and using the Helicone AI Gateway with SillyTavern.
  • API Connections Index Update: The "Usage/API_Connections/index.md" file has been updated to include Helicone in the Cloud LLM APIs section, offering a brief description and a link to its dedicated setup instructions.
  • Detailed Helicone Features: The new documentation covers setup instructions, a feature overview (provider routing, web search, custom properties), model selection (100+ models), pricing information, and support links for Helicone.
Using Gemini Code Assist

The full guide for Gemini Code Assist can be found on our documentation page, here are some quick tips.

Invoking Gemini

You can request assistance from Gemini at any point by creating a comment using either /gemini <command> or @gemini-code-assist <command>. Below is a summary of the supported commands on the current page.

Feature Command Description
Code Review /gemini review Performs a code review for the current pull request in its current state.
Pull Request Summary /gemini summary Provides a summary of the current pull request in its current state.
Comment @gemini-code-assist Responds in comments when explicitly tagged, both in pull request comments and review comments.
Help /gemini help Displays a list of available commands.

Customization

To customize Gemini Code Assist for GitHub experience, repository maintainers can create a configuration file and/or provide a custom code review style guide (such as PEP-8 for Python) by creating and adding files to a .gemini/ folder in the base of the repository. Detailed instructions can be found here.

Limitations & Feedback

Gemini Code Assist may make mistakes. Please leave feedback on any instances where its feedback is incorrect or counter productive. You can react with 👍 and 👎 on @gemini-code-assist comments. If you're interested in giving your feedback about your experience with Gemini Code Assist for Github and other Google products, sign up here.

You can also get AI-powered code generation, chat, as well as code reviews directly in the IDE at no cost with the Gemini Code Assist IDE Extension.

Footnotes

  1. Review the Privacy Notices, Generative AI Prohibited Use Policy, Terms of Service, and learn how to configure Gemini Code Assist in GitHub here. Gemini can make mistakes, so double check it and use code with caution.

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request adds comprehensive documentation for the Helicone AI Gateway integration. The new documentation is well-structured and follows the existing format. I've found a few minor typos and a small inaccuracy in the model list that should be corrected. I've also suggested using a permanent Discord invite link for better long-term maintainability. Overall, this is a great addition to the project's documentation.

## Features

### Provider Routing with Fallbacks
Helicone handls provider routing and fallbacks automatically, so you don't have to worry about it.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

There is a small typo in this line. handls should be handles.

Suggested change
Helicone handls provider routing and fallbacks automatically, so you don't have to worry about it.
Helicone handles provider routing and fallbacks automatically, so you don't have to worry about it.

### Model Selection
Helicone provides access to 100+ models including:
- **OpenAI**: GPT-4o, GPT-4 Turbo, GPT-3.5 Turbo
- **Anthropic**: Claude 4, Claude 3.5 Sonnet, Claude 3 Haiku

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

The model Claude 4 is not a recognized public model from Anthropic. The most powerful model in the Claude 3 family is Claude 3 Opus. It would be more accurate to list Claude 3 Opus instead of Claude 4 to avoid confusion.

Suggested change
- **Anthropic**: Claude 4, Claude 3.5 Sonnet, Claude 3 Haiku
- **Anthropic**: Claude 3 Opus, Claude 3.5 Sonnet, Claude 3 Haiku


## Support
- [Helicone Documentation](https://docs.helicone.ai/)
- [Helicone Discord](https://discord.gg/bnGpD4uG)

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

This Discord invite link appears to be a temporary one, which can expire. It's best practice to use a permanent vanity URL if available. Helicone's permanent invite link is https://discord.gg/helicone.

Suggested change
- [Helicone Discord](https://discord.gg/bnGpD4uG)
- [Helicone Discord](https://discord.gg/helicone)


### Helicone

- AI Gateway providing unified access to 100+ models across multiple providers (OpenAI, Anthropic, Google, Meta, etc.) with observability built-in by defaylt.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

There is a typo in this line. defaylt should be default.

Suggested change
- AI Gateway providing unified access to 100+ models across multiple providers (OpenAI, Anthropic, Google, Meta, etc.) with observability built-in by defaylt.
- AI Gateway providing unified access to 100+ models across multiple providers (OpenAI, Anthropic, Google, Meta, etc.) with observability built-in by default.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant