Feat(Metering & BIlling): Meter LLM traffic #3650
Conversation
* subjects * add schema * Apply suggestions from code review * appease vale Signed-off-by: Diana <[email protected]> --------- Signed-off-by: Diana <[email protected]> Co-authored-by: Diana <[email protected]>
✅ Deploy Preview for kongdeveloper ready!
To edit notification comments on pull requests, go to your Netlify project configuration. |
Guaris
added
the
do not merge
| tldr: | ||
| q: How can I meter LLM traffic in {{site.konnect_short_name}}, and what does the Metering & Billing system provide? | ||
| a: | | ||
| To meter LLM traffic in {{site.konnect_short_name}}, you can use the Metering & Billing system to track and invoice usage based on defined products, plans, and features. This guide walks you through setting up a Consumer, creating a meter for LLM tokens, defining a feature, creating a Plan with Rate Cards, and starting a subscription for billing. |
There was a problem hiding this comment.
Do we need to say "system"?
... you can use Metering & Billing to track...
|
|
||
| ## Create a Consumer | ||
|
|
||
| Before you configure metering and billing, you can set up a Consumer, Kong Air. [Consumers](/gateway/entities/consumer/) let you identify the client that's interacting with {{site.base_gateway}}. Later in this guide, you'll be mapping this Consumer to a customer in Metering & Billing and assigning them to a Premium plan. Doing this allows you map existing Consumers that are already consuming your APIs to customers to make them billable. |
There was a problem hiding this comment.
We refer to the product here, no?
metering and billing => Metering & Billing
| @@ -0,0 +1,164 @@ | |||
| --- | |||
| title: Meter LLM traffic in {{site.konnect_short_name}} | |||
There was a problem hiding this comment.
Title says to meter LLM traffic but we also setup pricing for it and even launch a subscription.
So either:
- Rename to "Monetize LLM Traffic"
- Or remove "3. Create a feature" and onward steps except validation and add a step to "Query Meter"
If we only focus to metering, the steps would look as:
- Create a Consumer
- Enable metering on Control Plane
- Validate: Send Traffic
- Validate: Query Usage on Meter
There was a problem hiding this comment.
This is also a docs structural question because we cover monetization here already: #3504 so technically we don't have to do it here and we could keep this more focused to metering.
app/_how-tos/meter-llm-traffic.md
Outdated
| {% endentity_examples %} | ||
| <!--vale on--> | ||
|
|
||
| ## Create a meter |
There was a problem hiding this comment.
This step will change this week :/
- We will pre-create meters for users so they don't have to
- Users have to "Enable Metering" on Control Plane similar to Advanced Analytics (or in M&B, see docs/figma)
See new experience: https://docs.google.com/document/d/1SKMyQBTFjKyLklofM0269G_0e1mcGnSIbFHQjzSh7hQ/edit?tab=t.0#heading=h.tyodobk39d3g
We are building lots of onboarding around this, so for now I think it would be enough to say in the docs:
"Enable metering for the Control Plane where you want to track usage on"
Because of this step title should change to "Enable Metering".
We can chat more on Zoom/Slack about this.
|
|
||
| ## Create a Consumer | ||
|
|
||
| Before you configure metering and billing, you can set up a Consumer, Kong Air. [Consumers](/gateway/entities/consumer/) let you identify the client that's interacting with {{site.base_gateway}}. Later in this guide, you'll be mapping this Consumer to a customer in Metering & Billing and assigning them to a Premium plan. Doing this allows you map existing Consumers that are already consuming your APIs to customers to make them billable. |
There was a problem hiding this comment.
| Before you configure metering and billing, you can set up a Consumer, Kong Air. [Consumers](/gateway/entities/consumer/) let you identify the client that's interacting with {{site.base_gateway}}. Later in this guide, you'll be mapping this Consumer to a customer in Metering & Billing and assigning them to a Premium plan. Doing this allows you map existing Consumers that are already consuming your APIs to customers to make them billable. | |
| Before you configure Metering & Billing, you can set up a Consumer, Kong Air. [Consumers](/gateway/entities/consumer/) let you identify the client that's interacting with {{site.base_gateway}}. Later in this guide, you'll be mapping this Consumer to a customer in Metering & Billing and assigning them to a Premium plan. Doing this allows you map existing Consumers that are already consuming your APIs to customers to make them billable. |
Co-authored-by: Diana <[email protected]>
| paths: | ||
| - /chat |
There was a problem hiding this comment.
| paths: | |
| - /chat | |
| paths: | |
| - /chat |
This was being rendered with "" which was causing problems
|
@cloudjumpercat I'm going to assign this to you while I'm on PTO |
Description
The Analytics pipeline in Metering is broken right now so the token usage wont actually show up in the invoice.
Preview Links
https://deploy-preview-3650--kongdeveloper.netlify.app/metering-and-billing/meter-llm-traffic/
Checklist
descriptionentry in frontmatter.