Skip to content

Document quotas for remote generation#3680

Merged
tjb9dc merged 3 commits into
mainfrom
fern/document-rate-limits
Feb 19, 2026
Merged

Document quotas for remote generation#3680
tjb9dc merged 3 commits into
mainfrom
fern/document-rate-limits

Conversation

@devin-ai-integration
Copy link
Copy Markdown
Contributor

@devin-ai-integration devin-ai-integration Bot commented Feb 18, 2026

Summary

Adds a new Quotas section to the SDK "How it works" page documenting the rate limits for remote (cloud) generation:

  • Leaky bucket algorithm: burst of 10 generations, refill of 5 per minute
  • Callout that local generation (--local) isn't subject to quotas
  • Link to contact us for higher limits

Updates since last revision

  • Fixed vale lint: is notisn't per Microsoft.Contractions rule

Local testing

Verified the page renders correctly via fern docs dev:

Local preview recording

View original video (rec-e22d483bc7de49359a3204ef6a980e03-edited.mp4)

Review & Testing Checklist for Human

  • Verify the quota values (burst=10, refill=5/min) match what was shipped in the backend
  • Check section placement — the Quotas section sits between the cloud workflow steps and the sequence diagram accordions; confirm this reads naturally
  • Confirm the link to the self-hosted page (/learn/sdks/deep-dives/self-hosted) resolves correctly on the preview deploy

Notes

Requested by: Fern Support
Link to Devin run

@devin-ai-integration
Copy link
Copy Markdown
Contributor Author

🤖 Devin AI Engineer

I'll be helping with this pull request! Here's what you should know:

✅ I will automatically:

  • Address comments on this PR. Add '(aside)' to your comment to have me ignore it.
  • Look at CI failures and help fix them

Note: I can only respond to comments from users who have write access to this repository.

⚙️ Control Options:

  • Disable automatic comment and CI monitoring

Comment thread fern/products/sdks/how-it-works.mdx Outdated
You can queue up to 10 generations at once (the burst), and the bucket refills at a steady rate of 5 generations per minute. If you exceed the burst limit, subsequent requests will be throttled until capacity is available.

<Note>
Rate limits apply only to remote (cloud) generation. [Local generation](/learn/sdks/deep-dives/self-hosted) using `--local` is not subject to any quotas.
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Microsoft.Contractions] Use 'isn't' instead of 'is not'.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Feb 18, 2026

🌿 Preview your docs: https://fern-preview-3bb52396-f27a-41cd-852b-23f8aadc1de3.docs.buildwithfern.com/learn

Here are the markdown pages you've updated:

@tjb9dc tjb9dc merged commit 1bf7af3 into main Feb 19, 2026
2 checks passed
@tjb9dc tjb9dc deleted the fern/document-rate-limits branch February 19, 2026 17:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants