Skip to content

Add queued limiter for providers and Chatwoot webhook tests #400

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 4 commits into from
Oct 25, 2025
Merged

Add queued limiter for providers and Chatwoot webhook tests #400

merged 4 commits into from
Oct 25, 2025
+1,272 −19

Conversation

@Joewus12345
Copy link
Owner

Summary

  • add a shared provider limiter with configurable concurrency and token buckets
  • wrap the OpenAI, Ollama, and Ollama-OpenAI providers to schedule calls through the limiter and pass token estimates from the Chatwoot webhook
  • extend the Chatwoot webhook suite and add limiter unit tests to validate queuing and token enforcement

Testing

  • npm test -- tests/limiter.test.js tests/chatwootWebhook.test.js

https://chatgpt.com/codex/tasks/task_e_68fc2704a3848333bfd411631cf27acb

@Joewus12345 Joewus12345 added the codex writing features, answering questions, fixing bugs, proposing pull requests for review label Oct 25, 2025 — with ChatGPT Codex Connector
@Joewus12345 Joewus12345 self-assigned this Oct 25, 2025
@Joewus12345 Joewus12345 added enhancement New feature or request refactor Changes to the codebase to enhance efficiency, security, speed and robustness of the codebase testing Addition of test cases for the codebase structure. Tests cases include unit and integration tests labels Oct 25, 2025
Joewus12345
Joewus12345 commented Oct 25, 2025
View reviewed changes
Copy link
Owner Author

@Joewus12345 Joewus12345 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Changes reviewed for testing and further tweaking

@Joewus12345 Joewus12345 merged commit dbd1207 into ollama Oct 25, 2025
@Joewus12345 Joewus12345 deleted the codex/implement-token-bucket-limiter-with-concurrency branch October 25, 2025 22:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

@Joewus12345 Joewus12345

Labels

codex writing features, answering questions, fixing bugs, proposing pull requests for review enhancement New feature or request refactor Changes to the codebase to enhance efficiency, security, speed and robustness of the codebase testing Addition of test cases for the codebase structure. Tests cases include unit and integration tests

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@Joewus12345