Skip to content

help request: How to gracefully implement token quota limiting to block access once exceeding quota #13755

Description

@RGZingYang

Description

I want to enable token quota control on Apache APISIX. Limits can be set per user or per user-route pair. After a user exhausts their total request quota, all follow-up requests initiated by the user are blocked, with no traffic forwarded to the target upstream LLM service.

Environment

  • APISIX version (run apisix version):
  • Operating system (run uname -a):
  • OpenResty / Nginx version (run openresty -V or nginx -V):
  • etcd version, if relevant (run curl http://127.0.0.1:9090/v1/server_info):
  • APISIX Dashboard version, if relevant:
  • Plugin runner version, for issues related to plugin runners:
  • LuaRocks version, for installation issues (run luarocks --version):

Metadata

Metadata

Assignees

No one assigned

    Labels

    questionlabel for questions asked by users

    Type

    No type

    Projects

    Status
    📋 Backlog

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions