Skip to content

feat(gateway): make vLLM sampler requests asynchronous and rate-limited#119

Closed
droot wants to merge 1 commit into
gke-labs:mainfrom
droot:feature/async-vllm-sampling
Closed

feat(gateway): make vLLM sampler requests asynchronous and rate-limited#119
droot wants to merge 1 commit into
gke-labs:mainfrom
droot:feature/async-vllm-sampling

feat(gateway): make vLLM sampler requests asynchronous and rate-limited

7c1a533
Select commit
Loading
Failed to load commit list.
Google CLA / cla/google succeeded Jun 11, 2026 in 6s

✅ All contributors are covered under a CLA with Google

See https://cla.developers.google.com/ for more info about Google's Contributor License Agreement (CLA).

ℹ️ Googlers: Go here to view more details and manage scans for this pull request.

Details

The following contributors were found for this pull request:

✅ 7c1a533 Author: @droot <sun*****ra​@google.com>, <aro******il​@gmail.com>

(Only the first commit for a unique contributor is listed.)

View more details on Google CLA