All pull requests

Pull requests

• feat(global-router): register router replicas through discovery

  documentationfeatsize/XXL
  #18198·sachalmalick opened Nov 5, 2026Contributor·1 task done·

  ·
  1

  2

• fix(router): exclude host and disk KV hits from GPU prefill load

  documentationexternal-contributionfixsize/L
  #18195·glamr-agent opened Nov 5, 2026Collaborator·

  ·
  1

  6

• feat(operator): run a sidecar-less LPX draft as its own workload

  deployment::k8sdocumentationfeatsize/XL
  #18192·andrewpaprotsky opened Nov 5, 2026Contributor·1 task done·

  ·
  1

  1

• docs(observability): list the Global Frontend affinity metrics

  docsdocumentationsize/S
  #18190·sachalmalick opened Nov 5, 2026Contributor·

  ·
  1

• feat(epp): support named policies in Runtime mode

  documentationexternal-contributionfeatsize/XL
  #18189·andrewzyxing opened Nov 5, 2026·1 task done·

  ·
  3

• fix(operator): wait for the requested restart revision in component and Grove progress

  deployment::k8sexternal-contributionfixsize/XL
  #18188·glamr-agent opened Nov 5, 2026Collaborator·

  ·
  6

• test(operator): compare Kubernetes API types with apiequality.Semantic.DeepEqual in tests

  deployment::k8sexternal-contributionsize/XStest
  #18187·dongjiang1989 opened Nov 5, 2026Contributor·1 task done·

  ·
  1

  3

• fix(frontend): preserve rendering context in speculative prefill

  documentationexternal-contributionfixfrontendsize/Ltrusted-contributor
  #18185·xianlubird opened Nov 5, 2026Contributor·1 task done·

  ·
  1

  4

• feat(router): add CPU backpressure example and CI coverage

  actionsdocumentationfeatsize/XL
  #18183·kthui opened Nov 5, 2026Contributor·1 task done·

  ·
  5

• fix(sglang,trtllm): honor the requested image output format in image workers

  backend::sglangbackend::trtllmdocumentationexternal-contributionsize/XL
  #18182·glamr-agent opened Nov 5, 2026Collaborator·

  ·
  8

• fix(bindings): reject unrepresentable durations in selection cache and discovery waits

  external-contributionfixsize/L
  #18181·glamr-agent opened Nov 5, 2026Collaborator·

  ·
  15

• fix(sglang): forward native prompt outputs from Python prefill workers

  backend::sglangexternal-contributionfixsize/L
  #18180·glamr-agent opened Nov 5, 2026Collaborator·1 task·

  ·
  13

• fix(runtime): cancel idle response writers when the TCP reader exits

  external-contributionfixsize/M
  #18179·Mlight7 opened Nov 5, 2026·1 task done·

  ·
  5

• chore(trtllm): [release/1.6.2] raise transformers and fsspec in system site

  backend::trtllmchorecontainersize/M
  #18178·dmitry-tokarev-nv opened Nov 5, 2026Contributor·

  ·
  1

• fix(frontend): preserve response framing while tracking inflight requests

  external-contributionfixfrontendsize/Ltrusted-contributor
  #18177·xianlubird opened Nov 5, 2026Contributor·1 task done·

  ·
  1

  6

• fix(kv-router): credit only the HiCache pages SGLang loads

  backend::sglangdocumentationfixroutersize/L
  #18176·jh-nv opened Nov 5, 2026Contributor·1 task done·

  ·
  1

  8

• test(deploy): report worker restarts in the job log when a deploy test fails

  external-contributionsize/Ltest
  #18173·glamr-agent opened Nov 5, 2026Collaborator·

  ·
  20

• fix(frontend): always send stop_sequence in Anthropic streaming message_delta

  external-contributionfixfrontendsize/M
  #18172·glamr-agent opened Nov 5, 2026Collaborator·

  ·
  8

• fix(trtllm): export additional metrics before the first event

  backend::trtllmfixsize/M
  #18171·yifjiang opened Nov 5, 2026Contributor·1 task done·

  ·
  1

  2

• feat(trtllm): move per-request perf metrics behind --publish-per-request-metrics

  backend::trtllmdocumentationfeatsize/L
  #18170·jh-nv opened Nov 5, 2026Contributor·1 task done·

  ·
  2

• fix(snapshot): honor destination Hugging Face offline policy

  deployment::k8sdocumentationfixsize/L
  #18167·nealvaidya opened Nov 5, 2026Contributor·1 task done·

  ·
  1

  16

• fix(snapshot): refresh destination env from snapshot-restore-proxy

  documentationexternal-contributionfixsize/L
  #18166·nealvaidya opened Nov 5, 2026Contributor·1 task done·

  ·
  1

  20

• fix(sglang): size every Diffusers-fallback text encoder so SDXL starts on SGLang 0.5.23

  backend::sglangexternal-contributionfixsize/L
  #18163·glamr-agent opened Nov 5, 2026Collaborator·

  ·
  10

• feat(global-router): share registrations between discovery instances

  containerfeatsize/XXL
  #18162·atchernych opened Nov 5, 2026Contributor·1 task done·

  ·
  2

• test(global-router): add a multi-cluster Global Discovery deploy test

  actionscontainerdocumentationsize/XXLtest
  #18161·atchernych opened Nov 5, 2026Contributor·1 task·

  ·
  2