All pull requests

Pull requests

• feat(frontend): refuse media before routing for text-only models

  documentationfeatfrontendsize/XL
  #17874·biswapanda opened Nov 2, 2026Contributor·

  ·
  1

  2

• fix(vllm): release prefill KV when decode rejects before admission

  backend::vllmfixsize/L
  #17873·nnshah1 opened Nov 2, 2026Contributor·1 task done·

  ·
  1

• fix(vllm): abort disaggregated decode immediately on client cancellation

  backend::vllmfixsize/XL
  #17871·nnshah1 opened Nov 2, 2026Contributor·1 task done·

  ·
  1

  2

• docs(kubernetes): profile one replica with a per-pod Nsight tag

  docsdocumentationexternal-contributionsize/M
  #17869·nv-yna opened Nov 2, 2026Contributor·

  ·
  8

• fix(sidecar): publish structural tags from the vLLM sidecar on vLLM 0.33+

  documentationfixsize/M
  #17866·JulienDarve opened Nov 2, 2026Contributor·1 task done·

  ·
  3

• perf(sidecar): default to 32 gRPC connections to the engine

  perfsize/S
  #17864·jthomson04 opened Nov 2, 2026Contributor·

  ·
  2

• fix(mocker): omit TRT-LLM token strings the real servicer leaves empty

  fixsize/L
  #17863·jthomson04 opened Nov 2, 2026Contributor·

  ·
  7

• build(vllm): bump core to v0.33.0

  backend::vllmbuildcontainerdocumentationfrontendsize/L
  #17862·JulienDarve opened Nov 2, 2026Contributor·1/2·1 task done·

  ·
  5

• feat(global-planner): order pair partners by pool priority

  documentationfeatplannersize/L
  #17860·sachalmalick opened Nov 2, 2026Contributor·2/4·

  ·
  3

• feat(global-planner): add pool priority model and resolver

  documentationfeatplannersize/XL
  #17859·sachalmalick opened Nov 2, 2026Contributor·1/4·

  ·
  3

• test(deploy): fail fast on failed checkpoint capture and keep retry logs DD_VLZ8CH

  external-contributionsize/Mtest
  #17858·glamr-agent opened Nov 2, 2026Collaborator·

  ·
  19

• refactor(epp): select through the router stack's plan interface

  documentationfrontendrefactorroutersize/XXL
  #17857·GuanLuo opened Nov 2, 2026Contributor·1 task·

  ·
  1

• feat(mocker): attach KVCR fetch hints from the KV router in offline replay

  documentationfeatroutersize/XL
  #17856·dreamtalen opened Nov 2, 2026Contributor·1 task done·

  ·
  20

• docs(sidecar): add backend support matrix

  docsdocumentationsize/M
  #17855·tanmayv25 opened Nov 2, 2026Contributor·1 task done·

  ·
  5

• perf(runtime): lower the Velo response batch window default to 2 ms

  perfsize/XS
  #17854·jthomson04 opened Nov 2, 2026Contributor·1 task done·

  ·
  2

• fix(vllm): preserve self-benchmark prefixes on vLLM 0.33

  backend::vllmfixsize/L
  #17853·tedzhouhk opened Nov 2, 2026Contributor·2/2·1 task done·

  ·
  1

  2

• chore(deps): bump Grove to v0.2.0-beta1

  actionschoredeployment::k8sdocumentationsize/L
  #17851·julienmancuso opened Nov 2, 2026Contributor·

  ·
  15

• perf(sglang): validate token IDs without a per-token Python loop

  backend::sglangexternal-contributionperfsize/L
  #17850·jacobhinkle opened Nov 2, 2026·1 task·

  ·
  1

  3

• feat(router): add group_priority request classifier for RL rollout groups

  documentationexternal-contributionfeatfrontendsize/XL
  #17845·ShaneGZhu opened Nov 2, 2026Contributor·1 task done·

  ·
  1

  2

• docs: add MatrixHub ModelExpress P2P article to external publications

  docsdocumentationexternal-contributionsize/XStrusted-contributor
  #17843·carlory opened Nov 2, 2026Contributor·1 task done·

  ·
  1

  5

• test(vllm): verify pinned native contracts and preflight bounds

  backend::vllmsize/XXLtest
  #17841·biswapanda opened Nov 2, 2026Contributor·

  ·
  1

• test(vllm): validate native read execution and cancellation

  backend::vllmsize/XXLtest
  #17840·biswapanda opened Nov 2, 2026Contributor·

  ·
  1

• test(vllm): validate native head qualification and execution

  backend::vllmsize/XLtest
  #17839·biswapanda opened Nov 2, 2026Contributor·

  ·
  1

• test(vllm): complete pinned native CPU fixture owners

  backend::vllmdocumentationsize/XXLtest
  #17838·biswapanda opened Nov 2, 2026Contributor·

  ·
  1

• test(vllm): pin released native decision strategy source

  actionsbackend::vllmsize/XXLtest
  #17837·biswapanda opened Nov 2, 2026Contributor·

  ·
  1