All pull requests

Pull requests

• build: Uninstall pdfkit pip package from SDK image

  Build
  #9045·mc-nv opened Oct 29, 2026Contributor·7 of 20 tasks·

  ·
  1

  

• test: Raise S3 server timeout in L0_backend_python env test

  #9036·devin-ai-integration[bot] opened Oct 23, 2026Bot·6 of 10 tasks·

  ·
  1

• ci: Prebuild TensorRT image plans in QA model generation

  CI/CD
  #9030·mc-nv opened Oct 21, 2026Contributor·7 of 20 tasks·

  ·
  

• docs: Publish latency histograms instead of summary quantiles

  #9028·iis-MarkKuang opened Oct 20, 2026·4 tasks done·

  ·
  1

  12

• Mchornyi/tri 2028/poc llm api python backend

  #9023·mc-nv opened Oct 16, 2026Contributor·

  ·
  3

• feat: Add a memory budget for parsing HTTP JSON requests

  #9020·akhilraj9 opened Oct 15, 2026Contributor·8 of 20 tasks·

  ·
  5

• ci: Ship trtexec in the QA image when built on an inference-runtime base

  #9014·devin-ai-integration[bot] opened Oct 12, 2026Bot·7 of 20 tasks·

  ·
  15

• ci: copy TensorRT tools into the QA image from cibase

  #9005·devin-ai-integration[bot] opened Oct 8, 2026Bot·7 of 10 tasks·

  ·
  1

• fix: Preserve generate model error status

  #9002·amarrtech opened Oct 8, 2026·7 of 22 tasks·

  ·
  1

  4

• fix: avg_time_queue_us under-reports queue time in k8s-onprem autoscaling rule

  #8995·100-JM opened Oct 3, 2026·

  ·
  1

  1

• fix: Preserve gRPC trace metadata length

  #8987·amarrtech opened Sep 29, 2026·10 of 22 tasks·

  ·
  3

• fix: Cancel HTTP inference requests when the client disconnects

  #8982·LiRunGuo opened Sep 21, 2026·9 of 13 tasks·

  ·

• fix: Weight autoscaling queue time by request count

  #8980·waynehacking8 opened Sep 20, 2026·7 of 13 tasks·

  ·
  1

  3

• test: reduce ensemble backpressure test load to 8 streams x 4 responses

  #8972·akhilraj9 opened Sep 14, 2026Contributor·9 of 11 tasks·

  ·
  5

• docs: add Nebius Serverless HTTP deployment example

  #8971·SalikovAlex opened Sep 12, 2026·9 of 12 tasks·

  ·
  2

• fix: support text batches in OpenAI embeddings

  #8961·SamJSui opened Sep 9, 2026·9 of 12 tasks·

  ·
  2

• build: replace the third_party superbuild with Conan-resolved dependencies

  #8960·mc-nv opened Sep 8, 2026Contributor·2 of 5 tasks·

  ·

• feat: add completion queue sharding for gRPC inference (unary and streaming)

  #8959·akhilraj9 opened Sep 4, 2026Contributor·10 of 11 tasks·

  ·
  15

• test: Convert L0_simple_go_client to pytest

  fixtesting
  #8943·mc-nv opened Aug 28, 2026Contributor·11 of 20 tasks·

  ·
  1

  

• feat(openai): add ProductionDebtServingGate and TechnicalDueDiligenceLedger

  #8930·AAH20 opened Aug 18, 2026·

  ·
  4

• improve(Build): Add build script capabilities

  #8926·jcuquemelle opened Aug 10, 2026·9 of 22 tasks·

  ·
  24

• test: replace blind time.sleep(5) with polling in L0_lifecycle

  #8920·Moyummmm opened Aug 6, 2026·6 tasks done·

  ·
  1

  2

• Forward HTTP headers to /generate endpoint (Fixes #8790)

  #8916·92subrata opened Aug 3, 2026·

  ·
  1

  6

• test: Add Python custom metrics reload regression

  #8892·goanpeca opened Jul 20, 2026·

  ·

• draft: update server status test

  #8849·mattwittwer opened Jun 23, 2026Contributor·20 tasks·

  ·