Search results

[Bug] how to use hicache l2(dram) to muti host(muti inference instances ,not pd ) share kvcache offload ?

Status: Open.

#31505 In sgl-project/sglang;

· yiminghub2024 opened on Jul 17, 2026

[Proposal] Fuse static FP8 activation quantization into producer kernels (norm / activation / allreduce epilogue)

Status: Open.

#31504 In sgl-project/sglang;

· YAMY1234 opened on Jul 17, 2026

[Bug] GSM8K accuracy regression on DeepSeek-V4-Flash-FP8 (dp8ep8, gfx950) traced to #29275 "Fix gfx95 bpreshuffle FP8 activation scale layout"

Status: Open.

#31490 In sgl-project/sglang;

· Lzy17 opened on Jul 16, 2026

[Bug] DeepSeek-V4 PD HiSparse shows lower accuracy on GPQA and SWE-Bench

Status: Open.

#31482 In sgl-project/sglang;

· jackyYang6 opened on Jul 16, 2026

[Bug] SGLANG_SHARED_EXPERT_TP1=1 corrupts output (R + ep_size·S) when the post-experts all-reduce is skipped (EP + dp-attention reduce-scatterv)

Status: Open.

#31475 In sgl-project/sglang;

· stevewx opened on Jul 16, 2026

Optimistic prefill can reach a cross-stage capacity stall

Status: Open.

#31473 In sgl-project/sglang;

· N3u0ns opened on Jul 16, 2026

[Bug] Model Gateway silently rewrites MCP tool_choice="required" to "auto"

Status: Open.

#31459 In sgl-project/sglang;

· OnlyMyRailgun opened on Jul 16, 2026

[Feature] RFC: SGLang KV Indexer for Distributed KV Cache Placement Metadata

Status: Open.

#31458 In sgl-project/sglang;

· wuyl1 opened on Jul 16, 2026

UnifiedRadixCache: extra-pool prefetch lifecycle missing on abort (segfault under timeout policy)

Status: Open.

#31445 In sgl-project/sglang;

· flymysql opened on Jul 16, 2026

[Perf] Speed up HiCache host buffer allocation: use MAP_PRIVATE + madvise instead of MAP_SHARED | MAP_POPULATE

Status: Open.

#31424 In sgl-project/sglang;

· DellCurry opened on Jul 16, 2026

[Bug] [OpenAI-compat] HTTP server does not validate 'model' field per OpenAI spec

Status: Open.

#31404 In sgl-project/sglang;

· aprilpear opened on Jul 16, 2026

[Bug] glm5.2 tep dp=2 cause speculative eagle error

Status: Open.

#31384 In sgl-project/sglang;

· rfyiamcool opened on Jul 16, 2026