Skip to content

Pull requests: vllm-project/vllm

New pull request New
890 Open 10,508 Closed
890 Open 10,508 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Bugfix] Fix PyNcclCommunicator device assertion for un-indexed CUDA devices
#21869 opened Jul 29, 2025 by CarlosArguilar Loading…
4
[DOC] Fix path of v1 related figures documentation Improvements or additions to documentation tpu Related to Google TPUs
#21868 opened Jul 29, 2025 by heheda12345 Loading…
3 of 4 tasks
4
[Perf] Using __nv_fp8_e4m3 instead of c10::e4m3 for per_token_group_quant
#21867 opened Jul 29, 2025 by yewentao256 Loading…
5
[ci] add b200 test ci/build
#21866 opened Jul 29, 2025 by simon-mo Loading…
4 tasks
4
[Performance] Introduce Marlin-based GEMM kernels for the calibration-free RTN-based quantization ci/build
#21865 opened Jul 29, 2025 by sakogan • Draft
7
[BugFix] Fix interleaved sliding window not set for Gemma3n ready ONLY add when PR is ready to merge/full CI is needed
#21863 opened Jul 29, 2025 by sarckk Loading…
3 of 4 tasks
4
[Perf] Parallelize fill_bitmask to accelerate high-throughput guided decoding structured-output v1
#21862 opened Jul 29, 2025 by benchislett Loading…
5
[Test] Add Benchmark and Unit Test for per_token_group_quant performance Performance-related issues
#21860 opened Jul 29, 2025 by yewentao256 Loading…
2
add autotune pass v1
#21859 opened Jul 29, 2025 by wenscarl • Draft
4 tasks
3
[Docs] Update docker.md with HF_TOKEN, new model, and podman fix documentation Improvements or additions to documentation force-merge
#21856 opened Jul 29, 2025 by mgoin Loading…
6
[V0 Deprecation] [P/D] Move kv_connector/v1 to kv_connector (2/2) v1
#21855 opened Jul 29, 2025 by lk-chen Loading…
4 tasks
4
[Performance] Eliminate unnecessary H2D copies in FlashInfer decode v1
#21854 opened Jul 29, 2025 by MatthewBonanni Loading…
3 of 4 tasks
7
[Docs] Improve docs search experience by limiting code block height in search results documentation Improvements or additions to documentation
#21853 opened Jul 29, 2025 by mgoin Loading…
4
[Docs] Switch to better markdown linting pre-commit hook ci/build documentation Improvements or additions to documentation performance Performance-related issues
#21851 opened Jul 29, 2025 by hmellor Loading…
4
Revert "[AMD][CI/Build] Fix the AMD issue caused by inappropriate of symbol exposure (#21647)" ci/build ready ONLY add when PR is ready to merge/full CI is needed rocm Related to AMD ROCm
#21850 opened Jul 29, 2025 by gshtras Loading…
4
[WIP] Add Kimi-Audio integration for vLLM new-model Requests to new models
#21849 opened Jul 29, 2025 by HelloWorldU Loading…
8
[Hardware][CPU] Build fix for ARM without BF16
#21848 opened Jul 29, 2025 by ericcurtin Loading…
4
Migrate MiniCPMOAudioInputs to TensorSchema
#21847 opened Jul 29, 2025 by bbeckca Loading…
3
[Misc] Support more collective_rpc return types v1
#21845 opened Jul 29, 2025 by njhill • Draft
4
Migrate LlavaOnevisionMultiInputs to TensorSchema
#21844 opened Jul 29, 2025 by bbeckca Loading…
4
Migrate LlavaNextVideoPixelInputs to TensorSchema
#21843 opened Jul 29, 2025 by bbeckca Loading…
4
[Bugfix] Fixing bug inside MultiModalProfiler. llama Related to Llama models multi-modality Related to multi-modality (#4194)
#21842 opened Jul 29, 2025 by shenoyvvarun Loading…
7
[Bugfix][PD] set max_completion_tokens=1 if req has this value documentation Improvements or additions to documentation
#21841 opened Jul 29, 2025 by Abirdcfly Loading…
3 of 4 tasks
1
4
[Bugfix] Actually disable processing cache when API server is scaled out frontend ready ONLY add when PR is ready to merge/full CI is needed
#21839 opened Jul 29, 2025 by DarkLight1337 Loading…
1 of 4 tasks
10
[Bugfix] [Performance] DeepEPHighThroughput + DeepSeek : Quant and then Dispatch deepseek Related to DeepSeek models
#21837 opened Jul 29, 2025 by varun-sundar-rabindranath Loading…
6
ProTip! Type g i on any issue or pull request to go back to the issue listing page.