Skip to content

Issues: vllm-project/vllm

[Roadmap] vLLM Roadmap Q1 2025
#11862 opened Jan 8, 2025 by simon-mo
Open 5
[V1] Feedback Thread
#12568 opened Jan 30, 2025 by simon-mo
Open 44
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

1,297 Open 5,357 Closed
1,297 Open 5,357 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[Bug]: Guided Decoding (structured json outputs) not generating proper outputs. bug Something isn't working
#13683 opened Feb 21, 2025 by venkatchel
1 task done
[Bug]: Speculative Decoding doesn't work with Ray compiled DAG and SPMD bug Something isn't working
#13682 opened Feb 21, 2025 by tczekajlo
1 task done
[Usage]: How to use a custom model with LLM without HuggingFace usage How to use vllm
#13680 opened Feb 21, 2025 by henrycharlesworth
1 task done
[Feature]: Support for LoRA for Pooling Models feature request
#13679 opened Feb 21, 2025 by ashwani-bhat
1 task done
[Bug]: bug Something isn't working
#13678 opened Feb 21, 2025 by tlrmchlsmth
1 task done
@tlrmchlsmth
1
[Bug]: Errors Encountered While Running Qwen/Qwen2.5-VL-72B-AWQ Inference on 8x24G的4090 GPUs bug Something isn't working
#13677 opened Feb 21, 2025 by moshilangzi
1 task done
[Bug]: Error while running Deepseek-R1: vllm.engine.async_llm_engine.AsyncEngineDeadError: Task finished unexpectedly. bug Something isn't working
#13676 opened Feb 21, 2025 by Wats0ns
1 task done
[Bug]: "ImportError: Please install vllm[audio] for audio support" while running whisper with '--task=transcription' bug Something isn't working
#13675 opened Feb 21, 2025 by IanZhengruShen
1 task done
[Bug]: Running ROCm support v1 vLLM Arch triggers ERROR_MEMORY_APERTURE_VIOLATION bug Something isn't working
#13674 opened Feb 21, 2025 by tjtanaa
1 task done
[Bug]: [V1][SpecDec] RuntimeError: CUDA error: an illegal memory access was encountered bug Something isn't working
#13673 opened Feb 21, 2025 by lbeisteiner
1 task done
[Bug]:vLLM 0.6.3 generate_sequences Randomly Hangs After 1-2 Steps When trying to Implement Tool Calling with Logits Processors bug Something isn't working
#13671 opened Feb 21, 2025 by AIBionics
1 task done
1
[Usage]: vllm: error: unrecognized arguments: --lora-path usage How to use vllm
#13669 opened Feb 21, 2025 by imrankh46
1 task done
2
[Feature]: deepseek gguf support feature request
#13665 opened Feb 21, 2025 by vip-china
1 task done
[New Model]: Google SigLip 2 good first issue Good for newcomers help wanted Extra attention is needed new model Requests to new models
#13663 opened Feb 21, 2025 by tranhoangnguyen03
1 task done
1
[Feature]: Can it support avx cpu's like xeon E5-2670v2 feature request
#13662 opened Feb 21, 2025 by asdfgh129
1 task done
[Bug]: how to use cuda graph on vllm bug Something isn't working
#13661 opened Feb 21, 2025 by ziang663
1 task done
[Installation]:Error while deploying Deepseek-R1 671B with AMD 8xMi300x installation Installation problems
#13659 opened Feb 21, 2025 by Bihan
1 task done
[Bug]: When deploying the Qwen2.5-VL-3B service, some image requests return errors. bug Something isn't working
#13657 opened Feb 21, 2025 by lijingcheng2021
1 task done
[Bug]: v0.7.3 can't work on wsl-ubuntu mirrored network bug Something isn't working
#13656 opened Feb 21, 2025 by engchina
1 task done
1
[Bug]: Qwen2.5 VL Internal Server Error bug Something isn't working
#13655 opened Feb 21, 2025 by heibaidaolx123
1 task done
8
[Installation]: Two CPU-only hosts installed. installation Installation problems
#13654 opened Feb 21, 2025 by grglym
1 task done
[Usage]: What normalization is applied in LLM.embed function. Can we create our own? usage How to use vllm
#13652 opened Feb 21, 2025 by ashwani-bhat
1 task done
12
[Bug]: 启动qwen2.5-vl系列的时候为啥老是卡着 bug Something isn't working
#13651 opened Feb 21, 2025 by lijingcheng2021
1 task done
1
[Bug]: [ROCM] _sdpa_attention() takes from 8 to 9 positional arguments but 10 were given bug Something isn't working
#13648 opened Feb 21, 2025 by gongdao123
1 task done
2
[Bug]: Errors Encountered While Running Qwen2.5-VL-72B-AWQ Inference on 2xA800 GPUs (Works Fine with Qwen2-VL-72B-AWQ) bug Something isn't working
#13640 opened Feb 21, 2025 by moqimoqidea
3 tasks done
2
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.