Skip to content

Pinned Loading

  1. vllm vllm Public

    A high-throughput and memory-efficient inference and serving engine for LLMs

    Python 61.2k 10.8k

  2. llm-compressor llm-compressor Public

    Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

    Python 2.2k 269

  3. recipes recipes Public

    Common recipes to run vLLM

    Jupyter Notebook 187 65

Repositories

Showing 10 of 26 repositories
  • vllm-gaudi Public

    Community maintained hardware plugin for vLLM on Intel Gaudi

    vllm-project/vllm-gaudi’s past year of commit activity
    Python 13 Apache-2.0 59 1 69 Updated Oct 28, 2025
  • vllm Public

    A high-throughput and memory-efficient inference and serving engine for LLMs

    vllm-project/vllm’s past year of commit activity
    Python 61,223 Apache-2.0 10,841 1,864 (30 issues need help) 1,212 Updated Oct 28, 2025
  • vllm-project/vllm-project.github.io’s past year of commit activity
    JavaScript 21 35 0 1 Updated Oct 28, 2025
  • vllm-ascend Public

    Community maintained hardware plugin for vLLM on Ascend

    vllm-project/vllm-ascend’s past year of commit activity
    Python 1,265 Apache-2.0 521 612 (8 issues need help) 192 Updated Oct 28, 2025
  • compressed-tensors Public

    A safetensors extension to efficiently store sparse quantized tensors on disk

    vllm-project/compressed-tensors’s past year of commit activity
    Python 182 Apache-2.0 34 5 (1 issue needs help) 12 Updated Oct 28, 2025
  • vllm-spyre Public

    Community maintained hardware plugin for vLLM on Spyre

    vllm-project/vllm-spyre’s past year of commit activity
    Python 37 Apache-2.0 26 6 19 Updated Oct 28, 2025
  • tpu-inference Public

    TPU inference for vLLM, with unified JAX and PyTorch support.

    vllm-project/tpu-inference’s past year of commit activity
    Python 131 Apache-2.0 19 7 (1 issue needs help) 47 Updated Oct 28, 2025
  • aibrix Public

    Cost-efficient and pluggable Infrastructure components for GenAI inference

    vllm-project/aibrix’s past year of commit activity
    Go 4,317 Apache-2.0 476 234 (20 issues need help) 21 Updated Oct 27, 2025
  • ci-infra Public

    This repo hosts code for vLLM CI & Performance Benchmark infrastructure.

    vllm-project/ci-infra’s past year of commit activity
    HCL 23 42 1 20 Updated Oct 28, 2025
  • guidellm Public

    Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs

    vllm-project/guidellm’s past year of commit activity
    Python 665 Apache-2.0 92 82 (5 issues need help) 22 Updated Oct 28, 2025