Skip to content

Pinned Loading

  1. vllm vllm Public

    A high-throughput and memory-efficient inference and serving engine for LLMs

    Python 57.3k 9.9k

  2. llm-compressor llm-compressor Public

    Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

    Python 1.9k 221

  3. recipes recipes Public

    Common recipes to run vLLM

    123 35

Repositories

Showing 10 of 22 repositories
  • vllm Public

    A high-throughput and memory-efficient inference and serving engine for LLMs

    vllm-project/vllm’s past year of commit activity
    Python 57,301 Apache-2.0 9,932 1,815 (28 issues need help) 1,138 Updated Sep 6, 2025
  • vllm-project/vllm-project.github.io’s past year of commit activity
    HTML 17 24 0 3 Updated Sep 6, 2025
  • aibrix Public

    Cost-efficient and pluggable Infrastructure components for GenAI inference

    vllm-project/aibrix’s past year of commit activity
    Go 4,198 Apache-2.0 452 220 (22 issues need help) 20 Updated Sep 5, 2025
  • semantic-router Public

    Intelligent Mixture-of-Models Router for Efficient LLM Inference

    vllm-project/semantic-router’s past year of commit activity
    Python 683 Apache-2.0 56 28 4 Updated Sep 6, 2025
  • production-stack Public

    vLLM’s reference system for K8S-native cluster-wide deployment with community-driven performance optimization

    vllm-project/production-stack’s past year of commit activity
    Python 1,750 Apache-2.0 278 75 (3 issues need help) 49 Updated Sep 6, 2025
  • vllm-spyre Public

    Community maintained hardware plugin for vLLM on Spyre

    vllm-project/vllm-spyre’s past year of commit activity
    Python 32 Apache-2.0 21 5 19 Updated Sep 6, 2025
  • recipes Public

    Common recipes to run vLLM

    vllm-project/recipes’s past year of commit activity
    123 Apache-2.0 35 3 2 Updated Sep 5, 2025
  • ci-infra Public

    This repo hosts code for vLLM CI & Performance Benchmark infrastructure.

    vllm-project/ci-infra’s past year of commit activity
    HCL 18 36 0 10 Updated Sep 6, 2025
  • llm-compressor Public

    Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

    vllm-project/llm-compressor’s past year of commit activity
    Python 1,909 Apache-2.0 221 51 (7 issues need help) 43 Updated Sep 5, 2025
  • guidellm Public

    Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs

    vllm-project/guidellm’s past year of commit activity
    Python 558 Apache-2.0 75 62 (5 issues need help) 26 Updated Sep 5, 2025