Skip to content
@vllm-project

vLLM

Pinned Loading

  1. vllm vllm Public

    A high-throughput and memory-efficient inference and serving engine for LLMs

    Python 63.9k 11.5k

  2. llm-compressor llm-compressor Public

    Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

    Python 2.3k 292

  3. recipes recipes Public

    Common recipes to run vLLM

    Jupyter Notebook 242 86

Repositories

Showing 10 of 26 repositories
  • tpu-inference Public

    TPU inference for vLLM, with unified JAX and PyTorch support.

    vllm-project/tpu-inference’s past year of commit activity
    Python 167 Apache-2.0 42 16 (1 issue needs help) 55 Updated Nov 25, 2025
  • vllm Public

    A high-throughput and memory-efficient inference and serving engine for LLMs

    vllm-project/vllm’s past year of commit activity
    Python 63,928 Apache-2.0 11,523 1,891 (34 issues need help) 1,241 Updated Nov 25, 2025
  • guidellm Public

    Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs

    vllm-project/guidellm’s past year of commit activity
    Python 720 Apache-2.0 101 41 (3 issues need help) 16 Updated Nov 25, 2025
  • vllm-spyre Public

    Community maintained hardware plugin for vLLM on Spyre

    vllm-project/vllm-spyre’s past year of commit activity
    Python 37 Apache-2.0 28 5 14 Updated Nov 25, 2025
  • llm-compressor Public

    Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

    vllm-project/llm-compressor’s past year of commit activity
    Python 2,270 Apache-2.0 292 73 (12 issues need help) 44 Updated Nov 26, 2025
  • ci-infra Public

    This repo hosts code for vLLM CI & Performance Benchmark infrastructure.

    vllm-project/ci-infra’s past year of commit activity
    HCL 26 Apache-2.0 46 0 23 Updated Nov 26, 2025
  • vllm-gaudi Public

    Community maintained hardware plugin for vLLM on Intel Gaudi

    vllm-project/vllm-gaudi’s past year of commit activity
    Python 17 Apache-2.0 72 1 63 Updated Nov 26, 2025
  • vllm-ascend Public

    Community maintained hardware plugin for vLLM on Ascend

    vllm-project/vllm-ascend’s past year of commit activity
    Python 1,386 Apache-2.0 599 732 (8 issues need help) 230 Updated Nov 25, 2025
  • aibrix Public

    Cost-efficient and pluggable Infrastructure components for GenAI inference

    vllm-project/aibrix’s past year of commit activity
    Go 4,434 Apache-2.0 487 248 (20 issues need help) 23 Updated Nov 25, 2025
  • semantic-router Public

    Intelligent Router for Mixture-of-Models

    vllm-project/semantic-router’s past year of commit activity
    Rust 2,330 Apache-2.0 297 111 (28 issues need help) 35 Updated Nov 25, 2025
View all repositories

Sponsors

  • @hippoley
  • @kXborg
  • @bgyukim
  • @G-Research-OSS
  • @kevATin
  • @yankay
  • @brickfrog
  • @GabrielBianconi
  • @imkero
  • @comet-ml
  • @thomas-hiddenpeak
  • @terrytangyuan
  • Private Sponsor
View all