Skip to content
@sgl-project

sgl-project

Pinned Loading

  1. sglang sglang Public

    SGLang is a fast serving framework for large language models and vision language models.

    Python 19k 3.1k

  2. sgl-learning-materials sgl-learning-materials Public

    Materials for learning SGLang

    612 48

  3. ome ome Public

    OME is a Kubernetes operator for enterprise-grade management and serving of Large Language Models (LLMs)

    Go 291 43

  4. genai-bench genai-bench Public

    Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serving systems.

    Python 219 25

  5. SpecForge SpecForge Public

    Train speculative decoding models effortlessly and port them smoothly to SGLang serving.

    Python 429 94

  6. sglang-jax sglang-jax Public

    JAX backend for SGL

    Python 77 17

Repositories

Showing 10 of 19 repositories

Top languages

Loading…

Most used topics

Loading…