sglang

sglang

15719
2266

SGLang is a fast serving framework for large language models and vision language models.

Community

GitHub

Languages

Python
82.3%
Cuda
6.9%
C++
6.7%
Rust
3.7%
CMake
0.2%
Shell
0.2%

README.md

Good First Issues

Ideal for first-time contributors

All Issues

Browse every open issue in this repository