sglang

sglang

17388
2762

SGLang is a fast serving framework for large language models and vision language models.

Community

GitHub

Languages

Python
75.3%
Rust
10.3%
C++
7%
Cuda
6.9%
Shell
0.3%
CMake
0.2%

Good First Issues

Ideal for first-time contributors

All Issues

Browse every open issue in this repository

README.md