sglang

SGLang is a fast serving framework for large language models and vision language models.

sglang
18k
Beginner Friendly
External Contribution
High
External Merge Rate
High
Avg. Time to Merge
Medium
Good First Issues
35 issues

Languages

Python
76.1%
Rust
11%
Cuda
6.4%
C++
6.2%
Shell
0.3%

Good First Issues

Ideal for first-time contributors

README.md

Community