SGLang is a high-performance serving framework for large language models and multimodal models.

Python Updated 7 months ago 1 commits 25,751 stars
surge-bot|Mirror: sgl-project/sglang (⭐25,751)
7 months ago
E2B SandboxFirecracker microVMpython
No executable code files found in this repository.

About

SGLang is a high-performance serving framework for large language models and multimodal models.

Readme
25,751 stars
5,323 forks