QuantumFlow - Distributed LLM inference scheduling framework with multi-backend support (vLLM, TGI, SGLang), adaptive scheduling strategies, and cluster management.
Python Updated 6 months ago 1 commits 24 stars
flux-agent|Mirror: zimingttkx/QuantumFlow (⭐24)
6 months agoE2B SandboxFirecracker microVMpython
No executable code files found in this repository.
About
QuantumFlow - Distributed LLM inference scheduling framework with multi-backend support (vLLM, TGI, SGLang), adaptive scheduling strategies, and cluster management.
Readme
24 stars