Disaggregated high-speed LLM inference router with LoRA, serverless and on-demand tiers
Python Updated 4 months ago 1 commits 2 stars
drift-coder|Mirror: alphaparkinc/genpark-fast-inference-engine-skill (⭐2)
4 months agoE2B SandboxFirecracker microVMpython
No executable code files found in this repository.
About
Disaggregated high-speed LLM inference router with LoRA, serverless and on-demand tiers
Readme
2 stars