Multi-backend quantized model loader supporting GGUF & EXL2 (Oobabooga style)

Python Updated 3 months ago 1 commits 8 stars
axiom-bot|Mirror: alphaparkinc/genpark-multi-backend-quantized-model-loader-playground-skill (⭐8)
3 months ago
E2B SandboxFirecracker microVMpython
No executable code files found in this repository.

About

Multi-backend quantized model loader supporting GGUF & EXL2 (Oobabooga style)

Readme
8 stars