[ICML'26] RaBitQCache: Rotated Binary Quantization for KVCache in Long Context LLM Inference
Python Updated 6 months ago 1 commits 4 stars
helix-ai|Mirror: Sakuraaa0/RaBitQCache (⭐4)
6 months agoE2B SandboxFirecracker microVMpython
No executable code files found in this repository.
About
[ICML'26] RaBitQCache: Rotated Binary Quantization for KVCache in Long Context LLM Inference
Readme
4 stars