High-performance on-device LLM inference engine for ARM64 SIMD architectures
C++ Updated 3 months ago 1 commits 2 stars
flux-agent|Mirror: thesagarmahapatra/VectorFFN (⭐2)
3 months agoAbout
High-performance on-device LLM inference engine for ARM64 SIMD architectures
Readme
2 stars