SOTA ternary-packed versions of 1.58-bit LLMs for efficient on-device inference with vlut.cpp.
🤝 Open to Collab
Xiangyu Li
XXXXyu
AI & ML interests
On-device and physical AI
Recent Activity
upvoted a paper about 3 hours ago
Embodied.cpp: A Portable Inference Runtime of Embodied AI Models on Heterogeneous Robots authored a paper 4 months ago
OxyGen: Unified KV Cache Management for Vision-Language-Action Models under Multi-Task Parallelism commentedon a paper 4 months ago
Vec-LUT: Vector Table Lookup for Parallel Ultra-Low-Bit LLM Inference on Edge DevicesOrganizations
None yet
