Article
Unbelievable! Run 70B LLM Inference on a Single 4GB GPU with This NEW Technique
lyogavin
• • 50
bjorker
bjorker
AI & ML interests
None yet
Recent Activity
liked a model 3 days ago
mradermacher/LFM2.5-24B-A2B-i1-GGUF liked a model 15 days ago
webAI-Official/TwIL-LM3-Pro liked a model 27 days ago
convaiinnovations/layaOrganizations
None yet
upvoted 2
articles about 2 years ago
Article
Run a Chatgpt-like Chatbot on a Single GPU with ROCm
andyll7772
• • 2