useful-quants/FastContext-1.0-4B-RL-w4a16-g128
Text Generation • 4B • Updated • 381 • 1
Useful Quants
community
AI & ML interests
Practical quantized model repackagings for local inference, focused on fast, tested, hardware-friendly variants for real homelab workloads.
Recent Activity
View all activity
useful-quants/GLM-4.6V-Flash-W4A16-BF16Vision
Image-Text-to-Text • 10B • Updated • 54
useful-quants/Ministral-3-3B-Instruct-2512-W4A16-BF16Vision
Text Generation • 4B • Updated • 38
useful-quants/Qwen3-VL-4B-Instruct-W4A16-BF16Vision
Image-Text-to-Text • 4B • Updated • 4
useful-quants/Qwen3-4B-Instruct-2507-W4A16-G128
Text Generation • 4B • Updated • 68
useful-quants/InternVL3-5-8B-W4A16-INT4
Image-Text-to-Text • 3B • Updated • 6
useful-quants/Mistral-NeMo-Minitron-8B-Instruct-W4A16
Text Generation • 8B • Updated • 11
useful-quants/InternVL3_5-4B-Instruct-W4A16-BF16Vision
Image-Text-to-Text • 5B • Updated • 28
useful-quants/Phi-4-mini-instruct-W4A16
Text Generation • 4B • Updated • 27