simaai/Phi-4-mini-instruct-Autoround-Safetensors
Text Generation • 4B • Updated • 79
Pre-Quantized Models
Pre-quantized safetensor models (GPTQ/AutoRound) and their optimization scripts, ready to be compiled for SiMa.ai hardware.
-
-
simaai/Gemma-2-2B-it-Autoround-Safetensors
Text Generation • 3B • Updated • 109 -
simaai/Gemma-3-1B-it-GPTQ-Safetensors
Text Generation • 1B • Updated • 42 -
simaai/LFM2-1.2B-Autoround-Safetensors
Text Generation • 1B • Updated • 67 -
simaai/LFM2-2.6B-Autoround-Safetensors
Text Generation • 3B • Updated • 71 -
simaai/LFM2.5-1.2B-Instruct-Autoround-Safetensors
Text Generation • 1B • Updated • 73 -
simaai/LFM2.5-1.2B-Thinking-Autoround-Safetensors
Text Generation • 1B • Updated • 70 -
simaai/Llama-2-7B-chat-hf-GPTQ-Safetensors
Text Generation • 7B • Updated • 23 -
simaai/Llama-3.1-8B-Instruct-GPTQ-Safetensors
Text Generation • 8B • Updated • 24 -
simaai/Llama-3.2-3B-Instruct-Autoround-Safetensors
Text Generation • 4B • Updated • 92 -
simaai/Mistral-7B-Instruct-v0.3-Autoround-Safetensors
Text Generation • 7B • Updated • 82 -
simaai/Phi-3.5-mini-instruct-Autoround-Safetensors
Text Generation • 4B • Updated • 91 -
simaai/Qwen2.5-0.5B-Instruct-Autoround-Safetensors
Text Generation • 0.6B • Updated • 109 -
simaai/Qwen2.5-1.5B-Instruct-Autoround-Safetensors
Text Generation • 2B • Updated • 112 -
simaai/Qwen2.5-3B-Instruct-Autoround-Safetensors
Text Generation • 3B • Updated • 110 -
simaai/Qwen2.5-7B-Instruct-Autoround-Safetensors
Text Generation • 8B • Updated • 126 -
simaai/Qwen3-0.6B-Autoround-Safetensors
Text Generation • 0.8B • Updated • 90 -
simaai/Qwen3-1.7B-GPTQ-Safetensors
Text Generation • 2B • Updated • 18 -
simaai/Qwen3-4B-Autoround-Safetensors
Text Generation • 4B • Updated • 104 -
simaai/Qwen3-4B-Instruct-2507-GPTQ-Safetensors
Text Generation • 4B • Updated • 9 -
simaai/Qwen3-8B-GPTQ-Safetensors
Text Generation • 8B • Updated • 15 -
simaai/Gemma-4-E2B-it-GPTQ-Safetensors
Any-to-Any • 6B • Updated • 24 -
simaai/Gemma-4-E2B-it-TextOnly-GPTQ-Safetensors
Text Generation • 5B • Updated • 83 -
simaai/Gemma-4-E4B-it-GPTQ-Safetensors
Any-to-Any • 9B • Updated • 24 -
simaai/Gemma-4-E4B-it-TextOnly-GPTQ-Safetensors
Text Generation • 8B • Updated • 41 -
simaai/Gemma3-SigLIP448-GPTQ-Safetensors
Image-Text-to-Text • 3B • Updated • 9 -
simaai/LFM2-VL-1.6B-Autoround-Safetensors
Image-Text-to-Text • 2B • Updated • 11 -
simaai/LFM2-VL-3B-Autoround-Safetensors
Image-Text-to-Text • 3B • Updated • 4 -
simaai/LFM2-VL-450M-Autoround-Safetensors
Image-Text-to-Text • 0.5B • Updated • 5 -
simaai/LFM2.5-VL-1.6B-Autoround-Safetensors
Image-Text-to-Text • 2B • Updated • 8 -
simaai/LFM2.5-VL-450M-Autoround-Safetensors
Image-Text-to-Text • 0.5B • Updated • 15 -
simaai/Qwen2.5-VL-3B-Instruct-GPTQ-Safetensors
Image-Text-to-Text • 3B • Updated • 14 -
simaai/Qwen3-VL-2B-Instruct-GPTQ-Safetensors
Image-Text-to-Text • 2B • Updated • 17 -
simaai/Qwen3-VL-4B-Instruct-Autoround-Safetensors
Image-Text-to-Text • 5B • Updated • 13 -
simaai/Qwen3-VL-8B-Instruct-GPTQ-Safetensors
Image-Text-to-Text • 9B • Updated • 21 -
simaai/Llama-3.1-Swallow-8B-Instruct-v0.5-GPTQ-Safetensors
Text Generation • 8B • Updated • 12
simaai/Qwen2.5-VL-7B-Instruct-GPTQ-Safetensors
Image-Text-to-Text • 5B • Updated • 18Note Qwen2.5-VL-7B-Instruct: GPTQ INT4/G256 text decoder and lm_head, GPTQ INT8 per-channel vision stack.