Gemma4
axteam's Gemma 4 quantizations — FP8 dynamic, AWQ INT4/INT8, NVFP4 (W4A4 & W4A16), and GGUF — for 12B-it, E4B-it, 26B-A4B(+it), 31B(+it).
Image-Text-to-Text • 12B • Updated • 234 • 4Note gemma-4-12B-it · FP8 dynamic (W8A8) — near-lossless; Hopper/Ada/Blackwell
axteam/gemma-4-12B-it-AWQ-8bit
Image-Text-to-Text • 12B • Updated • 236 • 4Note gemma-4-12B-it · AWQ W8A16 INT8 — near-lossless
axteam/gemma-4-12B-it-AWQ-4bit
Image-Text-to-Text • 12B • Updated • 449 • 2Note gemma-4-12B-it · AWQ W4A16 INT4 — ~1/4 size
axteam/gemma-4-12B-it-NVFP4A16
Image-Text-to-Text • 12B • Updated • 245 • 1Note gemma-4-12B-it · NVFP4 W4A16 (FP4 weights, BF16 activations) — best 4-bit quality
axteam/gemma-4-12B-it-NVFP4
Image-Text-to-Text • 12B • Updated • 294 • 2Note gemma-4-12B-it · NVFP4 W4A4 (FP4 weights + activations) — fastest on Blackwell
axteam/gemma-4-12B-it-GGUF
Text Generation • 12B • Updated • 2.94k • 2Note gemma-4-12B-it · GGUF (Q4_K_M / Q8_0 / BF16) for llama.cpp / Ollama
axteam/gemma-4-E4B-it-FP8-dynamic
Image-Text-to-Text • 8B • Updated • 348 • 4Note gemma-4-E4B-it · FP8 dynamic (W8A8) — near-lossless; Hopper/Ada/Blackwell
axteam/gemma-4-E4B-it-AWQ-8bit
Image-Text-to-Text • 8B • Updated • 299 • 3Note gemma-4-E4B-it · AWQ W8A16 INT8 — near-lossless
axteam/gemma-4-E4B-it-AWQ-4bit
Image-Text-to-Text • 8B • Updated • 288 • 2Note gemma-4-E4B-it · AWQ W4A16 INT4 — ~1/4 size
axteam/gemma-4-E4B-it-NVFP4A16
Image-Text-to-Text • 8B • Updated • 279 • 3Note gemma-4-E4B-it · NVFP4 W4A16 (FP4 weights, BF16 activations) — best 4-bit quality
axteam/gemma-4-E4B-it-NVFP4
Image-Text-to-Text • 8B • Updated • 342 • 4Note gemma-4-E4B-it · NVFP4 W4A4 (FP4 weights + activations) — fastest on Blackwell
axteam/gemma-4-E4B-it-GGUF
Text Generation • 8B • Updated • 2.62k • 5Note gemma-4-E4B-it · GGUF (Q4_K_M / Q8_0 / BF16) for llama.cpp / Ollama
axteam/gemma-4-26B-A4B-FP8-dynamic
Image-Text-to-Text • 26B • Updated • 257 • 2Note gemma-4-26B-A4B · FP8 dynamic (W8A8) — near-lossless; Hopper/Ada/Blackwell
axteam/gemma-4-26B-A4B-AWQ-8bit
Image-Text-to-Text • 9B • Updated • 190 • 1Note gemma-4-26B-A4B · AWQ W8A16 INT8 — near-lossless
axteam/gemma-4-26B-A4B-AWQ-4bit
Image-Text-to-Text • 26B • Updated • 271 • 2Note gemma-4-26B-A4B · AWQ W4A16 INT4 — ~1/4 size
axteam/gemma-4-26B-A4B-NVFP4A16
Image-Text-to-Text • 26B • Updated • 204 • 1Note gemma-4-26B-A4B · NVFP4 W4A16 (FP4 weights, BF16 activations) — best 4-bit quality
axteam/gemma-4-26B-A4B-NVFP4
Image-Text-to-Text • 26B • Updated • 199 • 1Note gemma-4-26B-A4B · NVFP4 W4A4 (FP4 weights + activations) — fastest on Blackwell
axteam/gemma-4-26B-A4B-GGUF
Text Generation • 25B • Updated • 1.91k • 2Note gemma-4-26B-A4B · GGUF (Q4_K_M / Q8_0 / BF16) for llama.cpp / Ollama
axteam/gemma-4-26B-A4B-it-FP8-dynamic
Image-Text-to-Text • 26B • Updated • 218 • 1Note gemma-4-26B-A4B-it · FP8 dynamic (W8A8) — near-lossless; Hopper/Ada/Blackwell
axteam/gemma-4-26B-A4B-it-AWQ-8bit
Image-Text-to-Text • 9B • Updated • 189 • 1Note gemma-4-26B-A4B-it · AWQ W8A16 INT8 — near-lossless
axteam/gemma-4-26B-A4B-it-AWQ-4bit
Image-Text-to-Text • 26B • Updated • 682 • 2Note gemma-4-26B-A4B-it · AWQ W4A16 INT4 — ~1/4 size
axteam/gemma-4-26B-A4B-it-NVFP4A16
Image-Text-to-Text • 26B • Updated • 345 • 4Note gemma-4-26B-A4B-it · NVFP4 W4A16 (FP4 weights, BF16 activations) — best 4-bit quality
axteam/gemma-4-26B-A4B-it-NVFP4
Image-Text-to-Text • 26B • Updated • 250 • 2Note gemma-4-26B-A4B-it · NVFP4 W4A4 (FP4 weights + activations) — fastest on Blackwell
axteam/gemma-4-26B-A4B-it-GGUF
Text Generation • 25B • Updated • 2.7k • 4Note gemma-4-26B-A4B-it · GGUF (Q4_K_M / Q8_0 / BF16) for llama.cpp / Ollama
axteam/gemma-4-31B-FP8-dynamic
Image-Text-to-Text • 31B • Updated • 312 • 2Note gemma-4-31B · FP8 dynamic (W8A8) — near-lossless; Hopper/Ada/Blackwell
axteam/gemma-4-31B-AWQ-8bit
Image-Text-to-Text • 10B • Updated • 309 • 3Note gemma-4-31B · AWQ W8A16 INT8 — near-lossless
axteam/gemma-4-31B-AWQ-4bit
Image-Text-to-Text • 7B • Updated • 247 • 2Note gemma-4-31B · AWQ W4A16 INT4 — ~1/4 size
axteam/gemma-4-31B-NVFP4A16
Image-Text-to-Text • 18B • Updated • 269 • 2Note gemma-4-31B · NVFP4 W4A16 (FP4 weights, BF16 activations) — best 4-bit quality
axteam/gemma-4-31B-NVFP4
Image-Text-to-Text • 18B • Updated • 331 • 2Note gemma-4-31B · NVFP4 W4A4 (FP4 weights + activations) — fastest on Blackwell
axteam/gemma-4-31B-GGUF
Text Generation • 31B • Updated • 2.09k • 2Note gemma-4-31B · GGUF (Q4_K_M / Q8_0 / BF16) for llama.cpp / Ollama
axteam/gemma-4-31B-it-FP8-dynamic
Image-Text-to-Text • 31B • Updated • 260 • 4Note gemma-4-31B-it · FP8 dynamic (W8A8) — near-lossless; Hopper/Ada/Blackwell
axteam/gemma-4-31B-it-AWQ-8bit
Image-Text-to-Text • 10B • Updated • 209 • 2Note gemma-4-31B-it · AWQ W8A16 INT8 — near-lossless
axteam/gemma-4-31B-it-AWQ-4bit
Image-Text-to-Text • 7B • Updated • 562 • 2Note gemma-4-31B-it · AWQ W4A16 INT4 — ~1/4 size
axteam/gemma-4-31B-it-NVFP4A16
Image-Text-to-Text • 18B • Updated • 333 • 5Note gemma-4-31B-it · NVFP4 W4A16 (FP4 weights, BF16 activations) — best 4-bit quality
axteam/gemma-4-31B-it-NVFP4
Image-Text-to-Text • 18B • Updated • 347 • 7Note gemma-4-31B-it · NVFP4 W4A4 (FP4 weights + activations) — fastest on Blackwell
axteam/gemma-4-31B-it-GGUF
Text Generation • 31B • Updated • 1.83k • 5Note gemma-4-31B-it · GGUF (Q4_K_M / Q8_0 / BF16) for llama.cpp / Ollama
axteam/gemma-4-E2B-it-GGUF
Text Generation • 5B • Updated • 2.01k • 3Note gemma-4-E2B-it · GGUF (Q4_K_M / Q8_0 / BF16) for llama.cpp / Ollama
axteam/gemma-4-E2B-it-FP8-dynamic
Image-Text-to-Text • 5B • Updated • 295 • 2Note gemma-4-E2B-it · FP8 dynamic (W8A8) — near-lossless; Hopper/Ada/Blackwell
axteam/gemma-4-E2B-it-AWQ-8bit
Image-Text-to-Text • 5B • Updated • 278 • 2Note gemma-4-E2B-it · AWQ W8A16 INT8 — near-lossless
axteam/gemma-4-E2B-it-AWQ-4bit
Image-Text-to-Text • 5B • Updated • 302 • 2Note gemma-4-E2B-it · AWQ W4A16 INT4 — ~1/4 size
axteam/gemma-4-E2B-it-NVFP4A16
Image-Text-to-Text • 5B • Updated • 311 • 2Note gemma-4-E2B-it · NVFP4 W4A16 (FP4 weights, BF16 activations) — best 4-bit quality
axteam/gemma-4-E2B-it-NVFP4
Image-Text-to-Text • 5B • Updated • 307 • 2Note gemma-4-E2B-it · NVFP4 W4A4 (FP4 weights + activations) — fastest on Blackwell