A collection of MoE+MLA models, serving as testing proxies for DeepSeek-V3/R1
Thien Tran
gaunernst
·
AI & ML interests
None yet
Recent Activity
liked a model 22 days ago
Qwen/Qwen3.8-27B liked a model 27 days ago
meta-models/Muse-Glimmer-30B liked a model about 1 month ago
MiniMaxAI/MiniMax-H3Organizations
Gemma 3 QAT INT4 (from Flax)
These are converted from the official QAT INT4 Flax checkpoints on Kaggle. Supported formats: AutoAWQ, GGUF
-
gaunernst/gemma-3-1b-it-int4-awq
Text Generation • 1.0B • Updated • 4.49k • 2 -
gaunernst/gemma-3-4b-it-int4-awq
Image-Text-to-Text • 4B • Updated • 1.55k • 7 -
gaunernst/gemma-3-12b-it-int4-awq
Image-Text-to-Text • 12B • Updated • 249k • 24 -
gaunernst/gemma-3-27b-it-int4-awq
Image-Text-to-Text • 27B • Updated • 1.36M • 40
Face Recognition Models
-
gaunernst/vit_small_patch8_gap_112.cosface_ms1mv3
Image Feature Extraction • 21.6M • Updated • 62 • 2 -
gaunernst/vit_tiny_patch8_112.cosface_ms1mv3
Image Feature Extraction • 5.51M • Updated • 31 • 2 -
gaunernst/vit_tiny_patch8_112.arcface_ms1mv3
Image Feature Extraction • 5.51M • Updated • 25.2k • 4 -
gaunernst/vit_tiny_patch8_112.adaface_ms1mv3
Image Feature Extraction • 5.51M • Updated • 38 • 2
LLMs 1B - 2B
Smallish LLM pre-training datasets
Llama3-compatible
-
nvidia/Llama-3.1-Minitron-4B-Width-Base
Text Generation • 5B • Updated • 1.99k • 197 -
nvidia/Llama-3.1-Minitron-4B-Depth-Base
Text Generation • 5B • Updated • 1.52k • 22 -
meta-llama/Llama-3.1-8B-Instruct
Text Generation • 8B • Updated • 5.74M • • 6.8k -
meta-llama/Llama-3.1-8B
Text Generation • 8B • Updated • 511k • 2.42k
Gemma 3 QAT INT4 (from GGUF)
Convert official Gemma 3 QAT GGUF to AutoAWQ and compressed-tensors format for ease of deployment
-
gaunernst/gemma-3-1b-it-qat-autoawq
Text Generation • 1.0B • Updated • 14 -
gaunernst/gemma-3-4b-it-qat-autoawq
Image-Text-to-Text • 4B • Updated • 144 • 2 -
gaunernst/gemma-3-12b-it-qat-autoawq
Image-Text-to-Text • 12B • Updated • 528 • 7 -
gaunernst/gemma-3-27b-it-qat-autoawq
Image-Text-to-Text • 27B • Updated • 1.35k • 12
Mini BERT models
https://arxiv.org/abs/1908.08962
LLMs < 1B
LLMs 2B - 4B
Llama2-compatible
DeepSeek testing
A collection of MoE+MLA models, serving as testing proxies for DeepSeek-V3/R1
Gemma 3 QAT INT4 (from GGUF)
Convert official Gemma 3 QAT GGUF to AutoAWQ and compressed-tensors format for ease of deployment
-
gaunernst/gemma-3-1b-it-qat-autoawq
Text Generation • 1.0B • Updated • 14 -
gaunernst/gemma-3-4b-it-qat-autoawq
Image-Text-to-Text • 4B • Updated • 144 • 2 -
gaunernst/gemma-3-12b-it-qat-autoawq
Image-Text-to-Text • 12B • Updated • 528 • 7 -
gaunernst/gemma-3-27b-it-qat-autoawq
Image-Text-to-Text • 27B • Updated • 1.35k • 12
Gemma 3 QAT INT4 (from Flax)
These are converted from the official QAT INT4 Flax checkpoints on Kaggle. Supported formats: AutoAWQ, GGUF
-
gaunernst/gemma-3-1b-it-int4-awq
Text Generation • 1.0B • Updated • 4.49k • 2 -
gaunernst/gemma-3-4b-it-int4-awq
Image-Text-to-Text • 4B • Updated • 1.55k • 7 -
gaunernst/gemma-3-12b-it-int4-awq
Image-Text-to-Text • 12B • Updated • 249k • 24 -
gaunernst/gemma-3-27b-it-int4-awq
Image-Text-to-Text • 27B • Updated • 1.36M • 40
Mini BERT models
https://arxiv.org/abs/1908.08962
Face Recognition Models
-
gaunernst/vit_small_patch8_gap_112.cosface_ms1mv3
Image Feature Extraction • 21.6M • Updated • 62 • 2 -
gaunernst/vit_tiny_patch8_112.cosface_ms1mv3
Image Feature Extraction • 5.51M • Updated • 31 • 2 -
gaunernst/vit_tiny_patch8_112.arcface_ms1mv3
Image Feature Extraction • 5.51M • Updated • 25.2k • 4 -
gaunernst/vit_tiny_patch8_112.adaface_ms1mv3
Image Feature Extraction • 5.51M • Updated • 38 • 2
LLMs < 1B
LLMs 1B - 2B
LLMs 2B - 4B
Smallish LLM pre-training datasets
Llama2-compatible
Llama3-compatible
-
nvidia/Llama-3.1-Minitron-4B-Width-Base
Text Generation • 5B • Updated • 1.99k • 197 -
nvidia/Llama-3.1-Minitron-4B-Depth-Base
Text Generation • 5B • Updated • 1.52k • 22 -
meta-llama/Llama-3.1-8B-Instruct
Text Generation • 8B • Updated • 5.74M • • 6.8k -
meta-llama/Llama-3.1-8B
Text Generation • 8B • Updated • 511k • 2.42k