Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

5,076

Base only

Active filters: llama.cpp

mradermacher/llama-3.2-3b-psychotherapy-cbt-i1-GGUF

3B • Updated Feb 19 • 169 • 2

Jackrong/Qwen3.5-4B-Python-Coder-GGUF

4B • Updated Mar 14 • 2.58k • 1

bigatuna/Qwen3.5-9b-Sushi-Coder-RL-GGUF

Text Generation • 9B • Updated Apr 20 • 11.6k • 83

prithivMLmods/Qwen3.5-9B-abliterated-v2-MAX

Image-Text-to-Text • 9B • Updated 3 days ago • 1.85k • 6

prism-ml/Bonsai-1.7B-gguf

Text Generation • 2B • Updated Apr 18 • 10.6k • 74

prithivMLmods/gemma-4-E2B-it-F32-GGUF

Image-Text-to-Text • 5B • Updated Apr 3 • 1.88k • 3

DJLougen/Harmonic-Hermes-9B-GGUF

9B • Updated Apr 8 • 2.84k • 61

apothic/bonsai-8B-1bit-turboquant

8B • Updated Apr 5 • 288 • 5

BrainboxAI/law-il-E2B

Text Generation • 5B • Updated Apr 22 • 244 • 3

Jackrong/Qwopus3.5-2B-v3-GGUF

2B • Updated Apr 12 • 1.88k • 5

prithivMLmods/gemma-4-E4B-it-Uncensored-MAX-GGUF

Image-Text-to-Text • 8B • Updated Apr 14 • 2.47k • 2

prithivMLmods/gemma-4-E2B-it-Uncensored-MAX-GGUF

Image-Text-to-Text • 5B • Updated Apr 14 • 3.72k • 4

batiai/Qwen3.6-35B-A3B-GGUF

Text Generation • 35B • Updated about 1 month ago • 17.6k • 3

Abiray/Qwen3.6-35B-A3B-heretic-GGUF

Image-Text-to-Text • 35B • Updated Apr 17 • 2.14k • 17

WithinUsAI/Opus4.7-GODs.Ghost.Codex-4B.GGuF

Text Generation • 4B • Updated May 3 • 30.9k • 75

tomvaillant/qwen3.5-9b-abliterated-journalist-GGUF

9B • Updated 9 days ago • 398 • 2

exdysa/MiniMax-M2.7-REAP-172B-A10B-GGUF

Text Generation • 173B • Updated Apr 27 • 996 • 8

edbuildingstuff/splashco-drive-gguf

Text Generation • 1B • Updated Apr 20 • 16 • 1

mad-lab-ai/Qwen3.6-27B-tq-gguf

Text Generation • 27B • Updated Apr 23 • 993 • 5

batiai/Qwen3.6-27B-GGUF

Text Generation • 27B • Updated about 1 month ago • 90.7k • 3

wangzhang/Qwen3.6-27B-abliterated-GGUF

Text Generation • 27B • Updated May 2 • 882 • 7

loilkon/Qwopus3.5-9B-v3.5-Uncensored

Text Generation • 9B • Updated Apr 25 • 693 • 8

GestaltLabs/Ornstein-Hermes-3.6-27b-GGUF

Image-Text-to-Text • 27B • Updated Apr 26 • 1.21k • 10

zlaabsi/Qwen3.6-27B-OTQ-GGUF

Image-Text-to-Text • 27B • Updated May 2 • 3.05k • 25

anemll/DeepSeek-V4-Flash-FP4-FP8-SSD

Text Generation • 7B • Updated Apr 29 • 2.36k • 6

knoopx/Qwen3.6-35B-A3B-NVFP4-GGUF

Text Generation • 35B • Updated 29 days ago • 5.51k • 10

fesalfayed/gpt-oss-20b-hermes_agent-tool-finetune_gguf

Text Generation • 21B • Updated May 2 • 1.56k • 4

freakyskittle/MiniMax-M2.75-460B-A20B-GGUF

Text Generation • 453B • Updated 8 days ago • 782 • 1

ssweens/DeepSeek-V4-Flash-GGUF-YMMV

Text Generation • 284B • Updated 23 days ago • 8.02k • 5

kasimat/Qwen3.6-27B-AEON-Ultimate-Uncensored-GGUF

Text Generation • 27B • Updated 30 days ago • 2.14k • 1