Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

5,072

Base only

Active filters: llama.cpp

k0valik/Darwin-28B-Coder-IQ4_XS12.9GiB-GGUF

Text Generation • 27B • Updated 13 days ago • 865 • 5

jedisct1/MiMo-V2.5-coder-Q2-v2

Text Generation • 309B • Updated 9 days ago • 640 • 7

Lazarus-Ai/ReAligned-Qwen3.5-27B-GGUF

Text Generation • 27B • Updated 7 days ago • 1.47k • 4

LiquidAI/LFM2.5-Audio-1.5B-GGUF

1B • Updated Mar 30 • 21.1k • 104

Jackrong/Qwen3.5-9B-GLM5.1-Distill-v1

Image-Text-to-Text • 10B • Updated Apr 18 • 19.9k • 66

MassivDash/Gemma-4-Rust-Coder

5B • Updated Apr 24 • 7.48k • 18

cHunter789/Qwen3.6-27B-i1-IQ4_XS-GGUF

Text Generation • 27B • Updated May 2 • 7.35k • 28

LibertAIDAI/Qwen3.6-27B-NVFP4-GGUF

Image-Text-to-Text • 27B • Updated about 1 month ago • 7.26k • 13

froggeric/Qwen3.6-27B-MTP-GGUF

Image-Text-to-Text • Updated 13 days ago • 108k • 70

GestaltLabs/Ornstein3.6-27B-MTP-NSC-ACE-SABER-GGUF

Image-Text-to-Text • 27B • Updated 20 days ago • 5.68k • 12

armand0e/Qwen3.5-9B-Opus-Agent-GGUF

9B • Updated 9 days ago • 3.1k • 8

linuxid10t/Laguna-XS.2-GGUF

33B • Updated 6 days ago • 355 • 3

poolside-laguna-hackathon/Piscina-XS.2-GGUF

Text Generation • 33B • Updated 4 days ago • 833 • 3

Surpem/Supertron-2.1-8B-A1B-GGUF

Text Generation • 8B • Updated 2 days ago • 507 • 3

JSchneemann/Mellum2-12B-A2.5B-Thinking-GGUF

Text Generation • 12B • Updated about 11 hours ago • 613 • 4

CodeFault/Mellum2-12B-A2.5B-Instruct-GGUF

Text Generation • 12B • Updated about 5 hours ago • 64 • 3

CodeFault/Mellum2-12B-A2.5B-Thinking-GGUF

Text Generation • 12B • Updated about 5 hours ago • 72 • 3

prithivMLmods/Qwen3.5-abliterated-MAX-AIO-GGUF

Image-Text-to-Text • 0.8B • Updated Mar 11 • 3.28k • 6

prism-ml/Bonsai-4B-gguf

Text Generation • 4B • Updated Apr 18 • 6.73k • 46

LiquidAI/LFM2.5-VL-450M-GGUF

Image-Text-to-Text • 0.4B • Updated Apr 6 • 7.72k • 47

TeichAI/gemma-4-26B-A4B-it-Claude-Opus-Distill-GGUF

25B • Updated 27 days ago • 5.89k • 42

DJLougen/Harmonic-Hermes-9B-GGUF

9B • Updated Apr 8 • 2.84k • 61

khazarai/Qwen3-4B-Qwen3.6-plus-Reasoning-Distilled-GGUF

Text Generation • 4B • Updated Apr 19 • 20.8k • 42

S4MPL3BI4S/gemma4-coding-agent

8B • Updated Apr 10 • 10.1k • 21

Jackrong/Qwen3.5-9B-GLM5.1-Distill-v1-GGUF

Image-Text-to-Text • 9B • Updated Apr 18 • 93.8k • 103

WithinUsAI/Opus4.7-GODs.Ghost.Codex-4B.GGuF

Text Generation • 4B • Updated May 3 • 30.9k • 75

bekoozkan/godot-gemma-4-e4b-it-GGUF

Any-to-Any • 8B • Updated 26 days ago • 8.67k • 6

Dyluhn/lordx64-Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-MTP-GGUF

Text Generation • 36B • Updated 28 days ago • 7.65k • 11

sana0756/Gemma-4-GodMode-V9-Ultimate-GGUF

8B • Updated 26 days ago • 586 • 2

GestaltLabs/Qwen3.6-35B-A3B-NSC-ACE-SABER-GGUF-MTP

Image-Text-to-Text • 36B • Updated 20 days ago • 10.6k • 14