GGUF models optimized with GSQ-RCO for efficient inference and minimal quality loss.
-
abenzerps/LFM2.5-24B-A2B-Uncensored-GSQ-RCO-GGUF
Text Generation • 24B • Updated • 10.1k • 22 -
abenzerps/Nanbeige4.3-33B-GSQ-RCO-GGUF
Text Generation • 33B • Updated • 22k • 46 -
abenzerps/Spark-X2.6-4B-Uncensored-GSQ-RCO-GGUF
Text Generation • 4B • Updated • 10.6k • 30 -
abenzerps/NeoHorse-1-9B-Uncensored-GSQ-RCO-GGUF
Text Generation • 9B • Updated • 7.26k • 19