RedHatAI/Pixtral-Large-Instruct-2411-hf-quantized.w4a16 Image-Text-to-Text • 125B • Updated Mar 31, 2025 • 31
RedHatAI/Pixtral-Large-Instruct-2411-hf-quantized.w8a8 Image-Text-to-Text • 124B • Updated Mar 31, 2025 • 26
RedHatAI/Pixtral-Large-Instruct-2411-hf-FP8-dynamic Image-Text-to-Text • 124B • Updated Mar 31, 2025 • 84 • 1
RedHatAI/Mistral-7B-Instruct-v0.3-quantized.w4a16 Text Generation • 7B • Updated Mar 13, 2025 • 559 • 2
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w4a16 Text Generation • 2B • Updated Feb 27, 2025 • 60 • 1
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w8a8 Text Generation • 2B • Updated Feb 27, 2025 • 84 • 2
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16 Text Generation • 8B • Updated Feb 27, 2025 • 297 • 2
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-quantized.w8a8 Text Generation • 8B • Updated Feb 27, 2025 • 441 • 5
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-FP8-dynamic Text Generation • 8B • Updated Feb 27, 2025 • 1.42k • 1
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-quantized.w4a16 Text Generation • 15B • Updated Feb 27, 2025 • 190 • 1
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-quantized.w8a8 Text Generation • 15B • Updated Feb 27, 2025 • 239 • 2
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-FP8-dynamic Text Generation • 15B • Updated Feb 27, 2025 • 552 • 3
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w4a16 Text Generation • 33B • Updated Feb 27, 2025 • 1.37k • 5