Red Hat AI

company

Verified

https://www.redhat.com/en/products/ai

AI & ML interests

OpenSource and AI

Recent Activity

kylesayrs updated a model about 20 hours ago

RedHatAI/Kimi-K3-FP8-BLOCK

kylesayrs published a model about 21 hours ago

RedHatAI/Kimi-K3-FP8-BLOCK

shanjiaz new activity 1 day ago

RedHatAI/GLM-5.2-speculator.dspark:Failed to run on 8xB200 - AssertionError: Tried to load weights of size torch.Size([6144, 30720])to a parameter of size torch.Size([6144, 18432])

View all activity

Papers

SNLP: Layer-Parallel Inference via Structured Newton Corrections

S2D2: Fast Decoding for Diffusion LLMs via Training-Free Self-Speculation

View all Papers

RedHatAI 's models 727

RedHatAI/Meta-Llama-3.1-405B-Instruct-FP8-dynamic

Text Generation • 406B • Updated Oct 19, 2024 • 1.68k • 15

RedHatAI/Qwen2.5-32B-Instruct-quantized.w4a16

33B • Updated Oct 18, 2024 • 296 • 1

RedHatAI/Qwen2.5-32B-quantized.w4a16

33B • Updated Oct 18, 2024 • 16

RedHatAI/Qwen2.5-72B-quantized.w4a16

73B • Updated Oct 17, 2024 • 18

RedHatAI/Qwen2.5-72B-Instruct-quantized.w4a16

73B • Updated Oct 17, 2024 • 39

RedHatAI/Qwen2.5-72B-Instruct-quantized.w8a16

73B • Updated Oct 17, 2024 • 17

RedHatAI/Qwen2.5-1.5B-Instruct-quantized.w8a16

2B • Updated Oct 17, 2024 • 25

RedHatAI/Qwen2.5-3B-Instruct-quantized.w8a16

3B • Updated Oct 17, 2024 • 23

RedHatAI/Llama-3.2-3B-Instruct-FP8

Text Generation • 4B • Updated Oct 16, 2024 • 2.65k • 6

RedHatAI/Llama-3.2-1B-Instruct-FP8

Text Generation • 1B • Updated Oct 16, 2024 • 789k • 4

RedHatAI/Llama-3.2-1B-Instruct-quantized.w8a8

Text Generation • 1B • Updated Oct 16, 2024 • 42.8k • 8

RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w4a16

Text Generation • 409B • Updated Oct 10, 2024 • 132 • 12

RedHatAI/Llama-3.2-3B-quantized.w8a8

4B • Updated Oct 9, 2024 • 6.98k

RedHatAI/SmolLM-1.7B-Instruct-quantized.w8a8

Text Generation • 2B • Updated Oct 9, 2024 • 26 • 1

RedHatAI/SmolLM-135M-Instruct-quantized.w8a8

Text Generation • 0.2B • Updated Oct 9, 2024 • 24 • 1

RedHatAI/SmolLM-360M-Instruct-quantized.w8a8

Text Generation • 0.4B • Updated Oct 9, 2024 • 23

RedHatAI/SmolLM-135M-Instruct-quantized.w8a16

Text Generation • 0.2B • Updated Oct 9, 2024 • 338

RedHatAI/gemma-2-27b-it-quantized.w8a16

Text Generation • 28B • Updated Oct 9, 2024 • 19

RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w8a16

Text Generation • 406B • Updated Oct 9, 2024 • 16 • 1

RedHatAI/gemma-2-2b-it-quantized.w8a8

Text Generation • 3B • Updated Oct 9, 2024 • 39

RedHatAI/Mistral-Nemo-Instruct-2407-quantized.w4a16

Text Generation • 12B • Updated Oct 9, 2024 • 4.53k • 4

RedHatAI/SmolLM-1.7B-Instruct-quantized.w8a16

Text Generation • 2B • Updated Oct 9, 2024 • 20

RedHatAI/gemma-2-2b-it-quantized.w4a16

Text Generation • 3B • Updated Oct 9, 2024 • 407 • 1

RedHatAI/gemma-2-9b-it-quantized.w4a16

Text Generation • 10B • Updated Oct 9, 2024 • 1.02k • 2

RedHatAI/Phi-3-small-128k-instruct-quantized.w8a16

Text Generation • 8B • Updated Oct 9, 2024 • 18

RedHatAI/gemma-2-2b-quantized.w8a16

Text Generation • 3B • Updated Oct 9, 2024 • 22

RedHatAI/gemma-2-2b-it-quantized.w8a16

Text Generation • 3B • Updated Oct 9, 2024 • 21 • 1

RedHatAI/gemma-2-9b-it-quantized.w8a16

Text Generation • 10B • Updated Oct 9, 2024 • 154 • 1

RedHatAI/gemma-2-2b-it-FP8

3B • Updated Oct 9, 2024 • 440 • 1

RedHatAI/starcoder2-15b-quantized.w8a8

Text Generation • 16B • Updated Oct 9, 2024 • 35