RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w4a16 Text Generation • 8B • Updated Jul 10 • 88.2k • 30
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8 Text Generation • 8B • Updated 9 days ago • 27.2k • 20
RedHatAI/Llama-3.2-1B-Instruct-quantized.w8a8 Text Generation • 1B • Updated Oct 16, 2024 • 34.8k • 8
RedHatAI/Phi-3-mini-128k-instruct-quantized.w4a16 Text Generation • 4B • Updated 9 days ago • 182 • 1
RedHatAI/Qwen2.5-VL-3B-Instruct-quantized.w8a8 Image-Text-to-Text • 4B • Updated May 1, 2025 • 104k • 2
RedHatAI/Qwen2.5-VL-3B-Instruct-quantized.w4a16 Image-Text-to-Text • 4B • Updated 9 days ago • 229 • 4
RedHatAI/Qwen2.5-VL-7B-Instruct-quantized.w8a8 Image-Text-to-Text • 8B • Updated Oct 2, 2025 • 3.44k • 9
RedHatAI/Qwen2.5-VL-7B-Instruct-quantized.w4a16 Image-Text-to-Text • 8B • Updated Apr 3, 2025 • 3.72k • 8
RedHatAI/granite-3.1-8b-instruct-quantized.w4a16 Text Generation • 8B • Updated 9 days ago • 1.18k • 1
RedHatAI/DeepSeek-R1-Distill-Llama-8B-quantized.w4a16 Text Generation • 8B • Updated 9 days ago • 485