RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w4a16 Text Generation • 8B • Updated 15 days ago • 75.6k • 30
RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8-dynamic Text Generation • 8B • Updated 15 days ago • 52.7k • 9
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8 Text Generation • 8B • Updated 15 days ago • 28.3k • 20
RedHatAI/Mistral-Small-24B-Instruct-2501-quantized.w4a16 Text Generation • 24B • Updated 15 days ago • 459 • 1
RedHatAI/granite-3.1-8b-instruct-quantized.w4a16 Text Generation • 8B • Updated 15 days ago • 1.01k • 1
RedHatAI/Llama-3.3-70B-Instruct-quantized.w4a16 Text Generation • 71B • Updated 15 days ago • 1.47k • 3
RedHatAI/Llama-3.3-70B-Instruct-quantized.w8a8 Text Generation • 71B • Updated 15 days ago • 2.95k • 14
RedHatAI/Llama-3.1-Nemotron-70B-Instruct-HF-FP8-dynamic Text Generation • 71B • Updated 15 days ago • 230 • 15
RedHatAI/Mistral-Small-24B-Instruct-2501-quantized.w8a8 Text Generation • 24B • Updated 15 days ago • 19.7k • 2
RedHatAI/Mistral-Small-24B-Instruct-2501-FP8-dynamic Text Generation • 24B • Updated 15 days ago • 4.36k • 13