RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a16 Text Generation • 71B • Updated Oct 9, 2024 • 150 • 5
RedHatAI/Mistral-7B-Instruct-v0.3-quantized.w8a8 Text Generation • 7B • Updated Oct 9, 2024 • 413 • 2
RedHatAI/Phi-3-medium-128k-instruct-quantized.w4a16 Text Generation • 14B • Updated Oct 9, 2024 • 1.35k • 3
RedHatAI/Phi-3-mini-128k-instruct-quantized.w4a16 Text Generation • 4B • Updated Oct 9, 2024 • 22 • 1
RedHatAI/Meta-Llama-3-8B-Instruct-quantized.w8a8 Text Generation • 8B • Updated Oct 9, 2024 • 1.42k • 2
RedHatAI/Phi-3-medium-128k-instruct-quantized.w8a8 Text Generation • 14B • Updated Oct 9, 2024 • 93 • 2
RedHatAI/Phi-3-medium-128k-instruct-quantized.w8a16 Text Generation • 14B • Updated Oct 9, 2024 • 18 • 2