RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8
Text Generation • 8B • Updated • 133k • 45
AI & ML interests
OpenSource and AI
Recent Activity
View all activity
Papers
SNLP: Layer-Parallel Inference via Structured Newton Corrections
S2D2: Fast Decoding for Diffusion LLMs via Training-Free Self-Speculation
RedHatAI/Meta-Llama-3.1-70B-quantized.w8a8
Text Generation • 71B • Updated • 81
RedHatAI/Meta-Llama-3.1-70B-quantized.w8a16
Text Generation • 71B • Updated • 80
RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a8
Text Generation • 71B • Updated • 887 • 21
RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a16
Text Generation • 71B • Updated • 111 • 5
RedHatAI/Meta-Llama-3.1-70B-Instruct-FP8-dynamic
Text Generation • 71B • Updated • 405 • 7
RedHatAI/Meta-Llama-3.1-70B-FP8
Text Generation • 71B • Updated • 216 • 3
RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w8a8
Text Generation • 406B • Updated • 76 • 2
RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w8a16
Text Generation • 406B • Updated • 124 • 2
RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w4a16
Text Generation • 406B • Updated • 336 • 11
RedHatAI/Meta-Llama-3.1-405B-Instruct-FP8-dynamic
Text Generation • 406B • Updated • 1.9k • 15
RedHatAI/Meta-Llama-3.1-405B-Instruct-FP8
Text Generation • 406B • Updated • 549 • 31
RedHatAI/Meta-Llama-3.1-405B-FP8
Text Generation • Updated • 134
RedHatAI/Meta-Llama-3-8B-Instruct-quantized.w8a8
Text Generation • 8B • Updated • 771 • 2
RedHatAI/Meta-Llama-3-70B-Instruct-quantized.w8a8
Text Generation • 71B • Updated • 100
RedHatAI/Llama-3.2-3B-quantized.w8a8
4B • Updated • 14.4k
RedHatAI/Llama-3.2-3B-Instruct-FP8
Text Generation • 4B • Updated • 185k • 6
RedHatAI/Llama-3.2-1B-Instruct-quantized.w8a8
Text Generation • 1B • Updated • 8.29k • 8
RedHatAI/Llama-3.2-1B-FP8
1B • Updated • 5.07k • 1
RedHatAI/Llama-2-7b-chat-quantized.w8a8
Text Generation • 7B • Updated • 190 • 1
RedHatAI/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4
Text Generation • 18B • Updated • 112
RedHatAI/NVIDIA-Nemotron-3-Ultra-550B-A55B-FP8-block
Text Generation • 561B • Updated • 2.09k
RedHatAI/Qwen3.8-27B
Image-Text-to-Text • 28B • Updated • 1.86k
RedHatAI/Llama-3.2-1B-Instruct-FP8
Text Generation • 1B • Updated • 76.1k • 4
RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w4a16
Image-Text-to-Text • 24B • Updated • 2.51k • 11
RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w8a8
Image-Text-to-Text • 24B • Updated • 1.24k • 5
RedHatAI/NVIDIA-Nemotron-3-Ultra-550B-A55B-quantized.w4a16
Text Generation • 561B • Updated • 9.05k • 5
RedHatAI/Mistral-Medium-3.5-128B
Image-Text-to-Text • 128B • Updated • 159
RedHatAI/diffusiongemma-26B-A4B-it-FP8-dynamic
Image-Text-to-Text • 26B • Updated • 45.9k • 12
RedHatAI/Qwen3-VL-30B-A3B-Instruct
Image-Text-to-Text • 31B • Updated • 94