RedHatAI/Qwen3.5-9B-quantized.w4a16
Image-Text-to-Text • 9B • Updated • 7.12k • 1
AI & ML interests
OpenSource and AI
Recent Activity
View all activity
Papers
SNLP: Layer-Parallel Inference via Structured Newton Corrections
S2D2: Fast Decoding for Diffusion LLMs via Training-Free Self-Speculation
RedHatAI/Qwen3-8B-speculator.dflash
2B • Updated • 852 • 12
RedHatAI/GLM-5.1
Text Generation • 754B • Updated • 204
RedHatAI/MiniMax-M2.5-quantized.w8a8
Text Generation • 229B • Updated • 183
RedHatAI/MiniMax-M2.5-quantized.w4a16
Text Generation • 34B • Updated • 260
RedHatAI/MiniMax-M2.5-NVFP4
Text Generation • 130B • Updated • 128
RedHatAI/TinyLlama-1.1B-Chat-v1.0-pruned2.4
Text Generation • Updated • 2.16k • • 1
RedHatAI/Qwen3-8B-quantized.w4a16
Text Generation • 8B • Updated • 32.2k • 4
RedHatAI/all-MiniLM-L6-v2
Sentence Similarity • 22.7M • Updated • 479
RedHatAI/granite-embedding-english-r2
Feature Extraction • 0.1B • Updated • 193
RedHatAI/nomic-embed-text-v1.5
Sentence Similarity • 0.1B • Updated • 563
RedHatAI/Qwen3-Embedding-8B
Feature Extraction • 8B • Updated • 179 • 1
RedHatAI/embeddinggemma-300m
Sentence Similarity • 0.3B • Updated • 316 • 1
RedHatAI/DeepSeek-V4-Flash-BF16
Text Generation • 284B • Updated • 1.22k • 1
RedHatAI/docling-layout-heron
42.9M • Updated • 7
RedHatAI/Qwen3.6-35B-A3B-FP8
Image-Text-to-Text • 36B • Updated • 14k
RedHatAI/Laguna-XS.2-NVFP4
Text Generation • 20B • Updated • 10.7k
RedHatAI/Laguna-XS.2-FP8
Text Generation • 33B • Updated • 242
RedHatAI/Kimi-K2.6-FP8-BLOCK
1T • Updated • 2.73k • 4
RedHatAI/gemma-3n-E4B-it-FP8-dynamic
Text Generation • 8B • Updated • 601 • 4
RedHatAI/Kimi-K2-Instruct-quantized.w4a16
Text Generation • 1T • Updated • 421 • 12
RedHatAI/Qwen3-8B-FP8-dynamic
Text Generation • 8B • Updated • 44.6k • 12
RedHatAI/DeepSeek-R1-0528-quantized.w4a16
Text Generation • 676B • Updated • 119 • 13
RedHatAI/NVIDIA-Nemotron-Nano-9B-v2-quantized.w4a16
Text Generation • 2B • Updated • 1.13k • 5
RedHatAI/NVIDIA-Nemotron-Nano-9B-v2-FP8-dynamic
Text Generation • 9B • Updated • 1.72k • 3
RedHatAI/Voxtral-Mini-3B-2507-FP8-dynamic
Automatic Speech Recognition • 5B • Updated • 9.74k • 12
RedHatAI/whisper-large-v3-turbo-quantized.w4a16
Automatic Speech Recognition • 0.9B • Updated • 1.8k • 8
RedHatAI/Qwen3-Coder-480B-A35B-Instruct-FP8
Text Generation • 480B • Updated • 116 • 3
RedHatAI/Apertus-8B-Instruct-2509-FP8-dynamic
Text Generation • 8B • Updated • 1.28k • 3
RedHatAI/Mistral-Large-3-675B-Instruct-2512-NVFP4
Updated • 9 • 3