view post Post 4405 We’re releasing Gemma 4 NVFP4 quants that run 1.5× faster on your GPU.Gemma-4-12B NVFP4 works on 11GB VRAM.26B-A4B hits 13K tok/s (B200).Unsloth NVFP4 enables faster, more accurate 4-bit Blackwell inference.Blog: https://unsloth.ai/docs/basics/nvfp4Gemma NVFP4: https://huggingface.co/collections/unsloth/nvfp4 See translation 2 replies · 🔥 12 12 🤗 3 3 🚀 2 2 👍 2 2 + Reply