Running 63 Accurate GGUF Memory Calculator 📊 63 Calculate memory for GGUF models using GPU layers + context
kaetemi/Meta-Llama-3.1-8B-Q4_K_M-GGUF-old Text Generation • 8B • Updated Jul 23, 2024 • 24 • 2
Running Featured 1.04k Can You Run It? LLM version 🚀 1.04k Calculate GPU needs for running LLMs on your hardware