gghfez
/

DeepSeek-V3-0324-256x21B-BF16

Model card Files Files and versions

Imatrix: DeepSeek-V3-0324.imatrix reuploaded from ubergarm/DeepSeek-V3-0324-GGUF

Downloads last month: 51

GGUF

Model size

672B params

Architecture

deepseek2

Hardware compatibility

Log In to view the estimation

16-bit

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for gghfez/DeepSeek-V3-0324-256x21B-BF16

Base model

deepseek-ai/DeepSeek-V3-0324

Quantized

(25)

this model

Collection including gghfez/DeepSeek-V3-0324-256x21B-BF16

Deepseek MoE BF16 for ik_llama quants

Upscaled BF16 quants and imatrix for Deepseek models. GGUFs are moving to Modelscope, Imatrix and Readme.md remain. • 6 items • Updated Oct 27