Available ExLlamaV3 0.0.15 quants

Type	Size	CLI
H8-4.0BPW	13.16 GB	Copy-paste the line / Download the batch file
H8-6.0BPW	18.72 GB	Copy-paste the line / Download the batch file
H8-8.0BPW	24.27 GB	Copy-paste the line / Download the batch file

Requirements: A python installation with huggingface-hub module to use CLI.

Downloads last month: -; Downloads are not tracked for this model. How to track

Model tree for DeathGodlike/WinterEngine-24B-Instruct_EXL3

Base model

Quantized

(4)

this model