RichardErkhov/google_-_gemma-2b-8bits
Text Generation • 3B • Updated • 3
Edit Models filters
Apps
Inference Providers
Active filters: bitsandbytes
RichardErkhov/TinyLlama_-_TinyLlama-1.1B-Chat-v1.0-4bits
Text Generation • 1B • Updated • 2
RichardErkhov/TinyLlama_-_TinyLlama-1.1B-Chat-v1.0-8bits
Text Generation • 1B • Updated • 22
JunWorks/Quantized_4bit_WhisperSmallOri_FP16
Automatic Speech Recognition • 0.2B • Updated • 3
theGhoul21/srl-sft-010524-4bit-v0.2
Text Generation • 7B • Updated • 2
RichardErkhov/bigscience_-_bloomz-560m-4bits
Text Generation • 0.6B • Updated • 6
RichardErkhov/bigscience_-_bloomz-560m-8bits
Text Generation • 0.6B • Updated • 2
RichardErkhov/google_-_gemma-2b-it-4bits
Text Generation • 3B • Updated • 1
RichardErkhov/google_-_gemma-2b-it-8bits
Text Generation • 3B • Updated • 1
RichardErkhov/augmxnt_-_shisa-gamma-7b-v1-4bits
Text Generation • 7B • Updated • 3
JunWorks/Quantized_4bit_WhisperSmallOri_FP16_noneb
Automatic Speech Recognition • 0.2B • Updated • 1
RichardErkhov/deepset_-_roberta-base-squad2-4bits
Text Generation • 0.1B • Updated • 21
RichardErkhov/deepset_-_roberta-base-squad2-8bits
Text Generation • 0.1B • Updated • 18
Chord-Llama/Llama-3-chord-llama-chechpoint-4
Text Generation • 8B • Updated • 3
RichardErkhov/consciousAI_-_question-answering-roberta-base-s-v2-4bits
Text Generation • 0.1B • Updated • 18
RichardErkhov/consciousAI_-_question-answering-roberta-base-s-v2-8bits
Text Generation • 0.1B • Updated • 19
RichardErkhov/deepset_-_tinyroberta-squad2-4bits
Text Generation • 82.8M • Updated • 2
RichardErkhov/deepset_-_tinyroberta-squad2-8bits
Text Generation • 82.2M • Updated • 2
RichardErkhov/deepset_-_roberta-base-squad2-distilled-4bits
Text Generation • 0.1B • Updated • 18
RichardErkhov/deepset_-_roberta-base-squad2-distilled-8bits
Text Generation • 0.1B • Updated • 18
Parssky/4bitmodel
Text Generation • 8B • Updated • 4
RichardErkhov/deepset_-_roberta-large-squad2-4bits
Text Generation • 0.4B • Updated • 2
RichardErkhov/deepset_-_roberta-large-squad2-8bits
Text Generation • 0.4B • Updated • 2
RichardErkhov/trl-internal-testing_-_tiny-random-LlamaForCausalLM-4bits
Text Generation • 1.03M • Updated • 6
RichardErkhov/trl-internal-testing_-_tiny-random-LlamaForCausalLM-8bits
Text Generation • 1.03M • Updated • 6
RichardErkhov/lgodwangl_-_new_01m-4bits
Text Generation • 7B • Updated • 2
RichardErkhov/lgodwangl_-_new_01m-8bits
Text Generation • 7B • Updated • 2
RichardErkhov/yanolja_-_EEVE-Korean-10.8B-v1.0-4bits
Text Generation • 11B • Updated • 2
RichardErkhov/deepset_-_xlm-roberta-large-squad2-4bits
Text Generation • 0.6B • Updated • 5
RichardErkhov/yanolja_-_EEVE-Korean-10.8B-v1.0-8bits
Text Generation • 11B • Updated • 6