Inference Providers
Active filters: 2bit
mlx-community/Hy3-OptiQ-2bit
Text Generation
• 24B • Updated • 730
• 4
mlx-community/DeepSeek-V4-Flash-0731-OptiQ-2bit
Text Generation
• 26B • Updated • 3.59k
• 5
cudabenchmarktest/personaplex-7b-turbo2bit
zjiayu064/Qwen3-Next-80B-A3B-Instruct-BitsMoE-2bit
Text Generation
• Updated • 19
• 1
Minami-su/Yi_34B_Chat_2bit
Text Generation
• 5B • Updated • 13
• 5
Text Generation
• 2B • Updated • 5
• 2
Minami-su/SUS-Chat-34B_2bit
Text Generation
• 5B • Updated • 8
• 2
ProphetOfBostrom/Noromaid-v0.4-Mixtral-Instruct-8x7b-Zloss_attn-4bit-moe-2bit-HQQ
Text Generation
• Updated • 13
• 6
ProphetOfBostrom/BagelMix-8x7B-2b-HQQ
Text Generation
• Updated • 8
legraphista/Yuan2-M32-hf-IMat-GGUF
Text Generation
• 40B • Updated • 676
• 3
legraphista/K2-Chat-IMat-GGUF
Text Generation
• 65B • Updated • 174
• 5
Text Generation
• 65B • Updated • 212
• 3
legraphista/neo_7b_instruct_v0.1-IMat-GGUF
Text Generation
• 8B • Updated • 993
legraphista/neo_7b_sft_v0.1-IMat-GGUF
Text Generation
• 8B • Updated • 612
legraphista/neo_7b-IMat-GGUF
Text Generation
• 8B • Updated • 707
legraphista/Llama-3-8B-Instruct-MopeyMule-IMat-GGUF
Text Generation
• 8B • Updated • 1.65k
• 1
legraphista/Meta-Llama-3-8B-Instruct-abliterated-v3-IMat-GGUF
Text Generation
• 8B • Updated • 1.9k
• 1
legraphista/Meta-Llama-3-70B-Instruct-abliterated-v3.5-IMat-GGUF
Text Generation
• 71B • Updated • 2.06k
• 2
legraphista/K2-ckpt_360-IMat-GGUF
Text Generation
• 65B • Updated • 1.66k
legraphista/Nxcode-CQ-7B-orpo-IMat-GGUF
Text Generation
• 7B • Updated • 826
• 3
legraphista/dolphin-2.9.2-Phi-3-Medium-IMat-GGUF
Text Generation
• 14B • Updated • 4.45k
legraphista/dolphin-2.9.2-Phi-3-Medium-abliterated-IMat-GGUF
Text Generation
• 14B • Updated • 540
• 1
legraphista/Higgs-Llama-3-70B-IMat-GGUF
Text Generation
• 71B • Updated • 185
• 8
legraphista/Qwen2-7B-Instruct-IMat-GGUF
Text Generation
• 8B • Updated • 1.2k
• 3
legraphista/Qwen2-0.5B-Instruct-IMat-GGUF
Text Generation
• 0.5B • Updated • 1.47k
legraphista/Qwen2-0.5B-IMat-GGUF
Text Generation
• 0.5B • Updated • 841
legraphista/Qwen2-1.5B-Instruct-IMat-GGUF
Text Generation
• 2B • Updated • 1.95k
• 1
legraphista/Qwen2-1.5B-IMat-GGUF
Text Generation
• 2B • Updated • 1.08k
legraphista/Qwen2-7B-IMat-GGUF
Text Generation
• 8B • Updated • 619
legraphista/Qwen2-57B-A14B-Instruct-IMat-GGUF
Text Generation
• 57B • Updated • 81
• 2