Inference Providers
Active filters: 2bit
mlx-community/Qwen3.5-122B-A10B-OptiQ-2bit
Text Generation
• 122B • Updated • 351
• 3
mlx-community/NVIDIA-Nemotron-3-Super-120B-A12B-OptiQ-2bit
Text Generation
• 121B • Updated • 633
• 2
AngelSlim/Hy-MT1.5-1.8B-2bit-GGUF
Translation
• 2B • Updated • 480
• 22
Minami-su/Yi_34B_Chat_2bit
Text Generation
• 5B • Updated • 2
• 5
Text Generation
• 2B • Updated • 5
• 2
Minami-su/SUS-Chat-34B_2bit
Text Generation
• 5B • Updated • 2
• 2
ProphetOfBostrom/Noromaid-v0.4-Mixtral-Instruct-8x7b-Zloss_attn-4bit-moe-2bit-HQQ
Text Generation
• Updated • 18
• 6
ProphetOfBostrom/BagelMix-8x7B-2b-HQQ
Text Generation
• Updated • 1
legraphista/Yuan2-M32-hf-IMat-GGUF
Text Generation
• 40B • Updated • 178
• 3
legraphista/K2-Chat-IMat-GGUF
Text Generation
• 65B • Updated • 170
• 5
Text Generation
• 65B • Updated • 169
• 3
legraphista/neo_7b_instruct_v0.1-IMat-GGUF
Text Generation
• 8B • Updated • 289
legraphista/neo_7b_sft_v0.1-IMat-GGUF
Text Generation
• 8B • Updated • 176
legraphista/neo_7b-IMat-GGUF
Text Generation
• 8B • Updated • 113
legraphista/Llama-3-8B-Instruct-MopeyMule-IMat-GGUF
Text Generation
• 8B • Updated • 159
• 1
legraphista/Meta-Llama-3-8B-Instruct-abliterated-v3-IMat-GGUF
Text Generation
• 8B • Updated • 312
• 1
legraphista/Meta-Llama-3-70B-Instruct-abliterated-v3.5-IMat-GGUF
Text Generation
• 71B • Updated • 491
• 2
legraphista/K2-ckpt_360-IMat-GGUF
Text Generation
• 65B • Updated • 378
legraphista/Nxcode-CQ-7B-orpo-IMat-GGUF
Text Generation
• 7B • Updated • 409
• 3
legraphista/dolphin-2.9.2-Phi-3-Medium-IMat-GGUF
Text Generation
• 14B • Updated • 481
legraphista/dolphin-2.9.2-Phi-3-Medium-abliterated-IMat-GGUF
Text Generation
• 14B • Updated • 132
• 1
legraphista/Higgs-Llama-3-70B-IMat-GGUF
Text Generation
• 71B • Updated • 257
• 8
legraphista/Qwen2-7B-Instruct-IMat-GGUF
Text Generation
• 8B • Updated • 221
• 3
legraphista/Qwen2-0.5B-Instruct-IMat-GGUF
Text Generation
• 0.5B • Updated • 266
legraphista/Qwen2-0.5B-IMat-GGUF
Text Generation
• 0.5B • Updated • 463
legraphista/Qwen2-1.5B-Instruct-IMat-GGUF
Text Generation
• 2B • Updated • 711
• 1
legraphista/Qwen2-1.5B-IMat-GGUF
Text Generation
• 2B • Updated • 417
legraphista/Qwen2-7B-IMat-GGUF
Text Generation
• 8B • Updated • 999
legraphista/Qwen2-57B-A14B-Instruct-IMat-GGUF
Text Generation
• 57B • Updated • 74
• 2
legraphista/Qwen2-72B-Instruct-IMat-GGUF
Text Generation
• 73B • Updated • 445
• 1