Inference Providers
Active filters: 4bit
Jimmi42/sarvam-m-4bit-mlx
Text Generation
• 4B • Updated • 104
• 2
geninhu/RakutenAI-7B-instruct-GPTQ
umangshikarvar/sentiment-qlora-gptneo
Text Classification
• Updated • 4
Fulstac/deepseek-r1-Distill-Qwen-32B-sqlgen-4bit-v1
Text Generation
• 33B • Updated • 2
Fulstac/deepseek-r1-Distill-Qwen-32B-lora-4bit-v3
Text Generation
• 33B • Updated • 3
acauanrr/qlora-ti-2025-adapter
abdou-u/MNLP_M3_quantized_dpo_mcqa_model
Multiple Choice
• 0.6B • Updated • 1
Text Generation
• 4B • Updated • 3
ayureasehealthcare/ayurezeastraai
Text Generation
• Updated Renugadevi82/cisco-nx-ai-4bit
1B • Updated avinashhm/Llama-3.1-Nemotron-Nano-4B-v1.1-GPTQ
Text Generation
• 5B • Updated • 2
btbtyler09/Kimi-Dev-72B-GPTQ-4bit
Text Generation
• 73B • Updated • 66
• 2
riddhimanrana/fastvlm-0.5b-captions
Image-Text-to-Text
• 99.1M • Updated • 127
• 3
Text Generation
• 0.4B • Updated • 2
• 1
adriabama06/GLM-4-9B-0414-exl3
Text Generation
• Updated • 2
• 1
JustJaro/SmolLM-135M_gptq_g32_4bit
Text Generation
• 0.1B • Updated • 2
ConfidentialMind/Mistral-Small-3.2-24B-Instruct-2506-GPTQ-AutoRound-TextOnly
Text Generation
• 24B • Updated • 120
btbtyler09/Qwen3-30B-A3B-gptq-4bit
Text Generation
• 31B • Updated • 25
dsuram/mistral-medical-finetuned
Text Generation
• Updated nxtcloud-org/kanana-safeguard-8b-bitsandbytes-4bit
Text Generation
• 8B • Updated • 40
• 1
nxtcloud-org/kanana-safeguard-prompt-2.1b-bitsandbytes-4bit
2B • Updated • 22
• 1
nxtcloud-org/kanana-safeguard-siren-8b-bitsandbytes-4bit
8B • Updated • 22
• 1
Cre4T3Tiv3/unsloth-llama3-alpaca-lora
Text Generation
• Updated crazymaker1122/Llama-3.3-8B-Instruct-awq-direct
Text Generation
• 8B • Updated • 1
Susant-Achary/smollm3-indian-recipes
Text Generation
• Updated • 3
PJEDeveloper/Mistral-Nemo-Instruct-2407-4bit-20250714_213418
Text Generation
• 13B • Updated • 2
adamrb/mpt-30b-chat-w4a16-gptq
30B • Updated • 1
PJEDeveloper/Mistral-7B-Instruct-v0.3-4bit-20250716_003938
Text Generation
• 7B • Updated • 2
PJEDeveloper/Mistral-7B-Instruct-v0.2-4bit-20250716_010928
Text Generation
• 7B • Updated • 2
kivoai/tinyllama-1.1b-chat-gptq
Text Generation
• Updated • 2