-
-
-
-
-
-
Inference Providers
Active filters:
4bit
Fulstac/deepseek-r1-Distill-Qwen-32B-lora-4bit-v3
Text Generation
•
33B
•
Updated
•
14
acauanrr/qlora-ti-2025-adapter
Updated
abdou-u/MNLP_M3_quantized_dpo_mcqa_model
Multiple Choice
•
0.6B
•
Updated
•
1
Text Generation
•
4B
•
Updated
•
3
ayureasehealthcare/ayurezeastraai
Text Generation
•
Updated
Renugadevi82/cisco-nx-ai-4bit
1B
•
Updated
•
2
avinashhm/Llama-3.1-Nemotron-Nano-4B-v1.1-GPTQ
Text Generation
•
5B
•
Updated
•
1
btbtyler09/Kimi-Dev-72B-GPTQ-4bit
Text Generation
•
73B
•
Updated
•
27
•
2
riddhimanrana/fastvlm-0.5b-captions
Image-Text-to-Text
•
99.1M
•
Updated
•
257
•
3
Text Generation
•
0.4B
•
Updated
•
2
•
1
adriabama06/GLM-4-9B-0414-exl3
Text Generation
•
Updated
•
1
•
1
JustJaro/SmolLM-135M_gptq_g32_4bit
Text Generation
•
0.1B
•
Updated
•
2
ConfidentialMind/Mistral-Small-3.2-24B-Instruct-2506-GPTQ-AutoRound-TextOnly
Text Generation
•
24B
•
Updated
•
81
btbtyler09/Qwen3-30B-A3B-gptq-4bit
Text Generation
•
31B
•
Updated
•
7
dsuram/mistral-medical-finetuned
Text Generation
•
Updated
nxtcloud-org/kanana-safeguard-8b-bitsandbytes-4bit
Text Generation
•
8B
•
Updated
•
2
•
1
nxtcloud-org/kanana-safeguard-prompt-2.1b-bitsandbytes-4bit
2B
•
Updated
•
1
•
1
nxtcloud-org/kanana-safeguard-siren-8b-bitsandbytes-4bit
8B
•
Updated
•
2
•
1
Cre4T3Tiv3/unsloth-llama3-alpaca-lora
Text Generation
•
Updated
crazymaker1122/Llama-3.3-8B-Instruct-awq-direct
Text Generation
•
8B
•
Updated
•
3
Susant-Achary/smollm3-indian-recipes
Text Generation
•
Updated
•
11
PJEDeveloper/Mistral-Nemo-Instruct-2407-4bit-20250714_213418
Text Generation
•
13B
•
Updated
•
1
adamrb/mpt-30b-chat-w4a16-gptq
30B
•
Updated
PJEDeveloper/Mistral-7B-Instruct-v0.3-4bit-20250716_003938
Text Generation
•
7B
•
Updated
•
1
PJEDeveloper/Mistral-7B-Instruct-v0.2-4bit-20250716_010928
Text Generation
•
7B
•
Updated
•
1
kivoai/tinyllama-1.1b-chat-gptq
Text Generation
•
Updated
•
1
Hariprasath28/orpheus-3b-4bit-AWQ
Text Generation
•
3B
•
Updated
•
328
codemajesty/gemma2b-4bit-quantized
Text Generation
•
3B
•
Updated
•
3
Irfanuruchi/1B-building-engineering-llm
1B
•
Updated
•
8
Irfanuruchi/Llama-3.2-3B-Computer-Engineering-LLM
3B
•
Updated
•
9