Inference Providers
Active filters: 4bit
Tonic/c4ai-command-a-03-2025-4bit_nf4_double
Text Generation
• 114B • Updated • 5
Tonic/c4ai-command-a-03-2025-4bit_fp4
Text Generation
• 113B • Updated • 259
Tonic/c4ai-command-a-03-2025-4bit_nf4_no_double
Text Generation
• 113B • Updated • 720
Lowkey-Loki/Mistral-Small-3.1-24B-Instruct-TextOnly-mlx-4bit
Text Generation
• 4B • Updated • 23
adriabama06/ReaderLM-v2-AWQ
Text Generation
• 2B • Updated • 5
• 1
TheCluster/gemma-3-27b-it-uncensored-mlx-4bit
Image-Text-to-Text
• Updated • 644
• 4
Lowkey-Loki/gemma-3-12b-it-textonly-mlx-4bit
Text Generation
• 2B • Updated • 25
btbtyler09/Llama-3.1-8B-Instruct-gptq-4bit
Text Generation
• 8B • Updated • 1
IrfanHamid/ChatBot-lora-7b
Updated
Text Generation
• 8B • Updated • 9
• 1
Serione/Llama-3.2-1B-SRLQ-4bit
jjeccles/autoround-quantized-4bit
3B • Updated • 2
adriabama06/DeepCoder-1.5B-Preview-AWQ
Text Generation
• Updated • 2
bubblspace/Bubbl-P4-multimodal-instruct
6B • Updated • 11
• 7
TheCluster/amoral-gemma-3-12B-v2-mlx-4bit
Image-Text-to-Text
• Updated • 481
• 2
TheCluster/amoral-gemma-3-27B-v2-mlx-4bit
Image-Text-to-Text
• Updated • 26
BoltMonkey/boltmonkey_shortreasoning-8b
Text Generation
• 8B • Updated • 1
BoltMonkey/boltmonkey_shortreasoning-8b-Q5_K_M-GGUF
Text Generation
• 8B • Updated • 11
TechyCode/tinyllama-sciq-lora
Text Generation
• Updated Sumo10/Phi-4-mini-instruct-AWQ-4bit
4B • Updated • 48
• 1
Sumo10/Llama-3.2-3B-Instruct-AWQ-4bit
3B • Updated • 3
cyberandy/SEOcrate-4B_grpo_new_01
Text Generation
• 4B • Updated • 9
• 7
Chun121/qwen3-4B-rpg-roleplay
Text Generation
• 4B • Updated • 254
• 15
8B • Updated • 6
• 1
SujitShelar/llama3-medchat-8b-lora
Question Answering
• Updated boods/mistral-location-extractor-4bit
Text Generation
• 7B • Updated • 3
mradermacher/SEOcrate-4B_grpo_new_01-GGUF
Reinforcement Learning
• 4B • Updated • 147
• 1
mradermacher/SEOcrate-4B_grpo_new_01-i1-GGUF
Reinforcement Learning
• 4B • Updated • 301
vannishh/llama3-2.1B-4bit-finetuned
Programmer-RD-AI/ResearchQwen-2.5-3B-LoRA
Question Answering
• 3B • Updated • 12
• 4