Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

954

Base only

Active filters: 4bit

GainEnergy/ogai-8x7b-4bit

Text Generation • 48B • Updated Mar 5, 2025 • 1 • 1

ModelCloud/QwQ-32B-gptqmodel-4bit-vortex-v1

Text Generation • 33B • Updated Mar 9, 2025 • 9 • 12

syubraj/DietRecommender_4bit_Qwen2.5-0.5B

Text Generation • Updated Mar 11, 2025

Lowkey-Loki/Viper-Coder-v1.7-Vsm6-MLX-4bit

2B • Updated Mar 11, 2025 • 3

Lowkey-Loki/reka-flash-3-mlx-4bit

3B • Updated Mar 11, 2025 • 7 • 1

Tonic/c4ai-command-a-03-2025-4bit_nf4_double

Text Generation • 114B • Updated Mar 13, 2025 • 7

Tonic/c4ai-command-a-03-2025-4bit_fp4

Text Generation • 113B • Updated Mar 13, 2025 • 7

Tonic/c4ai-command-a-03-2025-4bit_nf4_no_double

Text Generation • 113B • Updated Mar 13, 2025 • 7

Lowkey-Loki/Mistral-Small-3.1-24B-Instruct-TextOnly-mlx-4bit

Text Generation • 4B • Updated Mar 18, 2025 • 28

adriabama06/ReaderLM-v2-AWQ

Text Generation • 2B • Updated May 16, 2025 • 6 • 1

TheCluster/gemma-3-27b-it-uncensored-mlx-4bit

Image-Text-to-Text • Updated Apr 16, 2025 • 400 • 4

Lowkey-Loki/gemma-3-12b-it-textonly-mlx-4bit

Text Generation • 2B • Updated Mar 23, 2025 • 28

btbtyler09/Llama-3.1-8B-Instruct-gptq-4bit

Text Generation • 8B • Updated Apr 5, 2025 • 1

IrfanHamid/ChatBot-lora-7b

Updated Apr 8, 2025

Alxis955/qwen25-adv-lora

Text Generation • 8B • Updated Apr 8, 2025 • 7 • 1

Serione/Llama-3.2-1B-SRLQ-4bit

Updated Apr 9, 2025 • 2

jjeccles/autoround-quantized-4bit

3B • Updated Apr 9, 2025 • 2

adriabama06/DeepCoder-1.5B-Preview-AWQ

Text Generation • Updated Apr 13, 2025 • 2 • 2

bubblspace/Bubbl-P4-multimodal-instruct

6B • Updated Apr 15, 2025 • 10 • 7

TheCluster/amoral-gemma-3-12B-v2-mlx-4bit

Image-Text-to-Text • Updated Apr 16, 2025 • 458 • 2

TheCluster/amoral-gemma-3-27B-v2-mlx-4bit

Image-Text-to-Text • Updated Apr 16, 2025 • 9

BoltMonkey/boltmonkey_shortreasoning-8b

Text Generation • 8B • Updated Apr 18, 2025 • 34 •

BoltMonkey/boltmonkey_shortreasoning-8b-Q5_K_M-GGUF

Text Generation • 8B • Updated Apr 18, 2025 • 8

TechyCode/tinyllama-sciq-lora

Text Generation • Updated Apr 23, 2025

Sumo10/Phi-4-mini-instruct-AWQ-4bit

4B • Updated Apr 25, 2025 • 113 • 1

Sumo10/Llama-3.2-3B-Instruct-AWQ-4bit

3B • Updated Apr 25, 2025 • 5

cyberandy/SEOcrate-4B_grpo_new_01

Text Generation • 4B • Updated May 8, 2025 • 23 • 7

Chun121/qwen3-4B-rpg-roleplay

Text Generation • 4B • Updated Jul 7, 2025 • 382 • 15

taetae030/fin-term-model

8B • Updated May 4, 2025 • 16 • 1

SujitShelar/llama3-medchat-8b-lora

Question Answering • Updated May 5, 2025