Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,189

Base only

Active filters: quantization

elvinmarkmv/minimal-ai-models

Text Generation • Updated 5 days ago

Soulfate24/Spark-X2.5-4B-ASHQ1-Remix-GGUF

Text Generation • 4B • Updated 17 days ago • 1.14k

Yi30/wan2.2-ti2v-w4a8-svd-nvidia

Text-to-Video • Updated 17 days ago

SC117/MiniCPM5-2B-abliterated-FIT-GGUF

Text Generation • 3B • Updated 17 days ago • 3.07k • 1

ForeverBlue/nar-w4a4kv4-qwen3-base

Text Generation • Updated 2 days ago

ForeverBlue/nar-w4a4kv4-llama-3.1-70b

Text Generation • Updated 2 days ago

neopolita/Qwen3.6-23B-A3B-Niwaki-v2.1-4bit-mlx

Text Generation • 1.76k • Updated 17 days ago • 47

neopolita/Qwen3.6-23B-A3B-Niwaki-v2.1-2bit-mlx

Text Generation • 1.76k • Updated 17 days ago • 47

neopolita/Qwen3.6-23B-A3B-Niwaki-v2.1-4bit-gguf

Text Generation • 23B • Updated 17 days ago • 177

neopolita/Qwen3.6-23B-A3B-Niwaki-v2.1-2bit-gguf

Text Generation • 23B • Updated 17 days ago • 145

UraionLabs/MiniCPM5-2B-oQ8e

Text Generation • 3B • Updated 17 days ago • 216

UraionLabs/MiniCPM5-2B-oQ6e

Text Generation • 3B • Updated 17 days ago • 151

UraionLabs/MiniCPM5-2B-oQ5e

Text Generation • 3B • Updated 17 days ago • 156

UraionLabs/MiniCPM5-2B-oQ4e

Text Generation • 3B • Updated 17 days ago • 231 • 1

UraionLabs/MiniCPM5-2B-oQ3e

Text Generation • 3B • Updated 17 days ago • 164

UraionLabs/MiniCPM5-2B-oQ3.5e

Text Generation • 3B • Updated 17 days ago • 159

UraionLabs/MiniCPM5-2B-oQ2e

Text Generation • 3B • Updated 17 days ago • 173

UraionLabs/MiniCPM5-2B-oQ2.7e

Text Generation • 3B • Updated 17 days ago • 165

UraionLabs/MiniCPM5-2B-oQ2.5e

Text Generation • 3B • Updated 17 days ago • 212

ForeverBlue/nar-w4a4kv4-llama-3.2-3b

Text Generation • Updated 2 days ago

ForeverBlue/nar-w4a4kv4-llama-3.1-8b

Text Generation • Updated 2 days ago

KissTheHabit/yolov8n-table-yolo

Object Detection • Updated 14 days ago

mlx-community/MiniCPM5-2B-OptiQ-4bit

Text Generation • 3B • Updated 13 days ago • 2.1k • 4

Soulfate24/PaddleOCR-VL-1.6-ASHQ1-Remix-GGUF

Image-Text-to-Text • 0.5B • Updated 16 days ago • 1.09k

gratex/Ornith-1.5-397B-W4A16-g32-sym

Text Generation • 71B • Updated 16 days ago • 212

hoatac/gemma-4-E4B-it-AWQ

Text Generation • 8B • Updated 16 days ago • 797

hoatac/gemma-4-E4B-it-AWQ-mm

Image-Text-to-Text • 8B • Updated 16 days ago • 42

vcruz305/DSV4.1-Flash-EXL3-4.75bpw

Text Generation • 332B • Updated 4 days ago • 446 • 1

WaveCut/YuE2-3B-OrbitQuant-W4A4

Text Generation • 2B • Updated 15 days ago • 3.28k • 5

QUASAR-QAT/Muse-Glimmer-30B-QUASAR-NVFP4

Image-Text-to-Text • 30B • Updated 11 days ago • 181 • 2