Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

20,853

Base only

Active filters: quantized

InternScience/Agents-A1-Q4_K_M-GGUF

Text Generation • 35B • Updated Jul 15 • 19.9k • 153

AtomicChat/Qwen3.5-9B-GGUF

Text Generation • 9B • Updated 6 days ago • 19k • 4

AtomicChat/Qwen3.6-35B-A3B-GGUF

Text Generation • 35B • Updated 6 days ago • 6.79k • 4

ddalcu/Hunyuan3D-2.1-MLX-Serve-8bit

Image-to-3D • Updated Jul 25 • 573 • 8

lmcoleman/ThinkingCap-Qwen3.6-27B-MagicQuant-GGUF

Text Generation • 27B • Updated Aug 20 • 210 • 7

Brian6145/Qwen3.6-27B-Claude-Opus-DeepSeek-Distilled-Imatrix-MTP-1M-GGUF

Text Generation • 27B • Updated Aug 23 • 730 • 8

brewbadgertim/10Eros_Quants

Updated Jul 10 • 3

liodon-ai/Qwen2.5-7B-imatrix-GGUF

Text Generation • 8B • Updated Jul 13 • 178 • 2

YoozLabs/Qwen3.5-4B-qat-GGUF

Text Generation • 4B • Updated Jul 13 • 167 • 3

InternScience/Agents-A1-4B-Q8_0-GGUF

Text Generation • 4B • Updated Jul 14 • 171k • 51

realrebelai/Krea-R-Turbo

Text-to-Image • 13B • Updated Jul 17 • 3.31k • 13

ChrisColeTech/qwen-image-edit-turbo-GGUF

Image-to-Image • 20B • Updated Aug 19 • 1.1k • 2

mlx-community/gemma-4-12B-coder-fable5-composer2.5-v1-OptiQ-4bit

Image-Text-to-Text • 12B • Updated 16 days ago • 858 • 11

m15dg/local-ai-toolkit

Text Generation • 35B • Updated Jul 18 • 26.9k • 35

ggml-org/gemma-4-12B-GGUF

Any-to-Any • 12B • Updated 2 days ago • 2.28k • 6

ggml-org/gemma-4-26B-A4B-GGUF

Image-Text-to-Text • 25B • Updated 15 days ago • 908 • 2

infosave/Bonsai-27Bcmf

Text Generation • Updated 12 days ago • 1.26k • 3

unsloth/Wan2.2-T2V-A14B-FP8

Text-to-Video • 14B • Updated 18 days ago • 105 • 6

yugeshkarunamurthy/OvisOCR2-oQ6e

Image-Text-to-Text • 0.9B • Updated Jul 18 • 28 • 1

infosave/Bonsai-1.7Bcmf

Text Generation • Updated 12 days ago • 1.42k • 2

yashwork-byte/indic-conformer-600m-int8-onnx

Updated Jul 18 • 242 • 4

Mazino0/slim-onnx

Token Classification • Updated Jul 19 • 6 • 1

barozp/Qwen3.6-29B-REAP-Opus-Reasoning-Distill-MTP-GGUF

Text Generation • 29B • Updated Jul 22 • 1.18k • 13

Myric/granite-4.0-h-small-APEX-GGUF

Text Generation • 32B • Updated Jul 22 • 201 • 1

Aronstk15/DeepHat-V1-7B-Mixed-IQ4

8B • Updated Jul 22 • 103 • 2

Intel/Qwen3.6-35B-A3B-int2-mixed-CT-AutoRound

Image-Text-to-Text • 4B • Updated Aug 14 • 66 • 5

antirez/Laguna-S-2.1-GGUF

Text Generation • 118B • Updated Jul 26 • 207 • 12

mfielding92/SmartCode-Fable-5-CoT-Reasoning-QKVO-Qwen-3.6-27B-Distilled

27B • Updated Jul 26 • 4.17k • 11

F-A-I-L/llama-3.2-1b-mini-agent

Text Generation • 1B • Updated Sep 9 • 392 • 1

Stick9190/qwen_3_8b_f2k_int8_convrot

Updated Jul 26 • 8