Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

15,964

Base only

Active filters: quantized

mlx-community/Qwen3.5-9B-MLX-8bit

3B • Updated Mar 2 • 1.23k • 14

mlx-community/Qwen3.5-4B-OptiQ-4bit

Text Generation • 0.9B • Updated Jul 14 • 8.99k • 29

dealignai/Qwen3.5-VL-9B-JANG_4S-CRACK

Image-Text-to-Text • 10B • Updated Apr 17 • 632 • 11

dealignai/Nemotron-Cascade-2-30B-A3B-JANG_2L-CRACK

Text Generation • 36B • Updated Apr 17 • 117 • 7

mudler/Qwen3.5-35B-A3B-APEX-GGUF

Text Generation • 35B • Updated 16 days ago • 257k • 94

mudler/gemma-4-26B-A4B-it-heretic-APEX-GGUF

25B • Updated 16 days ago • 23.6k • 52

mudler/gemma-4-26B-A4B-it-Claude-Opus-Distill-APEX-GGUF

25B • Updated 16 days ago • 22.6k • 25

mudler/Huihui3.5-67B-A3B-APEX-GGUF

67B • Updated 16 days ago • 3.35k • 4

douyamv/Gemma-4-31B-JANG_4M-CRACK-GGUF

Text Generation • 31B • Updated Apr 9 • 9.69k • 239

AEON-7/Gemma-4-26B-A4B-it-Uncensored-NVFP4

Text Generation • 15B • Updated Jul 15 • 8.63k • 23

groxaxo/Huihui-gemma-4-26B-A4B-it-abliterated-GGUF

Image-Text-to-Text • 25B • Updated 11 days ago • 17.7k • 30

iamhsouna/Huihui-gemma-4-26B-A4B-it-abliterated-GGUF

Image-Text-to-Text • 25B • Updated Jul 1 • 150 • 1

ermiaazarkhalili/LFM2.5-1.2B-SFT-Claude-Opus-Reasoning-Unsloth-GGUF

Text Generation • 1B • Updated 28 days ago • 486 • 1

mad-lab-ai/Qwen3.6-35B-A3B-tq-gguf

35B • Updated Apr 16 • 364 • 5

DuoNeural/Qwen3.6-35B-A3B-Code-imatrix-GGUF

Text Generation • 35B • Updated Apr 29 • 504 • 15

sakamakismile/Huihui-Qwen3.6-35B-A3B-abliterated-NVFP4

Image-Text-to-Text • Updated Apr 29 • 8.13k • 12

hesamation/Qwen3.6-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-GGUF

Text Generation • 35B • Updated Apr 19 • 298k • 292

wangzhang/gemma-4-31B-it-abliterated-GGUF

Text Generation • 31B • Updated 4 days ago • 3.79k • 9

mudler/Qwen3.6-35B-A3B-uncensored-heretic-APEX-GGUF

35B • Updated 16 days ago • 25.4k • 74

sakamakismile/Huihui-Qwen3.6-35B-A3B-Claude-4.7-Opus-abliterated-NVFP4

Image-Text-to-Text • Updated Apr 29 • 5.59k • 19

ggml-org/Qwen3.6-27B-GGUF

Image-Text-to-Text • 27B • Updated Jul 16 • 43.5k • 23

Code4me2/bu-30b-a3b-preview-NVFP4

Image-Text-to-Text • 16B • Updated Apr 24 • 34 • 2

GestaltLabs/Ornstein-Hermes-3.6-27B-GGUF

Image-Text-to-Text • 27B • Updated Apr 26 • 23.8k • 12

Deviad/DeepSeek-V4-Flash-MLX-Q4Q8

Text Generation • 149B • Updated Apr 29 • 197 • 1

OsaurusAI/Mistral-Medium-3.5-128B-JANGTQ

Image-Text-to-Text • 14B • Updated May 1 • 242 • 3

drawais/Qwen3-Embedding-4B-AWQ-INT4

Text Generation • 4B • Updated May 2 • 13.7k • 5

DuoNeural/Phi-4-mini-instruct-GGUF

Text Generation • 4B • Updated May 3 • 385 • 1

localweights/Qwen3.6-35B-A3B-MTP-IMAT-IQ4_XS-Q8nextn-GGUF

Text Generation • 36B • Updated Jul 16 • 770 • 4

AtomicChat/gemma-4-31B-it-assistant-GGUF

Text Generation • 0.5B • Updated Jul 23 • 2.19k • 18

Abiray/Sulphur-2-base-GGUF

Text-to-Video • 21B • Updated May 30 • 137k • 80