Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

mixed-quantization

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

31

Base only

Active filters: mixed-quantization

Jmica/Drama-3-GGUF

Text-to-Speech • Updated about 8 hours ago • 1.21k • 8

shieldstackllc/Step-3.5-Flash-REAP-128B-A11B-mlx-mixed-4-6

Text Generation • 121B • Updated Feb 16 • 23

GOBA-AI-Labs/PrunedHub-Qwen3-30B-A3B-EN-80pct-MxMoE

Text Generation • 25B • Updated Feb 23 • 11

GOBA-AI-Labs/PrunedHub-Qwen3-30B-A3B-JP-80pct-MxMoE

Text Generation • 25B • Updated Feb 23 • 12

Phipper/qwen3.5-27b-opus-distilled-proposal-c

Text Generation • 27B • Updated Apr 2 • 13

Asystemoffields/Qwen3-1.7B-PMRA-IQ3XS-budget-GGUF

Text Generation • 2B • Updated Jun 2 • 16

Asystemoffields/gemma-4-E2B-it-PMRA-GGUF

Text Generation • 5B • Updated Jun 2 • 22

andrzejmontano/Qwen3-VL-Embedding-8B-mlx-8bit

Sentence Similarity • 9B • Updated May 14 • 70

Asystemoffields/Huihui-Qwen3.5-4B-Abliterated-PMRA-GGUF

Text Generation • 4B • Updated Jun 2 • 103

Asystemoffields/Ministral-3-8B-Instruct-PMRA-GGUF

Text Generation • 8B • Updated Jun 2 • 19 • 1

Asystemoffields/IBM-granite-4.1-8b-heretic-PMRA-GGUF

Text Generation • 8B • Updated Jun 2 • 16 • 1

TheGreatQuran/QuranKarim-SpeechToText-onnxModel

Automatic Speech Recognition • Updated Jul 31

andrzejmontano/tmax-27b-MTP-vision-BF16-8bit

Image-Text-to-Text • 28B • Updated Jun 26 • 12 • 1

andrzejmontano/Qwen3.5-9B-MTP-Mixed-8bit

Image-Text-to-Text • Updated Jul 3 • 21

andrzejmontano/gemma-4-12B-it-Mixed-8bit

Image-Text-to-Text • Updated Jul 3 • 8

Alkd/TEA-ASR-1.1-MLX-4bit

Automatic Speech Recognition • 2B • Updated Jul 11 • 53 • 2

Avifenesh/Hy3-REAP-Layer103p5-bw24

Text Generation • Updated Jul 21 • 1

Baekpica/K-EXAONE-236B-A23B-Mixed-Quant-GGUF

Text Generation • 237B • Updated Aug 14 • 227 • 1

Baekpica/Motif-3-Mixed-Quant-GGUF

Text Generation • 315B • Updated Aug 30 • 370 • 4

faelfernandes/Qwen3.8-27B-3.5bit

27B • Updated Aug 14 • 107

Baekpica/dots3-note-prev-Mixed-Quant-GGUF

Text Generation • 281B • Updated Sep 6 • 200 • 3

soyaakinohara/gemma-4-31b-it-heretic-3.68bpw-14gb.gguf

Text Generation • 31B • Updated 27 days ago • 594 • 2

Etherealty/Huihui-Qwen3.5-4B-Abliterated-PMRA-GGUF

Text Generation • 4B • Updated Sep 4 • 98 • 1

Ayaz672i/Huihui-Qwen3.5-4B-Abliterated-PMRA-GGUF

Text Generation • 4B • Updated Sep 7 • 205 • 1

Baekpica/Inkling-Small-GGUF

Image-Text-to-Text • Updated Sep 11 • 351

Baekpica/Inkling-Small-Mixed-Quant-GGUF

Image-Text-to-Text • Updated 23 days ago • 1.02k • 2

Baekpica/IQuest-Q1-Mixed-Quant-GGUF

Text Generation • Updated 13 days ago • 991 • 2

kunthawat/swift-qwen3.8-27b-mixed-iq3-gguf

Image-Text-to-Text • 0.5B • Updated about 22 hours ago • 472

shamidk/apex-flash-1-DS4-Q2-GGUF

Text Generation • 321B • Updated 10 days ago • 297 • 1

shamidk/apex-flash-1-abliterated-DS4-Q2-GGUF

Text Generation • 321B • Updated 10 days ago • 307 • 2