Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

mixed-quantization

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

14

Base only

Active filters: mixed-quantization

shieldstackllc/Step-3.5-Flash-REAP-128B-A11B-mlx-mixed-4-6

Text Generation • 121B • Updated Feb 16 • 58

GOBA-AI-Labs/PrunedHub-Qwen3-30B-A3B-EN-80pct-MxMoE

Text Generation • 25B • Updated Feb 23 • 9

GOBA-AI-Labs/PrunedHub-Qwen3-30B-A3B-JP-80pct-MxMoE

Text Generation • 25B • Updated Feb 23 • 3

Phipper/qwen3.5-27b-opus-distilled-proposal-c

Text Generation • 27B • Updated Apr 2 • 11

Asystemoffields/Qwen3-1.7B-PMRA-IQ3XS-budget-GGUF

Text Generation • 2B • Updated Jun 2 • 33

Asystemoffields/gemma-4-E2B-it-PMRA-GGUF

Text Generation • 5B • Updated Jun 2 • 208

andrzejmontano/Qwen3-VL-Embedding-8B-mlx-8bit

Sentence Similarity • 3B • Updated May 14 • 854

Asystemoffields/Huihui-Qwen3.5-4B-Abliterated-PMRA-GGUF

Text Generation • 4B • Updated Jun 2 • 148

Asystemoffields/Ministral-3-8B-Instruct-PMRA-GGUF

Text Generation • 8B • Updated Jun 2 • 70 • 1

Asystemoffields/IBM-granite-4.1-8b-heretic-PMRA-GGUF

Text Generation • 8B • Updated Jun 2 • 60 • 1

andrzejmontano/tmax-27b-MTP-vision-BF16-8bit

Image-Text-to-Text • 15B • Updated 16 days ago • 239 • 1

andrzejmontano/Qwen3.5-9B-MTP-Mixed-8bit

Image-Text-to-Text • Updated 9 days ago • 119

andrzejmontano/gemma-4-12B-it-Mixed-8bit

Image-Text-to-Text • Updated 9 days ago • 262

Alkd/TEA-ASR-1.1-MLX-4bit

Automatic Speech Recognition • 0.4B • Updated about 17 hours ago