Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,481

Base only

Active filters: quantization

zhangsq-nju/Qwen3-0.6B-EdgeRazor-1.88bit

Text Generation • 0.6B • Updated Jun 11 • 49 • 1

zhangsq-nju/Qwen3-0.6B-EdgeRazor-1.58bit

Text Generation • 0.6B • Updated Jun 11 • 86 • 1

zhangsq-nju/Qwen3-1.7B-EdgeRazor-4bit

Text Generation • 2B • Updated Jun 11 • 34 • 1

zhangsq-nju/Qwen3-1.7B-EdgeRazor-2.79bit

Text Generation • 2B • Updated Jun 11 • 51 • 1

zhangsq-nju/Qwen3-1.7B-EdgeRazor-1.88bit

Text Generation • 2B • Updated Jun 11 • 67 • 2

zhangsq-nju/Qwen3-1.7B-EdgeRazor-1.58bit

Text Generation • 2B • Updated Jun 11 • 91 • 2

zhangsq-nju/MobileLLM-350M-EdgeRazor-4bit

Text Generation • 0.4B • Updated Jun 11 • 36 • 1

zhangsq-nju/MobileLLM-350M-EdgeRazor-2.79bit

Text Generation • 0.4B • Updated Jun 11 • 44 • 1

zhangsq-nju/MobileLLM-350M-EdgeRazor-1.88bit

Text Generation • 0.4B • Updated Jun 11 • 29 • 1

zhangsq-nju/MobileLLM-350M-EdgeRazor-1.58bit

Text Generation • 0.4B • Updated Jun 11 • 38 • 1

zhangsq-nju/Qwen2.5-Omni-7B-EdgeRazor-4bit

Text Generation • 11B • Updated May 11 • 38 • 1

zhangsq-nju/Qwen3-0.6B-EdgeRazor-GGUF

Text Generation • 0.8B • Updated May 11 • 76 • 8

zhangsq-nju/Qwen3-1.7B-EdgeRazor-GGUF

Text Generation • 2B • Updated May 11 • 115 • 11

NICKO/Qwen2.5-3B-BonfyreFPQ-v12

NICKO/SmolLM2-1.7B-BonfyreFPQ-v12

NICKO/TinyLlama-1.1B-BonfyreFPQ-v12

Venugopalan2610/quant-olmoe-2bit

Text Generation • Updated Apr 18

AEON-7/Gemma-4-E4B-DECKARD-HERETIC-NVFP4

Text Generation • 6B • Updated Jun 21 • 163k • 1

navanchauhan/Huihui-Qwopus3.5-9B-v3-abliterated-TQ3_4S

Text Generation • 9B • Updated Apr 14 • 7

srijayadav/llama3-8b-qlora-alpaca

Text Generation • Updated Apr 13 • 1

KeinNiemand/Qwen3.5-122B-A10B-abliterix-IK_GGUF

Text Generation • 122B • Updated Apr 14 • 53 • 2

MLliu6/Qwen3-VL-2B-Instruct-AWQ-W4A16

Image-Text-to-Text • 2B • Updated Apr 17 • 15

dangvansam/chandra-ocr-2-FP8-dynamic

Image-Text-to-Text • 5B • Updated May 26 • 13.1k • 1

majentik/Voxtral-Mini-3B-2507-TurboQuant-MLX-8bit

Automatic Speech Recognition • 5B • Updated 25 days ago • 82

majentik/Voxtral-Mini-3B-2507-RotorQuant-MLX-8bit

Automatic Speech Recognition • 5B • Updated 25 days ago • 66

majentik/Voxtral-Mini-3B-2507-TurboQuant-MLX-4bit

Automatic Speech Recognition • 5B • Updated 25 days ago • 94

majentik/Voxtral-Mini-3B-2507-RotorQuant-MLX-4bit

Automatic Speech Recognition • 5B • Updated 25 days ago • 82

majentik/Voxtral-Mini-3B-2507-TurboQuant-MLX-2bit

Automatic Speech Recognition • 5B • Updated 25 days ago • 78

majentik/Voxtral-Mini-3B-2507-RotorQuant-MLX-2bit

Automatic Speech Recognition • 5B • Updated 25 days ago • 70

majentik/Voxtral-Mini-4B-Realtime-2602-TurboQuant-MLX-8bit

Automatic Speech Recognition • 1B • Updated 25 days ago • 141