Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,832

Base only

Active filters: quantization

NICKO/SmolLM2-1.7B-BonfyreFPQ-v12

NICKO/TinyLlama-1.1B-BonfyreFPQ-v12

Venugopalan2610/quant-olmoe-2bit

Text Generation • Updated Apr 18

AEON-7/Gemma-4-E4B-DECKARD-HERETIC-NVFP4

Text Generation • 6B • Updated 7 days ago • 77

navanchauhan/Huihui-Qwopus3.5-9B-v3-abliterated-TQ3_4S

Text Generation • 9B • Updated Apr 14 • 23

srijayadav/llama3-8b-qlora-alpaca

Text Generation • Updated Apr 13 • 1

KeinNiemand/Qwen3.5-122B-A10B-abliterix-IK_GGUF

Text Generation • 122B • Updated Apr 14 • 178 • 2

MLliu6/Qwen3-VL-2B-Instruct-AWQ-W4A16

Image-Text-to-Text • 2B • Updated Apr 17 • 34

dangvansam/chandra-ocr-2-FP8-dynamic

Image-Text-to-Text • 5B • Updated May 26 • 706

majentik/Voxtral-Mini-3B-2507-TurboQuant-MLX-8bit

Automatic Speech Recognition • 5B • Updated Apr 21 • 57

majentik/Voxtral-Mini-3B-2507-RotorQuant-MLX-8bit

Automatic Speech Recognition • 5B • Updated Apr 21 • 17

majentik/Voxtral-Mini-3B-2507-TurboQuant-MLX-4bit

Automatic Speech Recognition • 5B • Updated Apr 21 • 19

majentik/Voxtral-Mini-3B-2507-RotorQuant-MLX-4bit

Automatic Speech Recognition • 5B • Updated Apr 21 • 15

majentik/Voxtral-Mini-3B-2507-TurboQuant-MLX-2bit

Automatic Speech Recognition • 5B • Updated Apr 21 • 43

majentik/Voxtral-Mini-3B-2507-RotorQuant-MLX-2bit

Automatic Speech Recognition • 5B • Updated Apr 21 • 18

majentik/Voxtral-Mini-4B-Realtime-2602-TurboQuant-MLX-8bit

Automatic Speech Recognition • 1B • Updated Apr 21 • 40

majentik/Voxtral-Mini-4B-Realtime-2602-RotorQuant-MLX-8bit

Automatic Speech Recognition • 1B • Updated Apr 21 • 26

majentik/Voxtral-Mini-4B-Realtime-2602-TurboQuant-MLX-4bit

Automatic Speech Recognition • 0.7B • Updated Apr 21 • 22

majentik/Voxtral-Mini-4B-Realtime-2602-RotorQuant-MLX-4bit

Automatic Speech Recognition • 0.7B • Updated Apr 21 • 13

majentik/Voxtral-Mini-4B-Realtime-2602-TurboQuant-MLX-2bit

Automatic Speech Recognition • 0.4B • Updated Apr 21 • 20

majentik/Voxtral-Mini-4B-Realtime-2602-RotorQuant-MLX-2bit

Automatic Speech Recognition • 0.4B • Updated Apr 21 • 15

majentik/Voxtral-4B-TTS-2603-TurboQuant-MLX-8bit

Text-to-Speech • Updated Apr 21 • 34

majentik/Voxtral-4B-TTS-2603-RotorQuant-MLX-8bit

Text-to-Speech • Updated Apr 21 • 20

majentik/Voxtral-4B-TTS-2603-TurboQuant-MLX-4bit

Text-to-Speech • Updated Apr 21 • 19

majentik/Voxtral-4B-TTS-2603-RotorQuant-MLX-4bit

Text-to-Speech • Updated Apr 21 • 48 • 1

majentik/Voxtral-4B-TTS-2603-TurboQuant-MLX-2bit

Text-to-Speech • Updated Apr 21 • 13

majentik/Voxtral-4B-TTS-2603-RotorQuant-MLX-2bit

Text-to-Speech • Updated Apr 21 • 14

AsadIsmail/Qwen2.5-VL-7B-Instruct-ternary

Image-Text-to-Text • Updated Apr 27

AsadIsmail/gemma-4-E4B-it-ternary

Image-Text-to-Text • Updated Apr 27

AsadIsmail/SmolVLM2-2.2B-Instruct-ternary

Image-Text-to-Text • Updated Apr 15