Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,833

Base only

Active filters: quantization

AsadIsmail/whisper-large-v3-ternary

Automatic Speech Recognition • Updated Apr 27

YTan2000/Gemma4-26b-Super-Abliterated-TQ3_4S

Image-Text-to-Text • 25B • Updated Apr 14 • 217 • 8

D-Squarius-Green-Jr/Nucleus-Image-FP8

Text-to-Image • Updated Apr 15 • 32 • 4

chrisdemonxxx/Qwen3.5-397B-A17B-heretic-int4-AutoRound-fixed

Text Generation • Updated Apr 15 • 35

AsadIsmail/gemma-4-31B-it-ternary

Image-Text-to-Text • Updated Apr 15 • 1

lhca521/Gemma4-26b-Super-Abliterated-TQ3_4S

Image-Text-to-Text • 25B • Updated Apr 15 • 13

AMAImedia/Qwen3-8B-Nemotron-Orchestrator-NOESIS-AWQ-INT4

Text Generation • 8B • Updated Apr 26 • 5 • 1

MLliu6/Qwen3-VL-4B-Instruct-AWQ-W4A16

Image-Text-to-Text • 5B • Updated Apr 25 • 2.15k

MLliu6/Qwen3-VL-8B-Instruct-AWQ-W4A16

Image-Text-to-Text • 3B • Updated Apr 17 • 5.55k

EnsueAI/metal-int4-sdpa

Updated Apr 21 • 3 • 6

AMAImedia/Qwen3-32B-T-pro-it-2.1-NOESIS-AWQ-INT4

Text Generation • 33B • Updated Apr 26 • 107 • 1

Abiray/Qwen3.6-35B-A3B-Q3_K_M-GGUF

Image-Text-to-Text • 35B • Updated Apr 16 • 226

Abiray/Qwen3.6-35B-A3B-Q4_K_M-GGUF

Image-Text-to-Text • 35B • Updated Apr 16 • 8.16k • 17

Abiray/Qwen3.6-35B-A3B-Q5_K_M-GGUF

Image-Text-to-Text • 35B • Updated Apr 16 • 593 • 4

Abiray/Qwen3.6-35B-A3B-Q6_K-GGUF

Image-Text-to-Text • 35B • Updated Apr 16 • 603 • 3

Abiray/Qwen3.6-35B-A3B-Q8_0-GGUF

Image-Text-to-Text • 35B • Updated Apr 16 • 345 • 1

Abiray/Qwen3.6-35B-A3B-Q4_K_S-GGUF

Image-Text-to-Text • 35B • Updated Apr 16 • 269 • 2

Abiray/Qwen3.6-35B-A3B-heretic-GGUF

Image-Text-to-Text • 35B • Updated Apr 17 • 474 • 17

Abiray/Qwen3.6-35B-A3B-heretic-Q4_K_M-GGUF

Image-Text-to-Text • 35B • Updated Apr 17 • 208 • 8

scottgl/MiniMax-M2.7-REAP-172B-A10B-NVFP4-GB10

Text Generation • 98B • Updated Apr 16 • 29.1k • 3

YTan2000/Huihui-Qwen35-A35B-Ablit-Small-TQ3_4S

Image-Text-to-Text • 35B • Updated Apr 16 • 124 • 1

neroai14/Nero-Qwen2.5-1.5B-Surgical

2B • Updated Apr 18 • 3 • 1

majentik/garden

Text Generation • Updated Apr 17

AsadIsmail/CogVideoX-2b-ternary

Text-to-Video • Updated Apr 27 • 2

AsadIsmail/CogVideoX-5b-ternary

Text-to-Video • Updated Apr 27 • 1

sphaela/gemma-4-E2B-it-AutoRound-GGUF

5B • Updated Apr 24 • 185

armanibadboy/gemma-4-31b-it-route-b-perhead-k37

sphaela/gemma-4-E4B-it-AutoRound-GGUF

8B • Updated Apr 24 • 328 • 1

armanibadboy/discrete-weight-language-gemma-4-31b-it-all-linear

Image-Text-to-Text • 31B • Updated Apr 17 • 2

sphaela/gemma-4-31B-it-AutoRound-GGUF

31B • Updated Apr 24 • 378 • 1