Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,480

Base only

Active filters: quantization

Abiray/Qwen3.6-35B-A3B-Q4_K_S-GGUF

Image-Text-to-Text • 35B • Updated Apr 16 • 102 • 3

Abiray/Qwen3.6-35B-A3B-heretic-GGUF

Image-Text-to-Text • 35B • Updated Apr 17 • 1.54k • 17

Abiray/Qwen3.6-35B-A3B-heretic-Q4_K_M-GGUF

Image-Text-to-Text • 35B • Updated Apr 17 • 959 • 8

scottgl/MiniMax-M2.7-REAP-172B-A10B-NVFP4-GB10

Text Generation • 98B • Updated Apr 16 • 1.73k • 6

YTan2000/Qwen3.6-35B-A3B-TQ3_4S

Image-Text-to-Text • 35B • Updated Apr 18 • 785 • 83

YTan2000/Huihui-Qwen35-A35B-Ablit-Small-TQ3_4S

Image-Text-to-Text • 35B • Updated Apr 16 • 46 • 1

neroai14/Nero-Qwen2.5-1.5B-Surgical

2B • Updated Apr 18 • 8 • 1

majentik/garden

Text Generation • Updated 3 days ago

AsadIsmail/CogVideoX-2b-ternary

Text-to-Video • 2B • Updated Jul 5 • 5

AsadIsmail/CogVideoX-5b-ternary

Text-to-Video • 6B • Updated Jul 5 • 2

sphaela/gemma-4-E2B-it-AutoRound-GGUF

5B • Updated Apr 24 • 45

armanibadboy/gemma-4-31b-it-route-b-perhead-k37

sphaela/gemma-4-E4B-it-AutoRound-GGUF

8B • Updated Apr 24 • 159 • 1

armanibadboy/discrete-weight-language-gemma-4-31b-it-all-linear

Image-Text-to-Text • 31B • Updated Apr 17 • 7

sphaela/gemma-4-31B-it-AutoRound-GGUF

31B • Updated Apr 24 • 163 • 1

Infatoshi/Qwen3.6-35B-A3B-NVFP4-FP8

Image-Text-to-Text • Updated Apr 17 • 1.98k • 3

sphaela/gemma-4-26B-A4B-it-AutoRound-GGUF

25B • Updated Apr 24 • 346 • 8

AMAImedia/Qwen3.5-9B-Darwin-Opus-NOESIS-AWQ-INT4

Image-Text-to-Text • 9B • Updated Apr 26 • 75 • 20

AMAImedia/Qwen3-1.7B-TTS-Cross-Darwin-NOESIS-AWQ-INT4

Text-to-Speech • 2B • Updated Apr 26 • 17 • 14

AsadIsmail/SmolVLM2-500M-Video-Instruct-ternary

Image-Text-to-Text • Updated Apr 17

AsadIsmail/SmolVLM2-256M-Video-Instruct-ternary

Image-Text-to-Text • Updated Apr 17

AsadIsmail/whisper-medium-ternary

Automatic Speech Recognition • Updated Apr 17

AsadIsmail/whisper-small-ternary

Automatic Speech Recognition • Updated Apr 17

AsadIsmail/Wan2.1-T2V-1.3B-ternary

Text-to-Video • 1B • Updated Jul 5 • 6 • 1

AsadIsmail/Wan2.2-TI2V-5B-ternary

Text-to-Video • 5B • Updated Jul 5 • 15

AMAImedia/Qwen3.5-35B-A3B-Darwin-Opus-NOESIS-AWQ-INT4

Text Generation • 20B • Updated Apr 26 • 23 • 11

AMAImedia/Qwen3.5-35B-A3B-Darwin-Opus-NOESIS-AWQ-INT8

Text Generation • 37B • Updated Apr 26 • 21 • 11

jacob9706/Qwen3.6-35B-A3B-QOR-4bit

Text Generation • 5B • Updated Apr 18 • 36

mradermacher/Nero-Qwen2.5-1.5B-Surgical-GGUF

2B • Updated Apr 18 • 57

sphaela/Qwen3.6-35B-A3B-AutoRound-GGUF

36B • Updated Jul 1 • 3.75k • 17