Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,442

Base only

Active filters: quantization

Danny-Dasilva/Qwen3-4B-antidoom-W4A16-GPTQ-g32-DSpark

Text Generation • 4B • Updated Jul 7 • 17

sakamakismile/ThinkingCap-Qwen3.6-27B-NVFP4

Image-Text-to-Text • 17B • Updated Jul 8 • 6.16k • 20

Danny-Dasilva/Qwen3-8B-antidoom-W4A16-GPTQ-g32-DSpark

Text Generation • 8B • Updated Jul 8 • 242 • 1

SC117/Qwen-AgentWorld-35B-A3B-MTP-Uncensored-APEX-GGUF

Text Generation • 0.4B • Updated Jul 8 • 5.54k • 12

SC117/Qwen-AgentWorld-35B-A3B-MTP-APEX-GGUF

Text Generation • 0.4B • Updated Jul 8 • 2.08k • 4

ApacheOne/orbitquant_unets

Text-to-Image • Updated Jul 10

Litwein/Qwen3.6-35B-A3B-Claude-4.7-Opus-DWQ4-MTP-Vision-MLX

Image-Text-to-Text • 6B • Updated 29 days ago • 579 • 1

Litwein/Qwen3.6-35B-A3B-Claude-4.7-Opus-DWQ4-MTP-MLX

Text Generation • 6B • Updated 29 days ago • 1.4k • 2

Litwein/Qwen3.6-35B-A3B-Claude-4.7-Opus-oQ4-MTP-Vision-MLX

Image-Text-to-Text • 6B • Updated 29 days ago • 530

Litwein/Qwen3.6-35B-A3B-Claude-4.7-Opus-oQ4-MTP-MLX

Text Generation • 6B • Updated 29 days ago • 941

avtc/Hy3-GPTQ-RTN-4bit-tp8

Text Generation • 295B • Updated 16 days ago • 236 • 3

happynood/DeepSeek-R1-Distill-Qwen-1.5B-GGUF

2B • Updated Jul 8 • 72

happynood/DeepSeek-R1-Distill-Qwen-1.5B-GPTQ

2B • Updated Jul 8 • 8

Danny-Dasilva/Qwen3-14B-antidoom-W4A16-GPTQ-g32-DSpark

Text Generation • 15B • Updated Jul 11 • 166

urs-rs/gemma-4-26B-A4B-it-FP8-DYNAMIC

Image-Text-to-Text • 27B • Updated about 1 month ago • 260

shilohjt/GLM-4.5-Air-EXL3-RW-2.25bpw

16B • Updated Jul 9 • 5

yihao-liang/DVD-AWQ

Depth Estimation • Updated Jul 9

Azimml/Qwen3-1.7B-trellis-3bit-webgpu

Updated Jul 9 • 4

Azimml/Qwen3-8B-trellis-3bit-webgpu

Updated Jul 9 • 9

haven-ai-companion/gemma4-e4b-merged-iq4xs-turbo

Text Generation • 8B • Updated about 1 month ago • 361

Azimml/SmolLM2-135M-trellis-3bit-webgpu

Updated Jul 9 • 3

Dhi-Technologies/prompt2model-reference-onnx

Image Classification • Updated 15 days ago

yosoyalguien/Meta-Llama-3.1-8B-Instruct-GGUF-TQ4_1S

8B • Updated Jul 9 • 35

yosoyalguien/Qwen3.5-9B-GGUF-TQ4_1S

9B • Updated Jul 9 • 223

yosoyalguien/gemma-4-E2B-it-GGUF-TQ4_1S

5B • Updated Jul 9 • 102

avtc/Hy3-autoround-RTN-4bit-tp8-ep

Text Generation • 44B • Updated Jul 9 • 40 • 1

yosoyalguien/gemma-4-E4B-it-GGUF-TQ4_1S

8B • Updated Jul 9 • 91

realrebelai/LingBot_ComfyUI

Image-to-Video • Updated Jul 11 • 3.88k • 11

Yingyaeliae/grok-oss-Apollyon-8B-heretic-GGUF

8B • Updated Jul 10 • 220

hongweimeng/Qwen3.5-35B-A3B-AWQ-INT4

Image-Text-to-Text • Updated 28 days ago • 37