Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,836

Base only

Active filters: quantization

5dimension/sentinel-1-alpha-text-micro

Text Generation • Updated Apr 26 • 617

5dimension/sentinel-1-alpha-image-micro

Text Generation • Updated Apr 26 • 610

5dimension/sentinel-1-alpha-video-micro

Text Generation • Updated Apr 26 • 600

Entrit/Qwen2.5-72B-trit-uniform-d2

Text Generation • 73B • Updated 9 days ago • 54

Entrit/Qwen2.5-72B-trit-uniform-d3

Text Generation • 73B • Updated 9 days ago • 46

Entrit/Qwen2.5-72B-trit-uniform-d4

Text Generation • 73B • Updated 9 days ago • 47

Entrit/Qwen2.5-32B-trit-uniform-d2

Text Generation • 33B • Updated 10 days ago • 61

Entrit/Qwen2.5-32B-trit-uniform-d3

Text Generation • 33B • Updated May 4 • 38

Entrit/Qwen2.5-32B-trit-uniform-d4

Text Generation • 33B • Updated May 4 • 42

benjiaiplayground/LLaDA2.0-Uni-FP8

16B • Updated Apr 29 • 5 • 2

Entrit/Qwen2.5-7B-qat-d2-6k

Text Generation • 8B • Updated May 4 • 36

EnsueAI/DeepSeek-V4-Flash-Base-INT4

Updated Apr 26 • 6

necroyancer/gemma-4-31B-it-NVFP4-turbo-vision

Image-Text-to-Text • 33B • Updated Apr 26 • 19.2k • 4

manjunathshiva/Nemotron-3-Super-120B-A12B-tq3a-tq2e-g32

Text Generation • 121B • Updated May 9 • 1.79k • 1

kartmannXu/MERaLiON-2-3B-EAGLE-W4A16

Automatic Speech Recognition • Updated Apr 27

sombra-x/GLM-5.1-REAP-Solidity-MXFP8

Text Generation • 381B • Updated Apr 27 • 476

dong16/HunyuanImage-3-NF4-v2

Text-to-Image • 83B • Updated Apr 27 • 4

pearl-ai/Llama-3.3-70B-Instruct-pearl

Text Generation • 71B • Updated Apr 27 • 5.62k • 3

xpuenabler/gpt-oss-4.2b-4E-int4-autoround-ov-NNCF

Updated Apr 27 • 4

keithnull/Qwen3.6-VL-REAP-26B-A3B-GGUF

Image-Text-to-Text • 27B • Updated May 5 • 2.24k • 5

abhinand/Qwen3.6-35B-A3B-int4-AutoRound

Image-Text-to-Text • 6B • Updated Apr 27 • 670

clxudfast/huihui4-8b-a4b-v2-Q4_K_M

8B • Updated Apr 27 • 14

rdtand/MiniMax-M2.7-PrismaQuant-3.20bit-vllm

Text Generation • 94B • Updated Apr 28 • 1.57k • 10

xpuenabler/gpt-oss-6.6b-8E-int4-autoround-ov-NNCF

Updated Apr 28 • 5

xpuenabler/gpt-oss-4.8b-5E-int4-autoround-ov-NNCF

Updated Apr 28 • 4

Venugopalan2610/BCJR-QAT-Llama-3.2-1B-2bit

xpuenabler/gpt-oss-6.6b-8E-int4-autoround-ov-NNCF-v2

Updated Apr 28 • 4

xpuenabler/gpt-oss-6.6b-8E-int4-autoround-ov-NNCF-v3

Updated Apr 28 • 4

xpuenabler/gpt-oss-6.6b-8E-nf4-awq-optimum

Updated Apr 28 • 3

xpuenabler/gpt-oss-6.6b-8E-nf4-awq-optimum-static-128-decode

Updated Apr 29 • 2