Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,481

Base only

Active filters: quantization

necroyancer/gemma-4-31B-it-NVFP4-turbo-vision

Image-Text-to-Text • 33B • Updated Apr 26 • 965 • 4

manjunathshiva/Nemotron-3-Super-120B-A12B-tq3a-tq2e-g32

Text Generation • 121B • Updated 29 days ago • 398 • 1

kartmannXu/MERaLiON-2-3B-EAGLE-W4A16

Automatic Speech Recognition • Updated Apr 27

sombra-x/GLM-5.1-REAP-Solidity-MXFP8

Text Generation • 381B • Updated Apr 27 • 65

dong16/HunyuanImage-3-NF4-v2

Text-to-Image • 83B • Updated Apr 27 • 7

inferRouter/Qwen3.6-27B-FP8-lmhead-fp8

Image-Text-to-Text • 28B • Updated Apr 29 • 42 • 2

pearl-ai/Llama-3.3-70B-Instruct-pearl

Text Generation • 71B • Updated Apr 27 • 1.33k • 3

keithnull/Qwen3.6-VL-REAP-26B-A3B-GGUF

Image-Text-to-Text • 27B • Updated May 5 • 2.47k • 7

abhinand/Qwen3.6-35B-A3B-int4-AutoRound

Image-Text-to-Text • 6B • Updated Apr 27 • 237

w-ahmad/Qwen3.5-9B-GGUF-MoQ

Text Generation • 9B • Updated Jun 6 • 2.59k • 22

rdtand/MiniMax-M2.7-PrismaQuant-3.20bit-vllm

Text Generation • 94B • Updated Apr 28 • 1.03k • 11

Venugopalan2610/BCJR-QAT-Llama-3.2-1B-2bit

aoiandroid/resemble-enhance-fp16-quantized

Audio-to-Audio • Updated Apr 28

aoiandroid/resemble-enhance-int8-quantized

Audio-to-Audio • Updated Apr 28

inferRouter/Qwen3.6-27B-NVFP4

Image-Text-to-Text • 20B • Updated May 12 • 304

Farikhan/Llama-3.1-8B-Instruct-GPTQ-4bit

Text Generation • 2B • Updated Apr 29 • 7

feanors/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-FP8-Dynamic

Text Generation • 35B • Updated Apr 28 • 70 • 2

feanors/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-AWQ-INT4

Image-Text-to-Text • 36B • Updated Apr 28 • 687 • 7

lyf/Qwen3.6-27B-heretic-v2-mtp-int4-AutoRound

Image-Text-to-Text • 3B • Updated Apr 28 • 1.29k • 10

Rofati/right-parameters-not-more-parameters

AEON-7/Nemotron-3-Nano-Omni-AEON-Ultimate-Uncensored-NVFP4

Any-to-Any • 20B • Updated 30 days ago • 3.67k • 9

Abiray/Mistral-Medium-3.5-128B-Q4_K_M-GGUF

Text Generation • 125B • Updated May 3 • 106 • 4

inferRouter/Qwen3.6-27B-FP8-lmhead-embed-fp8

Image-Text-to-Text • 28B • Updated Apr 30 • 21

d-alistarh/Qwen3-4B-GSQ-Q3_K_M-GGUF

4B • Updated Apr 30 • 10

d-alistarh/Qwen3-8B-GSQ-Q3_K_M-GGUF

8B • Updated Apr 30 • 5

SuperJerem/voxtral-coalition

XiaofanQue/llama2-7b-scheme3c-ptq

7B • Updated Apr 30 • 7

nrl-ai/vn-spell-correction-small-onnx-int8

Text Generation • Updated May 1 • 29

nrl-ai/vn-spell-correction-base-onnx-int8

Text Generation • Updated May 1 • 23

nrl-ai/vn-diacritic-vit5-base-onnx-int8

Text Generation • Updated May 1 • 36