Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,836

Base only

Active filters: quantization

xpuenabler/gpt-oss-6.6b-8E-int4-autoround-ov-NNCF-v3

Updated Apr 28 • 4

xpuenabler/gpt-oss-6.6b-8E-nf4-awq-optimum

Updated Apr 28 • 3

xpuenabler/gpt-oss-6.6b-8E-nf4-awq-optimum-static-128-decode

Updated Apr 29 • 2

xpuenabler/gpt-oss-6.6b-8E-nf4-awq-KVu8-optimum-static-128-decode

Updated Apr 29 • 1

aoiandroid/resemble-enhance-fp16-quantized

Audio-to-Audio • Updated Apr 28

aoiandroid/resemble-enhance-int8-quantized

Audio-to-Audio • Updated Apr 28

inferRouter/Qwen3.6-27B-NVFP4

Image-Text-to-Text • 20B • Updated May 12 • 10k

xpuenabler/gpt-oss-6.6b-8E-nf4-awq-KVu8-optimum-static-16k-decode

Updated Apr 29 • 2

xpuenabler/gpt-oss-6.6b-8E-nf4-awq-optimum-static-16k-decode

Updated Apr 29 • 1

Farikhan/Llama-3.1-8B-Instruct-GPTQ-4bit

Text Generation • 2B • Updated Apr 29 • 3

feanors/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-FP8-Dynamic

Text Generation • 35B • Updated Apr 28 • 127 • 2

feanors/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-AWQ-INT4

Image-Text-to-Text • 36B • Updated Apr 28 • 11.7k • 6

lyf/Qwen3.6-27B-heretic-v2-mtp-int4-AutoRound

Image-Text-to-Text • 3B • Updated Apr 28 • 3.54k • 9

xpuenabler/gpt-oss-6.6b-8E-nf4-awq-optimum-static-16k-prefill

Updated Apr 29 • 2

xpuenabler/gpt-oss-6.6b-8E-nf4-awq-KVu8-optimum-static-16k-prefill

Updated Apr 29 • 2

xpuenabler/gpt-oss-6.6b-8E-nf4-awq-optimum-static-128-prefill

Updated Apr 29 • 4

xpuenabler/gpt-oss-6.6b-8E-nf4-awq-KVu8-optimum-static-128-prefill

Updated Apr 29 • 2

Rofati/right-parameters-not-more-parameters

AEON-7/Nemotron-3-Nano-Omni-AEON-Ultimate-Uncensored-NVFP4

Any-to-Any • 20B • Updated 8 days ago • 1.2k • 7

Abiray/Mistral-Medium-3.5-128B-Q4_K_M-GGUF

Text Generation • 125B • Updated May 3 • 286 • 4

inferRouter/Qwen3.6-27B-FP8-lmhead-embed-fp8

Image-Text-to-Text • 28B • Updated Apr 30 • 7

d-alistarh/Qwen3-4B-GSQ-Q3_K_M-GGUF

4B • Updated Apr 30 • 2

d-alistarh/Qwen3-8B-GSQ-Q3_K_M-GGUF

8B • Updated Apr 30 • 8

SuperJerem/voxtral-coalition

XiaofanQue/llama2-7b-scheme3c-ptq

7B • Updated Apr 30 • 2

nrl-ai/vn-spell-correction-small-onnx-int8

Text Generation • Updated May 1 • 9

nrl-ai/vn-spell-correction-base-onnx-int8

Text Generation • Updated May 1 • 27

nrl-ai/vn-diacritic-vit5-base-onnx-int8

Text Generation • Updated May 1 • 3

Tribewarez/pot-o-slim-greenhouse-666

Text Generation • 667k • Updated May 1 • 4

d-alistarh/Qwen3.5-9B-GSQ-Q3_K_M-GGUF

9B • Updated May 1 • 16