Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

645

Base only

Active filters: int4

tonera/prefectIllustriousXL_v20p

Text-to-Image • Updated Jan 23 • 16

tonera/prefectIllustriousXL_v3

Text-to-Image • Updated Jan 23 • 27

tonera/prefectPonyXL_v6

Text-to-Image • Updated Jan 23 • 6

tonera/protovisionXLHighFidelity3D_V660

Text-to-Image • Updated Jan 23 • 13

tonera/realvisxlV50_v50Lightning

Text-to-Image • Updated Jan 23 • 7

tonera/sdvn7Nijistylexl_v1

Text-to-Image • Updated Jan 23 • 7

tonera/sdxlNijiSeven_sdxlNijiSeven

Text-to-Image • Updated Jan 23 • 4

tonera/waiANINSFWPONYXL_v140

Text-to-Image • Updated Jan 23 • 30

tonera/waiNSFWIllustrious_v140

Text-to-Image • Updated Jan 23 • 85

tonera/waiREALMIX_v11

Text-to-Image • Updated Jan 23 • 5

tonera/waiSHUFFLENOOB_vPred03

Text-to-Image • Updated Jan 23 • 24

tonera/waiSHUFFLENOOB_vPred20

Text-to-Image • Updated Jan 23 • 27

DexopT/Qwen2.5-Coder-3B-Instruct-abliterated-MNN

Text Generation • Updated Jan 27 • 33

lokkju/nemotron-speech-streaming-en-0.6b-int4

Updated Jan 30 • 3

tonera/Beyond_Reality_Zimage_v2_svdq

Text-to-Image • Updated Feb 1 • 14 • 1

bullpoint/Qwen3-Coder-Next-AWQ-4bit

Text Generation • 14B • Updated Feb 3 • 89.1k • 26

hassanshka/Biomni-R0-32B-AWQ-INT4

Text Generation • 6B • Updated Feb 5 • 38

jrc2139/embeddinggemma-300m-qat-q8_0-unquantized-ONNX

Feature Extraction • Updated about 1 month ago • 7

Teaspoon-AI/Voxtral-Mini-4B-INT4-Jetson

Updated Feb 16 • 11 • 3

rungalileo/llama-3.2-3B-instruct-trtllm-ckpt-wq_int4_awq-kv_int8

Text Generation • Updated Feb 8 • 14

rungalileo/mistral-7b-instruct-v0.3-trtllm-ckpt-wq_int4_awq-kv_int8

Text Generation • Updated Feb 8 • 5

swzzzzc/Human-Like-Qwen2.5-7B-Instruct-AWQ

8B • Updated Feb 10 • 1

Advantech-EIOT/intel_google-gemma-3-4b-it-int4

Text Generation • Updated Feb 12 • 2

Advantech-EIOT/intel_google-gemma-3-12b-it-int4

Text Generation • Updated Feb 12 • 11

Sophia-AI/Qwen3-4B-Instruct-2507-AWQ-W4A16

Text Generation • 4B • Updated Feb 12 • 291

DudePls/Big-Tiger-Gemma-27B-v3-int4-asym-ov

Image-Text-to-Text • Updated Feb 16 • 3

inference4j/phi-3-mini-4k-instruct

Text Generation • Updated Feb 16 • 5

inference4j/deepseek-r1-distill-qwen-1.5b

Text Generation • Updated Feb 16

Ex0bit/Kimi-K2.5-PRISM-REAP-530B-A32B

Text Generation • 91B • Updated Feb 22 • 156 • 21

mayflowergmbh/bert-german-ler-onnx-int4

Token Classification • Updated Feb 18 • 7