Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,185

Base only

Active filters: int4

tonera/protovisionXLHighFidelity3D_V660

Text-to-Image • 3B • Updated Jan 23 • 14

tonera/realvisxlV50_v50Lightning

Text-to-Image • 3B • Updated Jan 23 • 8

tonera/sdvn7Nijistylexl_v1

Text-to-Image • 3B • Updated Jan 23 • 10

tonera/sdxlNijiSeven_sdxlNijiSeven

Text-to-Image • 3B • Updated Jan 23 • 20

tonera/waiANINSFWPONYXL_v140

Text-to-Image • 3B • Updated Jan 23 • 28

tonera/waiNSFWIllustrious_v140

Text-to-Image • 3B • Updated Jan 23 • 10

tonera/waiNSFWIllustrious_v150

Text-to-Image • 3B • Updated Jan 23 • 28 • 2

tonera/waiREALMIX_v11

Text-to-Image • 3B • Updated Jan 23 • 17

tonera/waiSHUFFLENOOB_vPred03

Text-to-Image • 3B • Updated Jan 23 • 463

tonera/waiSHUFFLENOOB_vPred20

Text-to-Image • 3B • Updated Jan 23 • 20

DexopT/Qwen2.5-Coder-3B-Instruct-abliterated-MNN

Text Generation • Updated Jan 27 • 167

lokkju/nemotron-speech-streaming-en-0.6b-int4

Updated Jan 30 • 3

bullpoint/Qwen3-Coder-Next-AWQ-4bit

Text Generation • 14B • Updated Feb 3 • 89.5k • 30

hassanshka/Biomni-R0-32B-AWQ-INT4

Text Generation • 6B • Updated Feb 5 • 9

jrc2139/embeddinggemma-300m-qat-q8_0-unquantized-ONNX

Feature Extraction • Updated May 7 • 8

rungalileo/llama-3.2-3B-instruct-trtllm-ckpt-wq_int4_awq-kv_int8

Text Generation • Updated Feb 8 • 9

rungalileo/mistral-7b-instruct-v0.3-trtllm-ckpt-wq_int4_awq-kv_int8

Text Generation • Updated Feb 8 • 8

swzzzzc/Human-Like-Qwen2.5-7B-Instruct-AWQ

8B • Updated Feb 10 • 9

Advantech-EIOT/intel_google-gemma-3-4b-it-int4

Text Generation • Updated Feb 12 • 12

Advantech-EIOT/intel_google-gemma-3-12b-it-int4

Text Generation • Updated Feb 12 • 7

a-ivanovitch/Qwen3-4B-Instruct-2507-AWQ-W4A16

Text Generation • 4B • Updated Feb 12 • 969

DudePls/Big-Tiger-Gemma-27B-v3-int4-asym-ov

Image-Text-to-Text • Updated Feb 16 • 10

inference4j/phi-3-mini-4k-instruct

Text Generation • Updated Feb 16 • 9

inference4j/deepseek-r1-distill-qwen-1.5b

Text Generation • Updated Feb 16

Ex0bit/Kimi-K2.5-PRISM-REAP-530B-A32B

Text Generation • 91B • Updated Feb 22 • 32 • 21

mayflowergmbh/bert-german-ler-onnx-int4

Token Classification • Updated Feb 18 • 9

inference4j/phi-3.5-vision-instruct

Image-Text-to-Text • Updated Feb 18

nitrox/Qwen3-4B-abliterated-v2

4B • Updated Feb 20 • 19

mradermacher/Qwen3-4B-abliterated-v2-GGUF

4B • Updated Feb 20 • 1.97k

mradermacher/Qwen3-4B-abliterated-v2-i1-GGUF

4B • Updated Feb 20 • 98 • 1