Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

192

Base only

Active filters: nf4

ping98k/open-llama-3b-opus-reasoning-sft-2k-4bit

Text Generation • 4B • Updated Apr 12 • 7

lhca521/QWEN_IMAGE_nf4_w_AbliteratedTE_Diffusers

Text-to-Image • Updated Apr 12 • 3

ping98k/open-llama-3b-openthought-mid-4bit

Text Generation • 4B • Updated Apr 13 • 4

ping98k/open-llama-3b-openthought-sft-4bit

Text Generation • 4B • Updated Apr 13 • 4

ping98k/open-llama-7b-openthought-mid-4bit

Text Generation • 7B • Updated Apr 14 • 2

Xiejiehang/ERNIE-Image-NF4

Text-to-Image • Updated Apr 14 • 30 • 2

ping98k/open-llama-7b-openthought-sft-4bit

Text Generation • 7B • Updated Apr 15

AndriejusNak/gemma4-26b-moe-finetune

Text Generation • Updated Apr 17 • 1

Truthseeker87/solarhive-26b-a4b-nf4

Image-Text-to-Text • 26B • Updated about 19 hours ago • 43

inspirebek/qwen3-4b-uzbek-v2-bnb-4bit

Text Generation • 5B • Updated Apr 20 • 2

Veetance/ERNIE-8B-NF4

Text-to-Image • Updated Apr 22

Veetance/ERNIE-Turbo-NF4

Text-to-Image • Updated Apr 22 • 3

Veetance/FLUX-Klein-4B-NF4

Text-to-Image • Updated Apr 23 • 1

lkjiop8/CyberSentinel-9B-bnb-4bit

9B • Updated Apr 23 • 1

Veetance/FLUX-Klein-9B-NF4

Text-to-Image • Updated Apr 23 • 3

Veetance/FLUX-Klein-9B-KV-NF4

Text-to-Image • Updated Apr 23

Veetance/Qwen2.5-VL-7B-NF4

Image-Text-to-Text • 9B • Updated Apr 23 • 7

Veetance/Narrative-Brain-5B-NF4

Text Generation • 2B • Updated Apr 23 • 7

Veetance/Z-Image-Turbo-NF4

Text-to-Image • Updated Apr 23 • 8

SanDiegoDude/LLaDA2.0-Uni-bnb-nf4

Any-to-Any • 16B • Updated Apr 24 • 98 • 2

s74101234/Qwen3.5-0.8B-Instruct-NF4

Image-Text-to-Text • 0.9B • Updated Apr 24 • 25

elon-trump/Qwen3.6-27B-4bit-text-only

Text Generation • 28B • Updated Apr 24 • 275

siyah1/EchoMimicV3-NF4

ovedrive/ERNIE-Image-nf4

Text-to-Image • Updated May 1 • 47

dong16/HunyuanImage-3-NF4-v2

Text-to-Image • 83B • Updated Apr 27 • 22

suitch/gemma-4-31B-it-4bit

Image-Text-to-Text • 32B • Updated Apr 28 • 20

xpuenabler/gpt-oss-6.6b-8E-nf4-awq-optimum

Updated Apr 28 • 2

xpuenabler/gpt-oss-6.6b-8E-nf4-awq-optimum-static-128-decode

Updated Apr 29 • 2

xpuenabler/gpt-oss-6.6b-8E-nf4-awq-KVu8-optimum-static-128-decode

Updated Apr 29 • 3

xpuenabler/gpt-oss-6.6b-8E-nf4-awq-KVu8-optimum-static-16k-decode

Updated Apr 29 • 2