Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

192

Base only

Active filters: nf4

sarathi-balakrishnan/Qwen2.5-VL-7B-Medical-LoRA

Image-Text-to-Text • Updated Feb 10 • 5

0ldev/Qwen2.5-VL-3B-Instruct-ov-nf4-npu

Image-Text-to-Text • Updated Feb 20 • 1

0ldev/gemma-3-4b-it-ov-nf4-npu

Text Generation • Updated Feb 20 • 6 • 1

0ldev/Qwen3-VL-2B-Instruct-ov-nf4-npu

Image-Text-to-Text • Updated Feb 20 • 6

EricRollei/HunyuanImage-3-NF4-v2

Text-to-Image • 83B • Updated Feb 21 • 86 • 1

EricRollei/HunyuanImage-3.0-Instruct-Distil-NF4-v2

Text-to-Image • 83B • Updated Feb 22 • 295 • 14

Tushe/nllb-200-600M-nf4-custom-weights-bare-metal

Translation • 0.4B • Updated Feb 24 • 8

MO7YW4NG/ms-marco-MiniLM-L-6-v2-4bit-nf4

Text Ranking • 23.1M • Updated Feb 24 • 2

PavonicAI/HeartMuLa-3B-4bit

4B • Updated Feb 24 • 44 • 2

mrhuseyn4/qwen3.5-27b-mxfp4

Text Generation • 28B • Updated Feb 25

daksh-neo/Nemotron-3-Super-120B-NF4-4bit

Text Generation • 126B • Updated Mar 30 • 52 • 1

hupakabras/Nemotron-3-Nano-30B-A3B-bnb-4bit

Text Generation • 32B • Updated Mar 19 • 98

robotflowlabs/qwen2.5-7b-instruct-int4

Text Generation • 8B • Updated Mar 19 • 4

robotflowlabs/qwen3-vl-2b-instruct-int4

Image-Text-to-Text • 2B • Updated Mar 19 • 9

robotflowlabs/qwen3-vl-4b-instruct-int4

Image-Text-to-Text • 5B • Updated Mar 19 • 236

princeDjoumessi/CogVideoX-5b-nf4

Image-to-Video • Updated Mar 20 • 2

hhhhy888/Qwen3-TTS-12Hz-1.7B-Base-BNB-NF4

Text-to-Speech • 2B • Updated Mar 23 • 41 • 1

emreyigitozturk/llama-3.2-3b-bitsandbytes-4bit-nf4

Text Generation • Updated Mar 24

groxaxo/s2-pro-BnB-4Bits

Text-to-Speech • Updated Mar 25 • 325 • 4

Granddyser/biglove-klein2

Text-to-Image • 9B • Updated Apr 8 • 7.65k • 23

Whomstt/Ministral-3-3B-Instruct-2512-bnb-nf4

Text Generation • 4B • Updated Mar 27 • 4

cudabenchmarktest/personaplex-7b-nf4

Updated Mar 29 • 13

Loke-60000/christina-TTS-nf4

Text-to-Speech • 0.9B • Updated Mar 29 • 131

tantk/vibevoice-1.5b-bnb-4bit

Text-to-Speech • 2B • Updated Apr 2 • 9

livadies/gemma-4-E2B-Ghetto-NF4

Text Generation • 5B • Updated Apr 3 • 29

livadies/gemma-4-31B-Base-Ghetto-NF4

Text Generation • 32B • Updated Apr 3 • 106 • 2

livadies/gemma-4-E4B-Ghetto-NF4

Text Generation • 8B • Updated Apr 3 • 41

SanDiegoDude/JoyAI-Image-Edit-NF4

Updated Apr 4 • 1

dylanneve1/Qwen3.5-0.8B_nf4_sym_group-1_dyn_stateful

Updated Apr 9 • 3

ping98k/open_llama_3b_v2_4bit

Text Generation • 4B • Updated Apr 11 • 14