Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

234

Base only

Active filters: nf4

iMiW/Giga-Embeddings-instruct-4bit-nf4

Feature Extraction • 4B • Updated Oct 16, 2025 • 45.3k • 1

EricRollei/HunyuanImage-3.0-Instruct-NF4-v2

Text-to-Image • 83B • Updated Feb 22 • 788 • 6

cudabenchmarktest/personaplex-7b-nf4

Updated Mar 29 • 10 • 1

SanDiegoDude/Cosmos3-Nano-nf4

Text-to-Image • 8B • Updated Jun 2 • 56 • 3

ABDALLALSWAITI/Maxwell

Text-to-Image • 6B • Updated Sep 7, 2024 • 2

Human23/EverFlux

Text-to-Image • Updated Jul 16, 2025 • 1

sarthak247/Wan2.1-T2V-1.3B-nf4

Text-to-Video • 1B • Updated Mar 2, 2025 • 366 • 6

mengqin1/RedidreamNSFWI1-bnb-4bit

Updated May 10, 2025 • 1

Kikinoking/MNLP_M3_quantized_model

Text Generation • 0.6B • Updated Jun 10, 2025 • 5

WaveCut/gemma-3-1b-it-qat-int4-bnb-nf4

Text Generation • 1B • Updated Jul 2, 2025 • 6

jw-sohn/Llama-3.1-8B-Instruct-nf4

Text Generation • 8B • Updated Aug 17, 2025 • 7

kotlarmilos/phi-4-mini-dotnet-runtime

Text Generation • Updated Jul 9 • 1

rapidfire-ai-inc/mistral-7b-sft-bnb-4bit

Text Generation • 7B • Updated Oct 6, 2025 • 6 • 1

AlekseyCalvin/QWEN_IMAGE_nf4_w_AbliteratedTE_Diffusers

Text-to-Image • 11B • Updated Aug 6, 2025 • 57 • 15

lopho/Wan2.2-T2V-A14B-Diffusers_nf4_transformer

15B • Updated Aug 10, 2025 • 18 • 2

lopho/Wan2.2-T2V-A14B-Diffusers_nf4_transformer_2

15B • Updated Aug 10, 2025 • 16 • 1

lopho/Wan2.2-T2V-A14B-Diffusers_nf4_text_encoder

6B • Updated Aug 18, 2025 • 6 • 3

lopho/Wan2.2-T2V-A14B-Diffusers_nf4

Text-to-Video • 7B • Updated Aug 18, 2025 • 47 • 1

je-suis-tm/monica_bellucci_lora_flux_nf4

Text-to-Image • Updated Jan 2 • 18 • • 2

lopho/Wan2.2-I2V-A14B-Diffusers_nf4_transformer

15B • Updated Aug 18, 2025 • 16 • 1

lopho/Wan2.2-I2V-A14B-Diffusers_nf4_transformer_2

15B • Updated Aug 18, 2025 • 11 • 2

lopho/Wan2.2-I2V-A14B-Diffusers_nf4

Image-to-Video • 7B • Updated Aug 18, 2025 • 34 • 1

je-suis-tm/marisa_abela_lora_flux_nf4

Text-to-Image • Updated Jan 2 • 6 • • 1

je-suis-tm/vanessa_kirby_lora_flux_nf4

Text-to-Image • Updated Jan 2 • 18 •

je-suis-tm/melanie_laurent_lora_flux_nf4

Text-to-Image • Updated Jan 2 • 6 •

je-suis-tm/brie_larson_lora_flux_nf4

Text-to-Image • Updated Jan 2 • 21 •

je-suis-tm/sky_bri_lora_flux_nf4

Text-to-Image • Updated Jan 2 • 12 •

marcusmi4n/abeja-qwen2.5-7b-japanese-quantized

Text Generation • 8B • Updated Sep 1, 2025 • 11

sweatSmile/HF-SmolLM-1.7B-0.5B-4bit-coder

Text Generation • 2B • Updated Sep 10, 2025 • 10 • 1

rapidfire-ai-inc/Llama-3.2-1B-bnb-4bit

Text Generation • 1B • Updated Oct 6, 2025 • 7