Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

11,589

Base only

Active filters: quantized

LordNeel/Hy3-GGUF

Text Generation • 295B • Updated 1 day ago • 165 • 2

mlx-community/Hy3-oQ2

Text Generation • 29B • Updated 1 day ago • 239 • 3

NAMAA-Space/cohere-transcribe-arabic-07-2026-int4

Automatic Speech Recognition • 2B • Updated about 3 hours ago • 14 • 2

brewbadgertim/10Eros_Quants

Updated about 19 hours ago • 2

RedHatAI/Llama-3.3-70B-Instruct-FP8-dynamic

Text Generation • 71B • Updated Jun 9 • 50k • 17

MaziyarPanahi/Phi-4-mini-instruct-GGUF

Text Generation • 4B • Updated Mar 1, 2025 • 112k • 14

QuantStack/Wan2.1_T2V_14B_FusionX-GGUF

Text-to-Video • 14B • Updated Jun 12, 2025 • 2.07k • 29

QuantStack/Wan2.1_T2V_14B_FusionX_VACE-GGUF

Image-to-Video • 17B • Updated Jun 12, 2025 • 2.56k • 59

lym00/Wan2.1_T2V_1.3B_SelfForcing_VACE-GGUF

Image-to-Video • 2B • Updated Jun 28, 2025 • 373 • 4

Raymond-dev-546730/ClinicalThought-AI-8B

Text Generation • 8B • Updated 9 days ago • 314 • 8

magicunicorn/whisper-large-v3-amd-npu-int8

Updated Aug 30, 2025 • 1 • 4

nvidia/Llama-3.1-8B-Instruct-NVFP4

5B • Updated Sep 15, 2025 • 281k • 13

videosdk-live/Namo-Turn-Detector-v1-Multilingual

Voice Activity Detection • Updated Oct 15, 2025 • 18.5k • 25

unsloth/Qwen-Image-2512-GGUF

Text-to-Image • 20B • Updated Jan 6 • 69.5k • 386

QuantFunc/Nunchaku-Qwen-Image-EDIT-2511

Image-to-Image • Updated 22 days ago • 3.83k • 105

Sikaworld1990/gemma-3-12b-it-abliterated-sikaworld-high-fidelity-edition-Ltx-2

Updated Mar 11 • 24

Sikaworld1990/gemma3-12B-hereticx-sikaworld-ltx-2

Updated Mar 11 • 13

intrect/VELA

Text Generation • 8B • Updated Apr 1 • 141 • 3

JEILDLWLRMA/Qwen3-VL-4B-Instruct-NVFP4

Image-to-Text • 3B • Updated Feb 7 • 293 • 3

andrevp/Nanbeige4.1-3B-MLX-4bit

Text Generation • 0.6B • Updated Feb 17 • 67 • 4

RedHatAI/Qwen3-Coder-Next-NVFP4

Text Generation • Updated Apr 28 • 75.1k • 33

saricles/Qwen3-Coder-Next-NVFP4-GB10

Text Generation • Updated Mar 1 • 5.3k • 36

nvidia/GLM-5-NVFP4

Text Generation • 435B • Updated Apr 10 • 37.4k • 30

AxionML/Qwen3.5-122B-A10B-NVFP4

Image-Text-to-Text • 62B • Updated Mar 3 • 179 • 7

mlx-community/Qwen3.5-4B-OptiQ-4bit

Text Generation • 0.9B • Updated 21 days ago • 7.64k • 24

lukealonso/Qwen3.5-397B-A17B-NVFP4

Text Generation • Updated Apr 12 • 3.14k • 10

ApacheOne/FLUX.2-klein-9b-kv-nvfp4_mixed

Updated Mar 13 • 13 • 10

pessini/Tucano2-qwen-3.7B-Think-MLX-4bit

0.6B • Updated Mar 14 • 467 • 1

mlx-community/bge-m3-mlx-8bit

Feature Extraction • 0.2B • Updated Mar 16 • 1.13k • 1

lyf/Qwen3.5-27B-Uncensored-HauhauCS-Aggressive-NVFP4

Image-Text-to-Text • 17B • Updated Apr 25 • 436 • 10