Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

15,881

Base only

Active filters: quantized

TheMelonGod/Jan-nano-exl2

Text Generation • Updated Jun 30, 2025 • 12

NVFP4/DeepSeek-Prover-V2-7B-FP4

4B • Updated Jul 23, 2025 • 7 • 1

NVFP4/DeepSeek-R1-0528-Qwen3-8B-FP4

5B • Updated Jul 23, 2025 • 40 • 2

NVFP4/Qwen3-32B-FP4

Text Generation • 19B • Updated Jul 23, 2025 • 891 • 3

NVFP4/Polaris-4B-Preview-FP4

2B • Updated Jul 23, 2025 • 19 • 1

NVFP4/Polaris-7B-Preview-FP4

5B • Updated Jul 23, 2025 • 4 • 1

hdtrnk/Wan2.1_Phantom_FusioniX

Image-to-Video • Updated Jun 25, 2025 • 3

muranAI/DeepSeek-R1-0528-Qwen3-8B-GGUF

8B • Updated Jun 28, 2025 • 259 • 1

hrsvrn/Flux.1-kontext-dev-gguf

12B • Updated Jun 26, 2025 • 10

onnx-community/distiluse-base-multilingual-v2-merged-onnx

Feature Extraction • Updated Jun 26, 2025 • 1

muranAI/gemma-3n-E4B-it-GGUF

Text Generation • 7B • Updated Jun 28, 2025 • 1.21k • 3

agentlans/gemma-3-4b-it-GGUF

4B • Updated Jun 27, 2025 • 36

lym00/Wan2.1_T2V_1.3B_SelfForcing_VACE-GGUF

Image-to-Video • 2B • Updated Jun 28, 2025 • 531 • 4

muranAI/Mistral-Small-3.1-24B-Instruct-2503-GGUF

Text Generation • 24B • Updated Jun 28, 2025 • 191 • 1

vnyaryan/playwright4model_q4_k_m

Text Generation • 3B • Updated Jun 28, 2025 • 25

vnyaryan/playwright5model_q4_k_m

Text Generation • 3B • Updated Jun 28, 2025 • 13

LibraxisAI/Llama-3_1-Nemotron-Ultra-253B-v1-MLX-Q5

Text Generation • 253B • Updated May 11 • 64

agentlans/Qwen3-4B-multilingual-sft

4B • Updated Jun 29, 2025 • 6

agentlans/Qwen3-4B-multilingual-sft-GGUF

Text Generation • 4B • Updated Jun 29, 2025 • 36

RedHatAI/Qwen3-30B-A3B-FP8-block

Text Generation • 31B • Updated Oct 27, 2025 • 4.63k

TheMelonGod/Irixxed-Magcap-12B-Slerp-exl2

Text Generation • Updated Jul 1, 2025 • 13

mlx-community/Qwen3-32B-3bit

33B • Updated Jul 1, 2025 • 28 • 2

steampunque/ultravox-v0_5-llama-3_1-8b-MP-GGUF

8B • Updated Feb 18 • 25

ReallyFloppyPenguin/OCRFlux-3B-GGUF

3B • Updated Jul 2, 2025 • 35 • 1

QuantStack/MAGREF_Wan2.1_I2V_14B-GGUF

Image-to-Video • 16B • Updated Jul 2, 2025 • 440 • 12

WaveCut/gemma-3-1b-it-qat-int4-bnb-nf4

Text Generation • 1B • Updated Jul 2, 2025 • 4

mzbac/flux1.schnell.4bit.mlx

Text-to-Image • Updated Jul 6, 2025

mzbac/flux1.dev.4bit.mlx

Text-to-Image • Updated Jul 6, 2025 • 1

mzbac/flux1.kontext.4bit.mlx

Image-to-Image • Updated Jul 6, 2025 • 7

mzbac/flux1.schnell.8bit.mlx

Text-to-Image • Updated Jul 6, 2025