Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

4-bit precision

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

62

Base only

Active filters: 4-bit precision

Vishalshendge3198/orpheus-3b-tts-german-emotional-merged

Text-to-Speech • 3B • Updated Mar 21

TxemAI/Qwen3.5-27B-4bit-MLX

Text Generation • 27B • Updated Apr 4 • 257

Crusadersk/mistral-7b-gptq-4bit

Text Generation • 7B • Updated Jul 6 • 9

Crusadersk/mistral-7b-awq-4bit

Text Generation • 7B • Updated Jul 6 • 11

Crusadersk/qwen2.5-7b-gptq-4bit

Text Generation • 8B • Updated Jul 6 • 20

Crusadersk/qwen2.5-7b-awq-4bit

Text Generation • 2B • Updated Jul 6 • 11

Akira-Papa/akira-papa-1.0-31b-jp

31B • Updated Apr 14 • 63 • 4

openbmb/MiniCPM-V-4_5-GPTQ

Image-Text-to-Text • 9B • Updated Jun 2 • 369 • 3

nvidia/GLM-5.1-NVFP4

Text Generation • 382B • Updated May 27 • 12.6k • 42

neuroturk/HYZ-01-0.6B

Text Generation • 0.6B • Updated Jul 19 • 100 • 1

mradermacher/HYZ-01-0.6B-GGUF

Question Answering • 0.6B • Updated Jun 18 • 139

turen01/GLM-5.1-NVFP4

Text Generation • 382B • Updated Jun 16 • 16

mradermacher/HYZ-01-0.6B-i1-GGUF

Question Answering • 0.6B • Updated Jun 18 • 350

mmangkad/GLM-5.2-NVFP4

Text Generation • 381B • Updated Jun 23 • 47 • 3

MarshallHD/LFM2.5-230M-NVFP4

Text Generation • 0.2B • Updated Jun 27 • 179 • 2

disguisequence/GLM-5.2-NVFP4

Text Generation • 381B • Updated Jun 29 • 19

formatcaha/GLM-5.2-NVFP4

Text Generation • 381B • Updated Jul 1 • 17

VX3/GLM-5.2-NVFP4

Text Generation • 381B • Updated Jul 4 • 27

TechnoBaptist/GLM-5.2-NVFP4

Text Generation • 381B • Updated Jul 7 • 21

dbaek111/fastvlm-0.5b-mlx-q4

Image-Text-to-Text • 99.1M • Updated Jul 13 • 41

dbaek111/fastvlm-1.5b-mlx-q4

Image-Text-to-Text • 0.3B • Updated Jul 13 • 16

dbaek111/fastvlm-7b-mlx-q4

Image-Text-to-Text • 1B • Updated Jul 13 • 37

zhangpengshou/GLM-5.2-NVFP4

Text Generation • 381B • Updated Jul 10 • 22

freesea/GLM-5.2-NVFP4

Text Generation • 381B • Updated Jul 11 • 25 • 2

ckoh04/GLM-5.2-NVFP4-active-slice

Text Generation • 32B • Updated Jul 23 • 60 • 1

tengsnake/Llama-Guard-4-12B-NVFP4

Text Generation • 12B • Updated 30 days ago • 133 • 3

rudrakshrakeshzodage/nllb-200-distilled-600M-nf4-4bit-gpu

Translation • Updated 21 days ago

rudrakshrakeshzodage/nllb-200-distilled-600M-fp32

Translation • 0.6B • Updated 21 days ago • 127

rudrakshrakeshzodage/nllb-200-distilled-600M-fp16

Translation • 0.6B • Updated 21 days ago • 83

Arsh9210/GLM-5.2-NVFP4

Text Generation • 381B • Updated 28 days ago • 60 • 1